People of color are adversely affected by artificial intelligence (AI) bias. The effects of AI bias have been noted in facial recognition technology, mortgage lending, and algorithms used to determine healthcare treatments. People impacted by AI bias are rarely represented in the development of AI technology (Atker et al., 2021). To prevent AI bias, including diverse perspectives in the creation of Responsible AI (RAI), artifacts that shape policies, procedures, and governance models, could address potential problems in the development of AI.
RAI is an emerging business discipline that examines legal, ethical, and moral standpoints of technology development to help reduce AI bias (Barredo et al., 2020, Taylor et al., 2018). By tying impacted people to innovation and incorporating their ideas as stakeholders, innovations gain substantive and symbolic support from those who are most affected by innovation (Boon et al., 2021). My motivation is explore broader employee stakeholder participation in IS, AI and Organizational Learning. Therefore, I seek to answer the following research question: "How does the participation of African American employee stakeholders in the creation of Responsible AI "shaping artifacts" reduce bias in AI?"

* Let it RAIN for Social Good, Mattias Brännström, Andreas Theodorou, Virginia Dignum
* Accountability and Responsibility of Artificial Intelligence Decision-making Models in Indian Policy Landscape, Palak Malhotra, Amita Misra

* Assessing Demographic Bias Transfer from Dataset to Model: A Case Study in Facial Expression Recognition, Iris Dominguez-Catena, Daniel Paternain, Mikel Galarm

> Debate Panel - Session Discussants: Elizabeth Adams, Gabriel Pedroza

Three years later, how far have we gotten in putting the OECD AI principles into practice?
Governments and other stakeholders have been working to implement the OECD AI Principles to make artificial intelligence trustworthy for people and planet. This talk is a timely occasion to highlight work to date and discuss future priorities.
The talk will showcase recent initiatives developed by the OECD Working Party on Artificial Intelligence Governance (AIGO) and the OECD.AI Network of Experts, including the OECD.AI Policy Observatory, a catalogue of tools for trustworthy AI, a user-friendly framework for classifying different types of AI systems and a global AI incidents tracker. The discussion will seek to highlight good AI policy practices related to AI governance.

* A Hierarchical HAZOP-Like Safety Analysis for Learning-Enabled Systems, Yi Qi, Philippa Ryan Conmy, Wei Huang, Xingyu Zhao, Xiaowei Huang
* Increasingly Autonomous CPS: Taming Emerging Behaviors from an Architectural Perspective, Jerome Hugues, Daniela Cancila

* CAISAR: A platform for Characterizing Artificial Intelligence Safety and Robustness, Julien Girard-Satabin, Michele Alberti, François Bobot, Zakaria Chihani, Augustin Lemesle

> Debate Panel - Session Discussants:  Luis Aranda, Douglas Lange, Mattias Brännström (Umeå University, Sweden)

Gary Marcus is a leading voice in artificial intelligence. He is a scientist, best-selling author, and serial entrepreneur (Founder of Robust.AI and Geometric.AI, acquired by Uber). He is well-known for his challenges to contemporary AI, anticipating many of the current limitations decades in advance, and for his research in human language development and cognitive neuroscience.
An Emeritus Professor of Psychology and Neural Science at NYU, he is the author of five books, including, The Algebraic Mind, Kluge, The Birth of the Mind, and the New York Times Bestseller Guitar Zero. He has often contributed to The New Yorker, Wired, and The New York Times. His most recent book, Rebooting AI, with Ernest Davis, is one of Forbes’s 7 Must Read Books in AI.

* Revisiting the Evaluation of Deep Neural Networks for Pedestrian Detection, Patrick Feifel, Benedikt Franke, Arne Raulf, Friedhelm Schwenker, Frank Bonarens, Frank Köster
* Improvement of Rejection for AI Safety through Loss-Based Monitoring, Daniel Scholz, Florian Hauer, Klaus Knobloch, Christian Mayr

> Debate Panel - Session Discussants: Gary Marcus, John Burden, Gabriel Pedroza

The purpose of TAILOR is to build a strong academic-public-industrial research network (https://tailor-network.eu/), with more than 50 partners from all Europe, with the capacity of providing the scientific basis for Trustworthy AI leveraging and combining learning, optimization and reasoning for realizing AI systems that incorporate the safeguards that make them in the reliable, safe, transparent and respectful of human agency and expectations.

The special session will present an overview of the TAILOR project (Foundations of Trustworthy AI – Integrating Reasoning, Learning and Optimization) and the activities that have been carried on within the project. Then, a panel with experts both from and outside the project consortium will investigate the current challenges and solutions that have been developed to support the Trustworthy AI.

We review several ways in which formal methods can enhance the quality of neural networks:
first, to learn neural networks with guaranteed properties;
second, to verify properties of neural networks;
and third, to enforce properties of neural networks at runtime.
For the first topic, we discuss reinforcement learning with temporal objectives in stochastic environments; for the second, decision procedures for reasoning about quantized neural networks; for the third, monitoring learned classifiers for novelty detection and fairness, and shielding learned controllers for safety and progress.

* Utilizing Class Separation Distance for the Evaluation of Corruption Robustness of Machine Learning Classifiers, Georg Siedel, Silvia Vock, Andrey Morozov, Stefan Voßd
* Safety-aware Active Learning with Perceptual Ambiguity and Criticality Assessment, Prajit T Rajendran, Guillaume Ollier, Huascar Espinoza, Morayo Adedjouma, Agnes Delaborde, Chokri Mraidha

* Understanding Adversarial Examples Through Deep Neural Network's Classification Boundary and Uncertainty Regions, Juan Shu, Bowei Xi, Charles Kamhoua

> Debate Panel - Session Discussants: Thomas A. Henzinger, Fernando Martinez Plumed

Deep Learning (DL) has become a fundamental building block of learning-enabled autonomous systems. Notwithstanding its great potential, employing DL in safety- and security-critical applications, including robots providing service in healthcare facilities or drones used for inspection and maintenance, raises significant trustworthiness challenges. Within the European project SESAME, we develop a model-based approach supporting the systematic engineering of dependable learning-enabled robotic systems. In this talk, we will overview recent advances made by the project team to provide assurances for the trustworthy, robust and explainable operation of DL, focusing particularly on techniques for deep learning testing and uncertainty analysis.

* Leveraging generative models to characterize the failure conditions of image classifiers, Adrien Le Coz, Stéphane Herbin, Faouzi Adjed
* Feasibility of Inconspicuous GAN-generated Adversarial Patches against Object Detection, Svetlana Pavlitskaya, Bianca-Marina Codău, J. Marius Zöllner

* Privacy Safe Representation Learning via Frequency Filtering Encoder, Jonghu Jeong, Minyong Cho, Philipp Benz, Jinwoo Hwang, Jeewook Kim, Seungkwan Lee, Tae-hoon Kim

* Benchmarking and deeper analysis of adversarial patch attack on object detectors, Pol Labarbarie, Adrien Chan Hon Tong, Stéphane Herbin, Milad Leyli-Abadi

> Debate Panel - Session Discussants: Simos Gerasimou, Bowei Xi (Purdue University), Gabriel Pedroza

While still debating some questions (such as the likelihood of achieving Artificial General Intelligence), the AI community in particular and most of the related stakeholders in general, seem to be more or less convinced that "AI winters" are a thing of the past and that the current "summer" will never end. Indeed, this rapidly evolving field, especially through the recent Deep Learning advances, is too good at particular useful tasks to simply disappear. There is little doubt, for example, that neural networks are poised to permeate a growing number of everyday applications, including sensitive software where trust is paramount.
But as these artifacts move from a fad status to more stably ubiquitous components, their deepening interweaving with different aspects of society deserves a special attention to the development of methods and tools for an adequate characterization of AI trustworthiness. This colossal quest is made difficult by the intrinsic opacity of neural networks and their increasing size, making any method that can bring us closer to trustworthiness a precious commodity. In this talk, we take a retrospective look at some of these methods, and discuss their current added value to safety, as well as the promises they hold for the future of AI trustworthiness.

* The impact of averaging logits over probabilities on ensembles of neural networks, Cedrique Rovile Njieutcheu Tassi, Jakob Gawlikowski, Auliya Unnisa Fitri, Rudolph Triebel
* Exploring Diversity in Neural Architectures for Safety, Michał Filipiuk, Vasu Singh

* Constrained Policy Optimization for Controlled Contextual Bandit Exploration, Mohammad Kachuee, Sungjin Lee

* A causal perspective on AI deception in games, Francis Rhys Ward, Francesco Belardinelli, Francesca Toni

> Debate Panel - Session Discussants: Zakaria Chihani, Jose Hernandez-Orallo