PROGRAMME
The IJCAI-PRICAI organizing committee has decided that all sessions will be held, as a Virtual event, at daytime in Japan. AISafety has been planned as a two-half-days workshop to fit the best for the time zones of speakers.
Thursday Jan 7th - 8am to 12pm UTC (Japan: + 9 hrs)
Friday Jan 8th - 12am to 4am UTC (Japan: + 9 hrs)
INVITED SPEAKERS
BEST PAPER AWARD
The Program Committee (PC) will designate up to 3-5 papers as candidates to the AISafety Best Paper Award.
The selected candidates are:
The AISafety 2020 Best Paper Award was granted to:
Rachel Freedman, Rohin Shah and Anca Dragan for Classifying Choice Set Misspecification in Reward Inference.
The best paper will be selected based on the votes of the workshop’s participants. During the workshop, all participants will be able to vote for the best paper.
The authors of the Best Paper Award will receive a certificate with the name of the award, the name of the paper, and the names of the authors of the paper, at the workshop’s closing.
ORGANIZING COMMITTEE
-
Huáscar Espinoza, Commissariat à l´Energie Atomique, France
-
John McDermid, University of York, UK
-
Xiaowei Huang, University of Liverpool, UK
-
Mauricio Castillo-Effen, Lockheed Martin, USA
-
Cynthia Chen, University of Hong Kong, China
-
José Hernández-Orallo, Universitat Politècnica de València, Spain
-
Seán Ó hÉigeartaigh, University of Cambridge, UK
-
Richard Mallah, Future of Life Institute, USA
PROGRAMME COMMITTEE
-
Stuart Russell, UC Berkeley, USA
-
Simos Gerasimou, University of York, UK
-
Jonas Nilson, NVIDIA, USA
-
Brent Harrison, University of Kentucky, USA
-
Siddartha Khastgir, University of Warwick, UK
-
Carroll Wainwright, Partnership on AI, USA
-
Martin Vechev, ETH Zurich, Switzerland
-
Sandhya Saisubramanian, University of Massachusetts Amherst, USA
-
Alessio R. Lomuscio, Imperial College London, UK
-
Rachel Freedman, UC Berkeley, USA
-
Brian Tse, Affiliate at University of Oxford, China
-
Michael Paulitsch, Intel, Germany
-
Rick Salay, University of Toronto, Canada
-
Ganesh Pai, NASA Ames Research Center, USA
-
Hélène Waeselynck, CNRS LAAS, France
-
Rob Alexander, University of York, UK
-
Vahid Behzadan, Kansas State University, USA
-
Simon Fürst, BMW, Germany
-
Chokri Mraidha, CEA LIST, France
-
Orlando Avila-García, Atos, Spain
-
Rob Ashmore, Defence Science and Technology Laboratory, UK
-
I-Jeng Wang, Johns Hopkins University, USA
-
Chris Allsopp, Frazer-Nash Consultancy, UK
-
Francesca Rossi, IBM and University of Padova, Italy
-
Ramana Kumar, Google DeepMind, UK
-
Javier Ibañez-Guzman, Renault, France
- Jérémie Guiochet, LAAS-CNRS, France
-
Raja Chatila, Sorbonne University, France
-
Hang Su, Tsinghua University, China
-
François Terrier, CEA LIST, France
-
Mehrdad Saadatmand, RISE SICS, Sweden
-
Alec Banks, Defence Science and Technology Laboratory, UK
-
Gopal Sarma, Broad Institute of MIT and Harvard, USA
-
Philip Koopman, Carnegie Mellon University, USA
-
Roman Nagy, Argo AI, Germany
-
Nathalie Baracaldo, IBM Research, USA
-
Toshihiro Nakae, DENSO Corporation, Japan
-
Peter Flach, University of Bristol, UK
-
Richard Cheng, California Institute of Technology, USA
-
José M. Faria, Safe Perspective, UK
-
Ramya Ramakrishnan, Massachusetts Institute of Technology, USA
-
Gereon Weiss, Fraunhofer ESK, Germany
-
Douglas Lange, Space and Naval Warfare Systems Center Pacific, USA
-
Philippa Ryan Conmy, Adelard, UK
-
Stefan Kugele, Technical University of Munich, Germany
-
Colin Paterson, University of York, UK
-
Ashley Llorens, Johns Hopkins University, USA
RECORDED SESSIONS
The presentation files are available in the talk title links below.
Session 1: Adversarial Machine Learning - Chair: Huascar Espinoza
* Understanding the One Pixel Attack: Propagation Maps and Locality Analysis. Danilo Vasconcellos Vargas and Jiawei Su.
* Robustness as inherent property of datapoints. Catalin-Andrei Ilie, Alin Stefanescu and Marius Popescu [Poster Paper].
* [Cancelled] Error-Silenced Quantization: Bridging Robustness and Compactness. Zhicong Tang, Yinpeng Dong and Hang Su.
* An Efficient Adversarial Attack on Graph Structured Data. Zhengyi Wang, Hang Su [Poster Paper].
* Evolving Robust Neural Architectures to Defend from Adversarial Attacks. Shashank Kotyan and Danilo Vasconcellos Vargas.
> Debate Panel - Paper Discussants: Xiaowei Huang, Jose Hernandez-Orallo
Invited Talk: John McDermid and Yan Jia. Safety of Artificial Intelligence: A Collaborative Model.
Achieving and assuring the safety of systems that use artificial intelligence (AI), especially machine learning (ML), pose some specific challenges that require unique solutions. However, that does not mean that good safety and software engineering practices are no longer relevant. This talk shows how the issues associated with AI and ML can be tackled by integrating with established safety and software engineering practices. It sets out a three-layer model, going from top to bottom: system safety/functional safety; ``AI/ML safety''; and safety-critical software engineering. This model gives both a basis for achieving and assuring safety and a structure for collaboration between safety engineers and AI/ML specialists. It is argued that this model is general and that it should underpin future standards and guidelines for safety of this class of system which employ ML, particularly because the model can facilitate collaboration between the different communities.
Session 2: DNN Testing, Analysis and Runtime Monitoring - Chair: Xiaowei Huang
* Is Uncertainty Quantification in Deep Learning Sufficient for Out-of-Distribution Detection? Adrian Schwaiger, Poulami Sinhamahapatra, Jens Gansloser and Karsten Roscher.
* A Comparison of Uncertainty Estimation Approaches in Deep Learning Components for Autonomous Vehicle Applications. Fabio Arnez, Huascar Espinoza, Ansgar Radermacher and François Terrier.
* Bayesian Model for Trustworthiness Analysis of Deep Learning Classifiers. Andrey Morozov, Emil Valiev, Michael Beyer, Kai Ding, Lydia Gauerhof and Christoph Schorn [Poster Paper].
* DeepSmartFuzzer: Reward Guided Test Generation For Deep Learning. Samet Demir, Hasan Ferit Eniser and Alper Sen.
> Debate Panel - Paper Discussants: Seán Ó hÉigeartaigh, Huascar Espinoza
Update Report: Richard Mallah (Future of Life Institute). The AI Safety Landscape Initiative
This talk presents an update report of the AI Safety Landscape initiative. The aim of the Consortium on the Landscape of Artificial Intelligence Safety (CLAIS) is to bring together relevant disciplines, initiatives, and organizations interested in collaborating on developing a map of knowledge on the safety, assurance, robustness, and trustworthiness of AI and autonomous systems. A key ambition of this initiative is to align and densely connect the distinct models of this space borne by diverse perspectives, and to leverage their confluence to power the generation of guidance artifacts relevant to a broad range of public stakeholders.
Session 3: AI Planning, Decision Making and Monitoring - Chair: Mauricio Castillo
* Increasing the Trustworthiness of Deep Neural Networks via Accuracy Monitoring. Zhihui Shao, Jianyi Yang and Shaolei Ren.
* Extracting Money from Causal Decision Theorists. Caspar Oesterheld and Vincent Conitzer [Poster Paper].
* Safety Augmentation in Decision Trees. Sumanta Dey, Pallab Dasgupta and Briti Gangopadhyay.
* Towards Safe and Reliable Robot Task Planning. Snehasis Banerje [Poster Paper].
> Debate Panel - Paper Discussants: Jose Hernandez-Orallo, Huascar Espinoza
Invited Talk: Nathalie Baracaldo (IBM Research). Security and Privacy Challenges in Federated Learning
In this talk I will first discuss the potential vulnerabilities that arise in this setting including membership inference and poisoning attacks. Then I will discuss some of the solutions that the team I lead at IBM research has been working on. These solutions include the utilization of differential privacy and multi-party computation during the training process, and I will explain their effect on the final accuracy of the global model. Finally, I will outline some research directions in this area.
Session 4: Ethical and Value-Aligned Learning and Planning - Chair: Richard Mallah
* Classifying Choice Set Misspecification in Reward Inference. Rachel Freedman, Rohin Shah and Anca Dragan.
* Ethically Compliant Planning in Moral Autonomous Systems. Justin Svegliato, Samer Nashed and Shlomo Zilberstein [Poster Paper].
* Aligning with Heterogenous Preferences for Kidney Exchange. Rachel Freedman.
> Debate Panel - Paper Discussants: Mauricio Castillo, Xin Cynthia Chen