Reliability and Safety of Intelligent Systems

Featured Speaker

Joseph Sifakis
Turing Award (2007)
Verimag Laboratory, France

Why is self-driving so hard? Despite the enthusiastic involvement of big technological companies and the massive investment of many billions of dollars, all the optimistic predictions about self-driving cars “being around the corner” went utterly wrong.

I argue that these difficulties emblematically illustrate the challenges raised by the vision for trustworthy autonomous systems. These are critical systems intended to replace human operators in complex organizations, very different from other intelligent systems such as game-playing robots or intelligent personal assistants.

I discuss complexity limitations inherent to autonomic behavior but also to integration in complex cyber-physical and human environments. I argue that existing critical systems engineering techniques fall short of meeting the complexity challenge. I also argue that emerging end-to-end AI-enabled solutions currently developed by industry, fail to provide the required strong trustworthiness guarantees.

I advocate a hybrid design approach combining model-based and data-based techniques and seeking tradeoffs between performance and trustworthiness. I also discuss the validation problem emphasizing the need for rigorous simulation and testing techniques allowing technically sound safety evaluation.

I conclude that building trustworthy autonomous systems goes far beyond the current AI vision. To reach this vision, we need a new scientific foundation enriching and extending traditional systems engineering with data-based techniques.

Keynote Speakers

Jim McDonald
President, Royal Academy of Engineering, UK
Principal and vice-chancellor, University of Strathclyde, UK
Intelligent Systems and Data Centric Engineering Applications

Zhihua Zhong
Vice-President, Chinese Academy of Engineering, China
Some Safety Issues on Intelligent Vehicles

Nancy Leveson
Massachusetts Institute of Technology, USA
US National Academy of Engineering, USA
Safety of Software-Intensive Systems

Xiaohong Guan
Xian Jiaotong University, China
Chinese Academy of Sciences, China
Safety and Security of Power Systems

Invited Industry Speakers

Tony Lee Kar-yun
Operations Director, MTR Corporation Limited, Hong Kong
Artificial Intelligence Enabled Applications Towards Intelligent Railway Transportation to be More Customer-centric, Reliable, and Safer

Matthew Hu
Senior Vice President Engineering and Quality at HAYLION Technologies
Robustness Thinking: A Best Practice in Design for Reliability

Zheng Hu
Director of Reliability Technology Lab, Huawei
Explorations and Practices towards a Reliable Intelligent System