From Features Engineering to Scenarios Engineering for Trustworthy AI: I&I, C&C, and V&V

Artificial intelligence (AI)’s rapid development has produced a variety of state-of-the-art models and methods that rely on network architectures and features engineering. However, some AI approaches achieve high accurate results only at the expense of interpretability and reliability. These problems may easily lead to bad experiences, lower trust levels, and systematic or even catastrophic risks. This article introduces the theoretical framework of scenarios engineering for building trustworthy AI techniques. We propose six key dimensions, including intelligence and index, calibration and certification, and verification and validation to achieve more robust and trusting AI, and address issues for future research directions and applications along this direction.

[1]  Muhammad Rusyadi Ramli,et al.  Finding Critical Scenarios for Automated Driving Systems: A Systematic Mapping Study , 2023, IEEE Transactions on Software Engineering.

[2]  Longbing Cao Beyond i.i.d.: Non-IID Thinking, Informatics, and Learning , 2022, IEEE Intell. Syst..

[3]  Fei-Yue Wang MetaVehicles in the Metaverse: Moving to a New Phase for Intelligent Vehicles and Smart Mobility , 2022, IEEE Trans. Intell. Veh..

[4]  Xiao Wang,et al.  Future Directions of Intelligent Vehicles: Potentials, Possibilities, and Perspectives , 2022, IEEE Trans. Intell. Veh..

[5]  Longbing Cao,et al.  A New Age of AI: Features and Futures , 2022, IEEE Intelligent Systems.

[6]  Fei-Yue Wang Parallel Intelligence in Metaverses: Welcome to Hanoi! , 2022, IEEE Intelligent Systems.

[7]  Yisheng Lv,et al.  Bridging the Micro and Macro: Calibration of Agent-Based Model Using Mean-Field Dynamics , 2021, IEEE Transactions on Cybernetics.

[8]  Yong Yuan,et al.  Nonfungible Tokens: Constructing Value Systems in Parallel Societies , 2021, IEEE Trans. Comput. Soc. Syst..

[9]  Kawal S. Rhode,et al.  Robotic Intra-Operative Ultrasound: Virtual Environments and Parallel Systems , 2021, IEEE/CAA Journal of Automatica Sinica.

[10]  Yonglin Tian,et al.  Federated Ecology: Steps Toward Confederated Intelligence , 2021, IEEE Trans. Comput. Soc. Syst..

[11]  Kunfeng Wang,et al.  A recurrent attention and interaction model for pedestrian trajectory prediction , 2020, IEEE/CAA Journal of Automatica Sinica.

[12]  Tianjian Chen,et al.  A Secure Federated Transfer Learning Framework , 2020, IEEE Intelligent Systems.

[13]  Chen Sun,et al.  Proximity based automatic data annotation for autonomous driving , 2020, IEEE/CAA Journal of Automatica Sinica.

[14]  Longbing Cao,et al.  Non-IID Recommender Systems: A Review and Framework of Recommendation Paradigm Shifting , 2016, ArXiv.

[15]  Fei-Yue Wang,et al.  Parallel Ecology for Intelligent and Smart Cyber-Physical-Social Systems , 2020, IEEE Trans. Comput. Soc. Syst..

[16]  Douglas Heaven,et al.  Why deep-learning AIs are so easy to fool , 2019, Nature.

[17]  Juanjuan Li,et al.  Decentralized Autonomous Organizations: Concept, Model, and Applications , 2019, IEEE Transactions on Computational Social Systems.

[18]  Kunfeng Wang,et al.  ParallelEye-CS: A New Dataset of Synthetic Images for Testing the Visual Intelligence of Intelligent Vehicles , 2019, IEEE Transactions on Vehicular Technology.

[19]  Juanjuan Li,et al.  Social Computing: From Crowdsourcing to Crowd Intelligence by Cyber Movement Organizations , 2019, IEEE Trans. Comput. Soc. Syst..

[20]  Xuan Li,et al.  The ParallelEye Dataset: A Large Collection of Virtual Images for Traffic Vision Research , 2019, IEEE Transactions on Intelligent Transportation Systems.

[21]  Shuai Wang,et al.  Blockchain-Enabled Smart Contracts: Architecture, Applications, and Future Trends , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[22]  Marcelo Soares Pimenta,et al.  5W2H Framework: a guide to design, develop and evaluate the user-centered gamification , 2016, IHC.

[23]  Li Li,et al.  Steps toward Parallel Intelligence , 2016 .

[24]  Liuqing Yang,et al.  Where does AlphaGo go: from church-turing thesis to AlphaGo thesis and beyond , 2016, IEEE/CAA Journal of Automatica Sinica.

[25]  Wenji Mao,et al.  Social Computing: From Social Informatics to Social Intelligence , 2007, IEEE Intell. Syst..