A Digital Twin-Driven Method for Product Performance Evaluation Based on Intelligent Psycho-Physiological Analysis

Digital twin, a new emerging and fast-growing technology which is one of the most promising technologies for smart design and manufacturing, has attracted much attention worldwide recently. With the application of digital twin, product performance evaluation has entered the data-driven era. However, traditional methods for evaluation mainly place emphasis on structure analysis in the stage of manufacturing and service in digital twin. They cannot synthesize multi-source information and take the high-level emotional response into consideration in the design stage. To overcome these disadvantages, a digital twin-driven method is proposed evaluating product design schemes in this study. It enables the acquisition of electroencephalogram (EEG) data, physical data, and emotional feedback. Human factors are systematically considered in the evaluation process to establish the information association between EEG and performance levels. Moreover, intelligent psycho-physiological analysis that incorporates EEG into the fuzzy comprehensive evaluation (FCE) and machine learning methods is adopted within the proposed method. It synthesizes human factors such as psychological requirements, subjective and objective assessment indicators to realize a novel machine learning-based EEG analysis. Taking advantage of the binary particle swarm optimization (BPSO) improved Riemannian manifold mapping, Riemann geometry (RG) features are extracted and selected from EEG signals. Differences of implicit psychological states while using the product produced by different design schemes can be more easily detected and classified. A case study of high-speed elevator is conducted to verify the feasibility and effectiveness of the proposed method. The accuracy of EEG classification for performance evaluation reaches 92%.

[1]  Christian Jutten,et al.  Classification of covariance matrices using a Riemannian-based kernel for BCI applications , 2013, Neurocomputing.

[2]  Laura Malinverni,et al.  Towards methods for evaluating and communicating participatory design: A multimodal approach , 2016, Int. J. Hum. Comput. Stud..

[3]  Yuan-Wei Du,et al.  Group fuzzy comprehensive evaluation method under ignorance , 2019, Expert Syst. Appl..

[4]  Hao Zheng,et al.  An Edge-Based Distributed Decision-Making Method for Product Design Scheme Evaluation , 2021, IEEE Transactions on Industrial Informatics.

[5]  Yixiong Feng,et al.  Data-driven customer requirements discernment in the product lifecycle management via intuitionistic fuzzy sets and electroencephalogram , 2018, Journal of Intelligent Manufacturing.

[6]  Fei Tao,et al.  Digital twin-driven product design, manufacturing and service with big data , 2017, The International Journal of Advanced Manufacturing Technology.

[7]  F. Yger,et al.  Riemannian Approaches in Brain-Computer Interfaces: A Review , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[8]  Panagiotis Artemiadis,et al.  Inferring imagined speech using EEG signals: a new approach using Riemannian manifold features , 2018, Journal of neural engineering.

[9]  Russell C. Eberhart,et al.  A discrete binary version of the particle swarm algorithm , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[10]  Wei Wu,et al.  Probabilistic Common Spatial Patterns for Multichannel EEG Analysis , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Olga Sourina,et al.  Real-time EEG-based emotion monitoring using stable features , 2015, The Visual Computer.

[12]  Young-Joon Lee,et al.  Sound metric design for evaluation of tonal sound in laser printer , 2012 .

[13]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces: a 10 year update , 2018, Journal of neural engineering.

[14]  Edgar O. Reséndiz-Flores,et al.  Optimal feature selection in industrial foam injection processes using hybrid binary Particle Swarm Optimization and Gravitational Search Algorithm in the Mahalanobis–Taguchi System , 2019, Soft Computing.

[15]  Yu Song,et al.  Using GOMS and NASA-TLX to Evaluate Human–Computer Interaction Process in Interactive Segmentation , 2017, Int. J. Hum. Comput. Interact..

[16]  Andrew Y. C. Nee,et al.  Digital twin-driven product design framework , 2019, Int. J. Prod. Res..

[17]  Yuri Borgianni,et al.  Review of the use of neurophysiological and biometric measures in experimental design research , 2020, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[18]  Christian Jutten,et al.  Multiclass Brain–Computer Interface Classification by Riemannian Geometry , 2012, IEEE Transactions on Biomedical Engineering.

[19]  Fei Tao,et al.  Big Data in product lifecycle management , 2015, The International Journal of Advanced Manufacturing Technology.

[20]  Kaisa Väänänen,et al.  Suitability of virtual prototypes to support human factors/ergonomics evaluation during the design. , 2016, Applied ergonomics.

[21]  Malcolm MacLachlan,et al.  Development and psychometric evaluation of the Trinity Amputation and Prosthesis Experience Scales (TAPES). , 2000 .

[22]  Andrew Kusiak,et al.  Smart manufacturing must embrace big data , 2017, Nature.

[23]  John D. Lee,et al.  The Oxford Handbook of Cognitive Engineering , 2013 .

[24]  He Zhang,et al.  Digital Twin in Industry: State-of-the-Art , 2019, IEEE Transactions on Industrial Informatics.

[25]  Wensheng Su,et al.  Elevator ride comfort monitoring and evaluation using smartphones , 2018 .

[26]  Bin He,et al.  Digital twin-based sustainable intelligent manufacturing: a review , 2020, Advances in Manufacturing.

[27]  Yufeng Wang,et al.  CCFS: A Confidence-Based Cost-Effective Feature Selection Scheme for Healthcare Data Classification , 2019, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[28]  Ming-Chuan Chiu,et al.  An Integrative Machine Learning Method to Improve Fault Detection and Productivity Performance in a Cyber-Physical System , 2020, J. Comput. Inf. Sci. Eng..

[29]  K.-R. Muller,et al.  Optimizing Spatial filters for Robust EEG Single-Trial Analysis , 2008, IEEE Signal Processing Magazine.

[30]  Suhua Zhang,et al.  An approach to EEG-based emotion recognition using combined feature extraction method , 2016, Neuroscience Letters.

[31]  Meng Zhang,et al.  Digital twin enhanced human-machine interaction in product lifecycle , 2019, Procedia CIRP.

[32]  Amandeep Singh,et al.  Sustainable supplier selection under must-be criteria through Fuzzy inference system , 2020 .

[33]  Joseph Sarkis,et al.  Integrating Fuzzy C-Means and TOPSIS for performance evaluation: An application and comparative analysis , 2014, Expert Syst. Appl..

[34]  Qi Wang,et al.  Cognition Digital Twins for Personalized Information Systems of Smart Cities: Proof of Concept , 2020, Journal of Management in Engineering.

[35]  Christian Jutten,et al.  Transfer Learning: A Riemannian Geometry Framework With Applications to Brain–Computer Interfaces , 2018, IEEE Transactions on Biomedical Engineering.

[36]  Xiaojuan Ma,et al.  Fostering engagement in technology-mediated stress management: A comparative study of biofeedback designs , 2020, Int. J. Hum. Comput. Stud..

[37]  Rikard Söderberg,et al.  Individualizing Locator Adjustments of Assembly Fixtures Using a Digital Twin , 2019, J. Comput. Inf. Sci. Eng..

[38]  David Murray-Rust,et al.  Digital twins as a resource for design research , 2019, PerDis.

[39]  Yixiong Feng,et al.  A Digital Twin-Driven Improved Design Approach of Drawing Bench for Brazing Material , 2019, DAC 2019.

[40]  Ji-Qin Ni,et al.  Fuzzy comprehensive evaluation of multiple environmental factors for swine building assessment and control. , 2017, Journal of hazardous materials.

[41]  Pramod Kumar Singh,et al.  Opposition chaotic fitness mutation based adaptive inertia weight BPSO for feature selection in text clustering , 2016, Appl. Soft Comput..

[42]  Xiang Peng,et al.  A decision approach with multiple interactive qualitative objectives for product conceptual schemes based on noncooperative-cooperative game theory , 2018, Adv. Eng. Informatics.

[43]  Oskar von Stryk,et al.  A human-machine-centered design method for (powered) lower limb prosthetics , 2017, Robotics Auton. Syst..

[44]  Yixiong Feng,et al.  A Cyber-Physical System for Product Conceptual Design Based on an Intelligent Psycho-Physiological Approach , 2017, IEEE Access.