Classification of physiological signals for wheel loader operators using Multi-scale Entropy analysis and case-based reasoning

Sensor signal fusion is becoming increasingly important in many areas including medical diagnosis and classification. Today, clinicians/experts often do the diagnosis of stress, sleepiness and tiredness on the basis of information collected from several physiological sensor signals. Since there are large individual variations when analyzing the sensor measurements and systems with single sensor, they could easily be vulnerable to uncertain noises/interferences in such domain; multiple sensors could provide more robust and reliable decision. Therefore, this paper presents a classification approach i.e. Multivariate Multiscale Entropy Analysis-Case-Based Reasoning (MMSE-CBR) that classifies physiological parameters of wheel loader operators by combining CBR approach with a data level fusion method named Multivariate Multiscale Entropy (MMSE). The MMSE algorithm supports complexity analysis of multivariate biological recordings by aggregating several sensor measurements e.g., Inter-beat-Interval (IBI) and Heart Rate (HR) from Electrocardiogram (ECG), Finger Temperature (FT), Skin Conductance (SC) and Respiration Rate (RR). Here, MMSE has been applied to extract features to formulate a case by fusing a number of physiological signals and the CBR approach is applied to classify the cases by retrieving most similar cases from the case library. Finally, the proposed approach i.e. MMSE-CBR has been evaluated with the data from professional drivers at Volvo Construction Equipment, Sweden. The results demonstrate that the proposed system that fuses information at data level could classify 'stressed' and 'healthy' subjects 83.33% correctly compare to an expert's classification. Furthermore, with another data set the achieved accuracy (83.3%) indicates that it could also classify two different conditions 'adapt' (training) and 'sharp' (real-life driving) for the wheel loader operators. Thus, the new approach of MMSE-CBR could support in classification of operators and may be of interest to researchers developing systems based on information collected from different sensor sources.

[1]  Reno Filla.  Study of a method for assessing operability of working machines in physical and virtual testing , 2012 .

[2]  P. Funk,et al.  ECG sensor signal analysis to represent cases in a case-based stress diagnosis system , 2010, Proceedings of the 10th IEEE International Conference on Information Technology and Applications in Biomedicine.

[3]  E. Mazer,et al.  Multi-sensor data fusion using Bayesian programming: An automotive application , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[4]  Mobyen Uddin Ahmed,et al.  Multi-Scale Entropy Analysis and Case-Based Reasoning to Classify Physiological Sensor Signals , 2012, ICCBR 2012.

[5]  Petra Perner,et al.  Recognition of airborne fungi spores in digital microscopic images , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[6]  I. Bichindaritz.  Prototypical Case Mining from Medical Literature , 2006 .

[7]  Sheng Wang,et al.  A Novel Framework for Cluster-based Sensor Fusion , 2006, The Proceedings of the Multiconference on "Computational Engineering in Systems Applications".

[8]  Madalena Costa,et al.  Multiscale entropy analysis of biological signals. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[9]  Petra Perner.  Flexible High-Content Analysis , 2006 .

[10]  Danilo P Mandic,et al.  Multivariate multiscale entropy: a tool for complexity analysis of multichannel data. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[11]  J. Richman,et al.  Physiological time-series analysis using approximate entropy and sample entropy. , 2000, American journal of physiology. Heart and circulatory physiology.

[12]  J. Shore,et al.  Which is the better entropy expression for speech processing: -S log S or log S? , 1984 .

[13]  Mobyen Uddin Ahmed,et al.  A CASE‐BASED DECISION SUPPORT SYSTEM FOR INDIVIDUAL STRESS DIAGNOSIS USING FUZZY SIMILARITY MATCHING , 2009, Comput. Intell..

[14]  Janet L. Kolodner,et al.  Reconstructive Memory: A Computer Model , 1983, Cogn. Sci..

[15]  Jeffrey M. Hausdorff,et al.  Fractal dynamics in physiology: Alterations with disease and aging , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[16]  Robin R. Murphy,et al.  Dempster-Shafer theory for sensor fusion in autonomous mobile robots , 1998, IEEE Trans. Robotics Autom..

[17]  Felix Schmid,et al.  Application of sensor fusion to railway systems , 1996, 1996 IEEE/SICE/RSJ International Conference on Multisensor Fusion and Integration for Intelligent Systems (Cat. No.96TH8242).

[18]  Sh. Ataei,et al.  Sensor fusion of a railway bridge load test using neural networks , 2005, Expert Syst. Appl..

[19]  Luigi Portinale,et al.  Case-based retrieval to support the treatment of end stage renal failure patients , 2006, Artif. Intell. Medicine.

[20]  Petra Perner,et al.  Case-based object recognition for airborne fungi recognition , 2006, Artif. Intell. Medicine.

[21]  F. Azuaje,et al.  Improving clinical decision support through case-based data fusion , 1999, IEEE Transactions on Biomedical Engineering.

[22]  H. Leung,et al.  Minimum entropy approach for multisensor data fusion , 1997, Proceedings of the IEEE Signal Processing Workshop on Higher-Order Statistics.

[23]  Klamer Schutte,et al.  A comparison of decision-level sensor-fusion methods for anti-personnel landmine detection , 2001, Inf. Fusion.

[24]  Reno Filla.  Quantifying Operability of Working Machines , 2011 .

[25]  Sanja Petrovic,et al.  A Case-Based Reasoning Approach to Dose Planning in Radiotherapy , 2007 .

[26]  Agnar Aamodt,et al.  Case-Based Reasoning: Foundational Issues, Methodological Variations, and System Approaches , 1994, AI Commun..

[27]  Nikolaos Papanikolopoulos,et al.  Vision sensing for intelligent vehicle and highway systems , 1994, Proceedings of 1994 IEEE International Conference on MFI '94. Multisensor Fusion and Integration for Intelligent Systems.

[28]  Thierry Ranchin,et al.  A case based reasoning data fusion scheme: application to offshore wind energy resource mapping , 2006, 2006 9th International Conference on Information Fusion.

[29]  K. J. Orford,et al.  Entropy measures of multi-sensor fusion performance , 1996 .

[30]  Sanjay Sood,et al.  Business Listing Classification Using Case Based Reasoning and Joint Probability , 2011, AAAI Spring Symposium: Modeling Complex Adaptive Systems as if They Were Voting Processes.

[31]  Thierry Fraichard,et al.  Multi-sensor data fusion using Bayesian programming : an automotive application , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[32]  Danilo P. Mandic,et al.  Multivariate Multiscale Entropy Analysis , 2012, IEEE Signal Processing Letters.

[33]  Nikunj C. Oza,et al.  Online Ensemble Learning , 2000, AAAI/IAAI.

[34]  Yorgos Goletsis,et al.  Towards Driver's State Recognition on Real Driving Conditions , 2011 .

[35]  Cynthia R. Marling,et al.  The 4 Diabetes Support System: A Case Study in CBR Research and Development , 2011, ICCBR.

[36]  Wei Wang,et al.  Feature Extracting of Weak Signal in Real-Time Sleeping EEG with Approximate Entropy and Bispectrum Analysis , 2009, 2009 3rd International Conference on Bioinformatics and Biomedical Engineering.

[37]  Mobyen Uddin Ahmed,et al.  Using Calibration and Fuzzification of Cases for Improved Diagnosis and Treatment of Stress , 2006 .

[38]  Peng Xu,et al.  Decentralized fault detection and diagnosis via sparse PCA based decomposition and Maximum Entropy decision fusion , 2012 .

[39]  C.A. Policastro,et al.  Applying Case Based Based Reasoning to Sensor Fusion , 2007, 2007 3rd International Conference on Intelligent Sensors, Sensor Networks and Information.

[40]  Mobyen Uddin Ahmed,et al.  Case-Based Reasoning Systems in the Health Sciences: A Survey of Recent Trends and Developments , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[41]  James A. Rodger,et al.  Toward reducing failure risk in an integrated vehicle health maintenance system: A fuzzy multi-sensor data fusion Kalman filter approach for IVHMS , 2012, Expert Syst. Appl..

[42]  Isabelle Bichindaritz.  Prototypical case mining from biomedical literature for bootstrapping a case base , 2007, Applied Intelligence.

[43]  Mobyen Uddin Ahmed,et al.  Driver's Mental State Monitoring System Using CBR Based on Heart Rate Variability Analysis , 2012 .

[44]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[45]  Mobyen Uddin Ahmed,et al.  K-NN based interpolation to handle artifacts for heart rate variability analysis , 2011, 2011 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT).

[46]  Amy Loutfi,et al.  A case-based patient identification system using pulseoximeter and a personalized health profile , 2012, ICCBR 2012.

[47]  Isabelle Bichindaritz,et al.  Case-based reasoning in the health sciences: What's next? , 2006, Artif. Intell. Medicine.

[48]  Madalena Costa,et al.  Multiscale entropy analysis of complex physiologic time series. , 2002, Physical review letters.

[49]  Agnar Aamodt,et al.  CASE-BASED REASONING: FOUNDATIONAL ISSUES, METHODOLOGICAL VARIATIONS, AND SYSTEM APPROACHES AICOM - ARTIFICIAL INTELLIGENCE COMMUNICATIONS , 1994 .