An Adaptive Industrial Human-Machine Interface to Optimise Operators Working Performance

Adaptive User Interfaces (AUI) have the potential to deliver advantageous solutions for a wide range of industrial applications. Their ability to adapt to operator interaction patterns and achieve a more personalised interaction can lead to greater efficiency and productivity in the manufacturing process. However, in certain industrial contexts multiple operators interact with the system, rendering it impossible to detect each individual and propose an operator-personalised adaptation. In this paper we propose a data-driven methodology to generate temporal adaptation rules for a multi-operator industrial process. Through the use of machine learning (ML), the methodology: i) analyzes the interaction of different operators with the same machine, ii) selects the most representative adaptations, and iii) generates a set of temporal adaptation rules. The methodology was validated in a real industrial setting resulting in over 40% shorter operator interaction time, and almost 60% number of clicks reduction, thus decreasing the occurrence of interaction errors.

[1]  Paolo Gallina,et al.  Progressive co-adaptation in human-machine interaction , 2015, 2015 12th International Conference on Informatics in Control, Automation and Robotics (ICINCO).

[2]  Kristina Höök,et al.  Steps to take before intelligent user interfaces become real , 2000, Interact. Comput..

[3]  Birgitta König-Ries,et al.  An approach to controlling user models and personalization effects in recommender systems , 2013, IUI '13.

[4]  Ian H. Witten,et al.  Adaptive personalized interfaces—A question of viability , 1985 .

[5]  Lorenzo Sabattini,et al.  The INCLUSIVE System: A General Framework for Adaptive Industrial Automation , 2021, IEEE Transactions on Automation Science and Engineering.

[6]  Akash Singh,et al.  Can Adaptive Interfaces Improve the Usability of Mobile Applications? , 2010, HCIS.

[7]  Mark Poguntke,et al.  The Personal Adaptive In-Car HMI: Integration of External Applications for Personalized Use , 2011, UMAP Workshops.

[8]  Ranjitha Kumar,et al.  ERICA: Interaction Mining Mobile Apps , 2016, UIST.

[9]  Jean Vanderdonckt,et al.  Cloud Menus: a Circular Adaptive Menu for Small Screens , 2018, IUI.

[10]  Martin Ester,et al.  Density‐based clustering , 2019, WIREs Data Mining Knowl. Discov..

[11]  Carlos Cernuda,et al.  An Industrial HMI Temporal Adaptation based on Operator-Machine Interaction Sequence Similarity , 2021, 2021 22nd IEEE International Conference on Industrial Technology (ICIT).

[12]  Andrew Kusiak,et al.  Artificial-Intelligence-Driven Customized Manufacturing Factory: Key Technologies, Applications, and Challenges , 2020, Proceedings of the IEEE.

[13]  Roberto Uribeetxeberria,et al.  Data-Driven Industrial Human-Machine Interface Temporal Adaptation for Process Optimization , 2020, 2020 25th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA).

[14]  Luis A. Leiva ACE: An Adaptive CSS Engine for Web Pages and Web-based Applications , 2012 .

[15]  Kalevi Tervo,et al.  Adaptation of the human-machine interface to the human skill and dynamic characteristics , 2014 .

[16]  Lei Shu,et al.  Smart Factory of Industry 4.0: Key Technologies, Application Case, and Challenges , 2018, IEEE Access.

[17]  Bin Li,et al.  Influence of information overload on operator’s user experience of human–machine interface in LED manufacturing systems , 2015, Cognition, Technology & Work.

[18]  Angelica N. Nieto Lee,et al.  Enhancement of industrial monitoring systems by utilizing context awareness , 2013, 2013 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support (CogSIMA).

[19]  J. Nielsen,et al.  Coordinating user interfaces for consistency , 2001, SGCH.

[20]  Luis A. Leiva,et al.  Adapting User Interfaces with Model-based Reinforcement Learning , 2021, CHI.