Feedback Presentation for Workers in Industrial Environments - Challenges and Opportunities

On the long term, the current wave of digitization and automation in the industrial environment will result in a progressively higher complexity and heterogeneity in the industrial environment. In this context, a growing need arises for the development of digital assistance systems to support workers in various fields of activities. Current systems are generally limited to visualizations and visual feedback. Therefore, in the scope of this paper, we take a look at the major challenges and opportunities for the integration of multimodal feedback systems in today’s and future industrial environments. It shows that the integration of multimodal feedback is subject to a complex combination of technical, user-centric and legal aspects.

[1]  Gavriel Salvendy,et al.  Handbook of Human Factors and Ergonomics: Salvendy/Handbook of Human Factors 4e , 2012 .

[2]  Joo-Hwee Lim,et al.  Design and Evaluation of Vibrating Footwear for Navigation Assistance to Visually Impaired People , 2016, 2016 IEEE International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData).

[3]  Markus Funk.  Assistive Augmentation at the Manual Assembly Workplace using In-Situ Projection , 2015 .

[4]  Marimuthu Palaniswami,et al.  Internet of Things (IoT): A vision, architectural elements, and future directions , 2012, Future Gener. Comput. Syst..

[5]  Björn Scheuermann,et al.  Misbehavior Detection in Industrial Wireless Networks: Challenges and Directions , 2018, Mob. Networks Appl..

[6]  T. Sauter,et al.  Automation Networks in the Era of the Internet of Things and Industry 4 . 0 , 2022 .

[7]  Markus Funk,et al.  Assistive Systems for the Workplace: Towards Context-Aware Assistance , 2015 .

[8]  Albrecht Schmidt,et al.  Multi-Sensor Context-Awareness in Mobile Devices and Smart Artifacts , 2002, Mob. Networks Appl..

[9]  Jing Liu,et al.  Survey of Wireless Indoor Positioning Techniques and Systems , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[10]  Christopher R. Wagner,et al.  A compliant tactile display for teletaction , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[11]  Tao Yang,et al.  Eye-Wearable Technology for Machine Maintenance: Effects of Display Position and Hands-free Operation , 2015, CHI.

[12]  Markus Funk,et al.  Comparing Tactile, Auditory, and Visual Assembly Error-Feedback for Workers with Cognitive Impairments , 2016, ASSETS.

[13]  Martin Maier,et al.  The tactile internet: vision, recent progress, and open challenges , 2016, IEEE Communications Magazine.

[14]  Karen Renaud,et al.  Predicting technology acceptance and adoption by the elderly: a qualitative study , 2008, SAICSIT '08.

[15]  Marcel Bogers,et al.  on Intelligent Manufacturing and Automation , 2013 The Smart Factory : Exploring Adaptive and Flexible Manufacturing Solutions , 2014 .

[16]  Andreas Holzinger,et al.  Can we Trust Machine Learning Results? Artificial Intelligence in Safety-Critical Decision Support , 2018, ERCIM News.

[17]  Andrew Y. C. Nee,et al.  Augmented reality applications in design and manufacturing , 2012 .

[18]  R. Riener,et al.  Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review , 2012, Psychonomic Bulletin & Review.

[19]  S. Hygge,et al.  EFFECTS OF NOISE, HEAT AND INDOOR LIGHTING ON COGNITIVE PERFORMANCE AND SELF-REPORTED AFFECT , 2001 .

[20]  Gavriel Salvendy,et al.  Handbook of Human Factors and Ergonomics , 2005 .

[21]  Abderrahmane Kheddar,et al.  1 Tactile interfaces : a state-ofthe-art survey , 2003 .

[22]  Marco Ehrlich,et al.  State of the Art and Future Applications of Industrial Wireless Sensor Networks , 2018 .

[23]  Jay Lee,et al.  Introduction to cyber manufacturing , 2016 .

[24]  Malte Brettel,et al.  How Virtualization, Decentralization and Network Building Change the Manufacturing Landscape: An Industry 4.0 Perspective , 2014 .

[25]  Carsten Röcker,et al.  SOCIAL AND TECHNOLOGICAL CONCERNS ASSOCIATED WITH THE USAGE OF UBIQUITOUS COMPUTING TECHNOLOGIES , 2010 .

[26]  Oliver Korn,et al.  Industrial playgrounds: how gamification helps to enrich work for elderly or impaired persons in production , 2012, EICS '12.

[27]  Mathias Schmitt,et al.  Human-machine-interaction in the industry 4.0 era , 2014, 2014 12th IEEE International Conference on Industrial Informatics (INDIN).

[28]  Oliver Kopp,et al.  Towards Context-aware Workflows , 2007 .

[29]  Michele Germani,et al.  Digital Manufacturing Systems: A Framework to Improve Social Sustainability of a Production Site , 2017 .

[30]  Fred D. Davis.  User Acceptance of Information Technology: System Characteristics, User Perceptions and Behavioral Impacts , 1993, Int. J. Man Mach. Stud..

[31]  Robert J. Stone,et al.  Haptic Feedback: A Brief History from Telepresence to Virtual Reality , 2000, Haptic Human-Computer Interaction.

[32]  Lorenzo Sabattini,et al.  Towards modern inclusive factories: A methodology for the development of smart adaptive human-machine interfaces , 2017, 2017 22nd IEEE International Conference on Emerging Technologies and Factory Automation (ETFA).

[33]  Juergen Jasperneite,et al.  The Future of Industrial Communication: Automation Networks in the Era of the Internet of Things and Industry 4.0 , 2017, IEEE Industrial Electronics Magazine.

[34]  Wu He,et al.  Internet of Things in Industries: A Survey , 2014, IEEE Transactions on Industrial Informatics.

[35]  Jeretta Horn Nord,et al.  E-monitoring in the workplace: privacy, legislation, and surveillance software , 2006, CACM.

[36]  Alois Ferscha,et al.  Tactor placement in wrist worn wearables , 2010, International Symposium on Wearable Computers (ISWC) 2010.

[37]  H S Vitense,et al.  Multimodal feedback: an assessment of performance and mental workload , 2003, Ergonomics.

[38]  Carsten Röcker,et al.  Privacy and Security in Technology-enhanced Environments: Exploring Users' Knowledge about Technological Processes of Diverse User Groups , 2013 .

[39]  Ariana R. Levinson,et al.  Industrial Justice: Privacy Protection for the Employed , 2008 .

[40]  Iina Aaltonen,et al.  Use of wearable and augmented reality technologies in industrial maintenance work , 2016, MindTrek.

[41]  M. Hoagland,et al.  Feedback Systems An Introduction for Scientists and Engineers SECOND EDITION , 2015 .

[42]  M. Reiner,et al.  Sensory dominance in combinations of audio, visual and haptic stimuli , 2009, Experimental Brain Research.

[43]  Markus Funk,et al.  Haptic, Auditory, or Visual?: Towards Optimal Error Feedback at Manual Assembly Workplaces , 2016, PETRA.

[44]  Anke M. Brock,et al.  Using wrist vibrations to guide hand movement and whole body navigation , 2014, i-com.

[45]  Antti Jylhä,et al.  Pointing and Selecting with Tactile Glove in 3D Environment , 2014, Symbiotic.

[46]  Andreas Holzinger,et al.  The effect of previous exposure to technology on acceptance and its importance in usability and accessibility engineering , 2011, Universal Access in the Information Society.

[47]  Andreas Butz,et al.  Are HMDs the better HUDs? , 2013, 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[48]  Gerhard Fettweis,et al.  5G: Personal mobile internet beyond what cellular did to telephony , 2014, IEEE Communications Magazine.

[49]  Gerhard Fettweis,et al.  The 5G-Enabled Tactile Internet: Applications, requirements, and architecture , 2016, 2016 IEEE Wireless Communications and Networking Conference.

[50]  Dahai Li,et al.  Haptic Shoes: Representing Information By Vibration , 2005, APVIS.

[51]  Sebastian Büttner,et al.  Extending the Design Space in Industrial Manufacturing Through Mobile Projection , 2015, MobileHCI Adjunct.

[52]  Sebastian Büttner,et al.  Towards a Framework for Assistance Systems to Support Work Processes in Smart Factories , 2017, CD-MAKE.

[53]  Kenneth A. Kovach,et al.  The Balance Between Employee Privacy And Employer Interests , 2000 .

[54]  Pierre Falzon,et al.  Ergonomics, knowledge development and the design of enabling environments , 2009 .

[55]  Mauro Figueiredo,et al.  Handbook of Research on Human-Computer Interfaces, Developments, and Applications , 2016 .

[56]  Carsten Röcker,et al.  Revisiting Privacy in Smart Spaces: Social and Architectural Aspects of Privacy in Technology-Enhanced Environments , 2009 .

[57]  Christian Biemann,et al.  What do we need to build explainable AI systems for the medical domain? , 2017, ArXiv.

[58]  Christian Haas,et al.  Anomaly Detection in Industrial Networks using Machine Learning: A Roadmap , 2016, ML4CPS.

[59]  Markus Funk,et al.  Comparing projected in-situ feedback at the manual assembly workplace with impaired workers , 2015, PETRA.

[60]  Robert P. Minch,et al.  Legal and Ethical Implications of Employee Location Monitoring , 2005, HICSS.