Human-Machine Speech-Based Interfaces with Augmented Reality and Interactive Systems for Controlling Mobile Cranes

In this paper, an overview of human-machine interactive communication for controlling lifting devices is presented, covering also the integration with vision and sensorial systems. Following a general concept, and motivation towards intelligent human-machine communication through artificial neural networks, selected methods are proposed, which provide further directions both of recent as well as of future research on human-machine interaction. The aim of the experimental research is to design a prototype of an innovative interaction system, equipped with a speech interface in a natural language, augmented reality and interactive manipulators with force feedback.

[1]  Matthew Kam,et al.  Enabling the Rapid Development and Adoption of Speech-User Interfaces , 2014, Computer.

[2]  Keith Stuart,et al.  Interactive systems for designing machine elements and assemblies , 2015 .

[3]  Karol Miądlicki,et al.  Overview of user interfaces used in load lifting devices , 2015 .

[4]  Wojciech Kacalak,et al.  Intelligent Speech Interaction of Devices and Human Operators , 2016, CSOC.

[5]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[6]  Jacek M. Zurada,et al.  Sentence recognition using artificial neural networks , 2008, Knowl. Based Syst..

[7]  Donald F. Specht,et al.  Probabilistic neural networks , 1990, Neural Networks.

[8]  Karol Miądlicki,et al.  Real-time gesture control of a CNC machine tool with the use Microsoft Kinect sensor , 2015 .

[9]  Wojciech Kacalak,et al.  New Intelligent Interactive Automated Systems for Design of Machine Elements and Assemblies , 2012, ICONIP.

[10]  Maciej Majewski,et al.  Intelligent Natural Language Processing , 2006, ICNC.

[11]  Wojciech Kacalak,et al.  Intelligent Automated Design of Machine Components Using Antipatterns , 2015, IDEAL.

[12]  Marek Grudziński,et al.  Intelligent Machine Tool – Vision Based 3D Scanning System for Positioning of the Workpiece , 2015 .

[13]  Jacek M. Zurada,et al.  Intelligent E-Learning Systems for Evaluation of User's Knowledge and Skills with Efficient Information Processing , 2010, ICAISC.

[14]  Charles L. Ortiz.  The Road to Natural Conversational Speech Interfaces , 2014, IEEE Internet Computing.