Cognitive Human-Machine Interface Applied in Remote Support for Industrial Robot Systems

An attempt is currently being made to widely introduce industrial robots to Small-Medium Enterprises (SMEs). Since the enterprises usually employ too small number of robot units to afford specialized departments for robot maintenance, they must be provided with inexpensive and immediate support remotely. This paper evaluates whether the support can be provided by means of Cognitive Info-communication – communication in which human cognitive capabilities are extended irrespectively of geographical distances. The evaluations are given with an aid of experimental system that consists of local and remote rooms, which are physically separated – a six-degree-of-freedom NACHI SH133-03 industrial robot is situated in the local room, while the operator, who supervises the robot by means of audio-visual Cognitive Human-Machine Interface, is situated in the remote room. The results of simple experiments show that Cognitive Info-communication is not only efficient mean to provide the support remotely, but is probably also a powerful tool to enhance interaction with any data-rich environment that require good conceptual understanding of system's state and careful attention management. Furthermore, the paper discusses data presentation and reduction methods for data-rich environments, as well as introduces the concepts of Naturally Acquired Data and Cognitive Human-Machine Interfaces.

[1]  B Rajapakse,et al.  Remote Access Toolkit for industrial robots , 2004 .

[2]  J. Davidoff,et al.  Some effects of color on naming and recognition of objects. , 1985, Journal of experimental psychology. Learning, memory, and cognition.

[3]  A. Ardila.  On the Evolution of Calculation Abilities , 2010, Front. Evol. Neurosci..

[4]  P. Gordon.  Numerical Cognition Without Words: Evidence from Amazonia , 2004, Science.

[5]  Riyanto T. Bambang.  Development of architectures for Internet telerobotics systems , 2008, ArXiv.

[6]  Richard S. J. Frackowiak,et al.  Neurobiological measures of human selective attention , 2001, Neuropsychologia.

[7]  Gerhard Schreck,et al.  SME-Service Networks for Cooperative Operation of Robot Installations , 2004, BASYS.

[8]  Trygve Thomessen,et al.  Multimodal Human-Machine Interface for Remote Operation of Robot Systems , 2012, SyRoCo.

[9]  J. Byrne.  Learning and memory : a comprehensive reference , 2008 .

[10]  Cataldo Guaragnella,et al.  A visual approach for driver inattention detection , 2007, Pattern Recognit..

[11]  Joo-Ho Lee,et al.  Intelligent Space — concept and contents , 2002, Adv. Robotics.

[12]  A. Fairhall,et al.  Sensory adaptation , 2007, Current Opinion in Neurobiology.

[13]  Alan Lipschultz,et al.  Virtual Reality Technology, 2nd edition , 2004 .

[14]  Peter Baranyi,et al.  Cognitive infocommunications: CogInfoCom , 2010, 2010 11th International Symposium on Computational Intelligence and Informatics (CINTI).

[15]  Kathleen L. Slaney,et al.  On the ambiguity of concept use in psychology: Is the concept “concept” a useful concept? , 2011 .

[16]  E. N. Sokolov.  Higher nervous functions; the orienting reflex. , 1963, Annual review of physiology.

[17]  David W. Schloerb,et al.  A Quantitative Measure of Telepresence , 1995, Presence: Teleoperators & Virtual Environments.

[18]  I. Biederman.  Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[19]  Peter Baranyi,et al.  A unified terminology for CogInfoCom applications , 2011, 2011 2nd International Conference on Cognitive Infocommunications (CogInfoCom).

[20]  Raúl Marín,et al.  Telecontrol of an industrial robot arm by means of a multimodal user interface: a case study , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[21]  M Bates,et al.  Models of natural language understanding. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[22]  Tomasz Imielinski,et al.  Database Mining: A Performance Perspective , 1993, IEEE Trans. Knowl. Data Eng..

[23]  P. Bach-y-Rita,et al.  Sensory substitution and the human–machine interface , 2003, Trends in Cognitive Sciences.

[24]  Eleanor Rosch,et al.  Principles of Categorization , 1978 .

[25]  Redwan Alqasemi,et al.  Scaled telerobotic control of a manipulator in real time with laser assistance for ADL tasks , 2009, 2009 6th International Symposium on Mechatronics and its Applications.

[26]  James S. Adelman,et al.  Letters in Words Are Read Simultaneously, Not in Left-to-Right Sequence , 2010, Psychological science.

[27]  Péter Baranyi,et al.  A Conceptual Framework for the Design of Audio Based Cognitive Infocommunication Channels , 2012, Recent Advances in Intelligent Engineering Systems.

[28]  Thomas B. Sheridan,et al.  Telerobotics , 1989, Autom..

[29]  Allen Newell,et al.  Elements of a theory of human problem solving. , 1958 .

[30]  S. S. Pande,et al.  WebROBOT: Internet based robotic assembly planning system , 2004, Comput. Ind..

[31]  L. Billard,et al.  From the Statistics of Data to the Statistics of Knowledge , 2003 .

[32]  Alberto J. Alvares,et al.  Telerobotics: through-the-Internet teleoperation of the ABB IRB 2000 industrial robot , 1999, Optics East.

[33]  Simon Forge,et al.  A Helping Hand for Europe: The Competitive Outlook for the EU Robotics Industry , 2010 .

[34]  Jeffrey S. Shell,et al.  Designing for augmented attention: Towards a framework for attentive user interfaces , 2006, Comput. Hum. Behav..