Scenarios of Multimodal Information Navigation Services for Users in Cyberphysical Environment

Cyberphysical systems (CPS) provide a broad range of possibilities in many fields of human activity such as multimodal human-computer interaction (HCI). The paper discusses the architecture of developing multimodal information navigation system of SPIIRAS, considering an approach of building a corporate information subsystem for tracking events, scheduling and displaying information on a distributed set of stationary monitors. The subsystem architecture was described in detail. The suggested algorithm for generating schedules showed high performance. The subsystem uses standard network technologies, is not tied to any software or hardware platforms, matches extensibility and portability criteria and may be used as a component of the cyberphysical environment in various organizations. Scenarios of user handling depending on user status are presented.

[1]  Lihui Wang,et al.  Current status and advancement of cyber-physical systems in manufacturing , 2015 .

[2]  Xin-yuan Huang,et al.  Design and Implementation of a Cyber Physical System for Building Smart Living Spaces , 2012, Int. J. Distributed Sens. Networks.

[3]  Daria A. Suranova,et al.  Personified Voice Interaction Software in Billing Systems , 2014, SPECOM.

[4]  Matthew Turk,et al.  Multimodal interaction: A review , 2014, Pattern Recognit. Lett..

[5]  H. Vincent Poor,et al.  Multicast Routing for Decentralized Control of Cyber Physical Systems with an Application in Smart Grid , 2012, IEEE Journal on Selected Areas in Communications.

[6]  Jianhua Ma,et al.  A systematic methodology for augmenting quality of experience in smart space design , 2015, IEEE Wireless Communications.

[7]  Олег Олегович Басов,et al.  Анализ и моделирование процесса выбора положения для транспортировки пострадавшего на основе байесовских сетей доверия , 2015 .

[8]  Vijay Kumar,et al.  Robust Control for Mobility and Wireless Communication in Cyber–Physical Systems With Application to Robot Teams , 2012, Proceedings of the IEEE.

[9]  Edward A. Lee,et al.  Introduction to Embedded Systems - A Cyber-Physical Systems Approach , 2013 .

[10]  Alexander V. Smirnov,et al.  Cyber-Physical-Social System Self-Organization: Ontology-Based Multi-level Approach and Case Study , 2015, 2015 IEEE 9th International Conference on Self-Adaptive and Self-Organizing Systems.

[11]  Ken Fukuda,et al.  Smart appliance network as cyber physical systems: Creating value to meet various consumer lifestyles , 2015, 2015 IEEE 4th Global Conference on Consumer Electronics (GCCE).

[12]  Siddhartha Kumar Khaitan,et al.  Design Techniques and Applications of Cyberphysical Systems: A Survey , 2015, IEEE Systems Journal.

[13]  Bhavani M. Thuraisingham,et al.  Cyberphysical systems security applied to telesurgical robotics , 2012, Comput. Stand. Interfaces.

[14]  A. A. Karpov,et al.  Information enquiry kiosk with multimodal user interface , 2009, Pattern Recognition and Image Analysis.

[15]  Jiafu Wan,et al.  Cyber-Physical Systems for Optimal Energy Management Scheme of Autonomous Electric Vehicle , 2013, Comput. J..

[16]  F. Richard Yu,et al.  A Game-Theoretical Scheme in the Smart Grid With Demand-Side Management: Towards a Smart Cyber-Physical Power Infrastructure , 2013, IEEE Transactions on Emerging Topics in Computing.

[17]  Jay Lee,et al.  A Cyber-Physical Systems architecture for Industry 4.0-based manufacturing systems , 2015 .

[18]  Andrey Ronzhin,et al.  Multimodal Interaction with Intelligent Meeting Room Facilities from Inside and Outside , 2009, NEW2AN.

[19]  Rajeev Alur,et al.  Principles of Cyber-Physical Systems , 2015 .

[20]  Chenyang Lu,et al.  Cyber-Physical Codesign of Distributed Structural Health Monitoring with Wireless Sensor Networks , 2014, IEEE Trans. Parallel Distributed Syst..

[21]  Nicu Sebe,et al.  Multimodal interfaces: Challenges and perspectives , 2009, J. Ambient Intell. Smart Environ..

[22]  Daqiang Zhang,et al.  Context-aware vehicular cyber-physical systems with cloud support: architecture, challenges, and solutions , 2014, IEEE Communications Magazine.

[23]  Andrey Ronzhin,et al.  From smart devices to smart space , 2010 .

[24]  Insup Lee,et al.  Medical Cyber Physical Systems , 2010, Design Automation Conference.

[25]  Irina V. Vatamaniuk,et al.  Architecture of Data Exchange with Minimal Client-Server Interaction at Multipoint Video Conferencing , 2014, NEW2AN.