Emotion Communication System

In today’s increasingly rich material life, people are shifting their focus from the physical world to the spiritual world. In order to identify and care for people’s emotions, human-machine interaction systems have been created. The currently available human-machine interaction systems often support the interaction between human and robot under the line-of-sight (LOS) propagation environment, while most communications in terms of human-to-human and human-to-machine are non-LOS (NLOS). In order to break the limitation of the traditional human–machine interaction system, we propose the emotion communication system based on NLOS mode. Specifically, we first define the emotion as a kind of multimedia which is similar to voice and video. The information of emotion can not only be recognized, but can also be transmitted over a long distance. Then, considering the real-time requirement of the communications between the involved parties, we propose an emotion communication protocol, which provides a reliable support for the realization of emotion communications. We design a pillow robot speech emotion communication system, where the pillow robot acts as a medium for user emotion mapping. Finally, we analyze the real-time performance of the whole communication process in the scene of a long distance communication between a mother-child users’ pair, to evaluate the feasibility and effectiveness of emotion communications.

[1]  Abdulmotaleb El Saddik,et al.  Haptic based emotional communication system in Second Life , 2010, 2010 IEEE International Symposium on Haptic Audio Visual Environments and Games.

[2]  Shiwen Mao,et al.  A Directional CSMA/CA Protocol for mmWave Wireless PANs , 2010, 2010 IEEE Wireless Communication and Networking Conference.

[3]  Keke Gai,et al.  Phase-Change Memory Optimization for Green Cloud with Genetic Algorithm , 2015, IEEE Transactions on Computers.

[4]  Giancarlo Fortino,et al.  A framework for collaborative computing and multi-sensor data fusion in body sensor networks , 2015, Inf. Fusion.

[5]  Piyush Jha,et al.  DeyPoS: Deduplicatable Dynamic Proof of Storage for Multi-User Environments , 2017 .

[6]  Yongjoo Cho,et al.  Interactive emotional content communications system using portable wireless biofeedback device , 2011, IEEE Transactions on Consumer Electronics.

[7]  Giancarlo Fortino,et al.  A Task-Oriented Framework for Networked Wearable Computing , 2016, IEEE Transactions on Automation Science and Engineering.

[8]  Jing Chen,et al.  Batch Identification Game Model for Invalid Signatures in Wireless Mobile Networks , 2017, IEEE Transactions on Mobile Computing.

[9]  Min Chen,et al.  Efficient Upstream Bandwidth Multiplexing for Cloud Video Recording Services , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Beno Benhabib,et al.  A Survey of Autonomous Human Affect Detection Methods for Social Robots Engaged in Natural HRI , 2016, J. Intell. Robotic Syst..

[11]  Shiwen Mao,et al.  A survey of mobile cloud computing for rich media applications , 2013, IEEE Wireless Communications.

[12]  Dimitrios Hatzinakos,et al.  ECG Pattern Analysis for Emotion Detection , 2012, IEEE Transactions on Affective Computing.

[13]  Michael A. Goodrich,et al.  Human-Robot Interaction: A Survey , 2008, Found. Trends Hum. Comput. Interact..

[14]  Min Chen,et al.  AIWAC: affective interaction through wearable computing and cloud technology , 2015, IEEE Wireless Communications.

[15]  Min Chen,et al.  Mobility-Aware Caching and Computation Offloading in 5G Ultra-Dense Cellular Networks , 2016, Sensors.

[16]  Daxin Tian,et al.  A Dynamic and Self-Adaptive Network Selection Method for Multimode Communications in Heterogeneous Vehicular Telematics , 2015, IEEE Transactions on Intelligent Transportation Systems.

[17]  Shivendra S. Panwar,et al.  A survey of envelope processes and their applications in quality of service provisioning , 2006, IEEE Communications Surveys & Tutorials.

[18]  Min Chen,et al.  Wearable 2.0: Enabling Human-Cloud Integration in Next Generation Healthcare Systems , 2017, IEEE Communications Magazine.

[19]  Min Chen,et al.  CP-Robot: Cloud-Assisted Pillow Robot for Emotion Sensing and Interaction , 2016 .

[20]  Min Chen,et al.  Smart Clothing: Connecting Human with Clouds and Big Data for Sustainable Health Monitoring , 2016, Mobile Networks and Applications.

[21]  Min Chen,et al.  iDoctor: Personalized and professionalized medical recommendations based on hybrid matrix factorization , 2017, Future Gener. Comput. Syst..

[22]  Min Wu,et al.  A multimodal emotional communication based humans-robots interaction system , 2016, 2016 35th Chinese Control Conference (CCC).

[23]  Keke Gai,et al.  Dynamic energy-aware cloudlet-based mobile cloud computing model for green computing , 2016, J. Netw. Comput. Appl..

[24]  Meikang Qiu,et al.  Privacy Protection for Preventing Data Over-Collection in Smart City , 2016, IEEE Transactions on Computers.

[25]  Lajos Hanzo,et al.  Survey of Large-Scale MIMO Systems , 2015, IEEE Communications Surveys & Tutorials.

[26]  Min Chen,et al.  Software-Defined Mobile Networks Security , 2016, Mobile Networks and Applications.

[27]  Roozbeh Jafari,et al.  Enabling Effective Programming and Flexible Management of Efficient Body Sensor Network Applications , 2013, IEEE Transactions on Human-Machine Systems.

[28]  Zhigang Deng,et al.  Analysis of emotion recognition using facial expressions, speech and multimodal information , 2004, ICMI '04.

[29]  Shiwen Mao,et al.  Design principles for distributed channel assignment in wireless ad hoc networks , 2005, IEEE International Conference on Communications, 2005. ICC 2005. 2005.

[30]  Karsten Berns,et al.  A Multimodal Nonverbal Human-Robot Communication System , 2015 .

[31]  Di Wu,et al.  Eco-Aware Online Power Management and Load Scheduling for Green Cloud Datacenters , 2016, IEEE Systems Journal.

[32]  Theodoros Iliou,et al.  Features and classifiers for emotion recognition from speech: a survey from 2000 to 2011 , 2012, Artificial Intelligence Review.

[33]  Shrikanth S. Narayanan,et al.  Analysis of emotional effect on speech-body gesture interplay , 2014, INTERSPEECH.

[34]  Guosen Yue,et al.  User Grouping for Massive MIMO in FDD Systems: New Design Methods and Analysis , 2014, IEEE Access.

[35]  Marcelo H. Ang,et al.  A Survey on Perception Methods for Human–Robot Interaction in Social Robots , 2013, International Journal of Social Robotics.

[36]  Zhangdui Zhong,et al.  Challenges on wireless heterogeneous networks for mobile cloud computing , 2013, IEEE Wireless Communications.

[37]  Karon E. MacLean,et al.  Design and assessment of the Haptic Creature's affect display , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[38]  Matthias Scheutz,et al.  Is robot telepathy acceptable? Investigating effects of nonverbal robot-robot communication on human-robot interaction , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[39]  Lajos Hanzo,et al.  Quality-of-experience assessment and its application to video services in lte networks , 2015, IEEE Wireless Communications.

[40]  Min Chen,et al.  User Intent-Oriented Video QoE with Emotion Detection Networking , 2016, 2016 IEEE Global Communications Conference (GLOBECOM).

[41]  Wei Li,et al.  Mobile Cloud Platform: Architecture, Deployment and Big Data Applications , 2016, CloudComp.

[42]  Hassan Ghasemzadeh,et al.  Multi-sensor fusion in body sensor networks: State-of-the-art and research challenges , 2017, Inf. Fusion.

[43]  Zhengguo Sheng,et al.  Learning to Be Energy-Efficient in Cooperative Networks , 2016, IEEE Communications Letters.

[44]  Tao Jiang,et al.  A survey of QoE-driven video streaming over cognitive radio networks , 2015, IEEE Network.

[45]  Hassan Ghasemzadeh,et al.  Power-Aware Activity Monitoring Using Distributed Wearable Sensors , 2014, IEEE Transactions on Human-Machine Systems.

[46]  Fadel Adib,et al.  Emotion recognition using wireless signals , 2016, MobiCom.

[47]  Min Chen,et al.  LTE-based humanoid robotics system , 2015, Microprocess. Microsystems.