Discrimination of Lies in Communication by using Automatic Measuring System of Nonverbal Information

In the near future, it is expected for us to communicate with robots and computer agents in a natural way. In daily life, we usually speculate about partner's intentions from diverse nonverbal information expressed unconsciously. We thus need to investigate the method of speculating partner's intentions by using nonverbal information and to implement it with a robot or agent to realize the smooth communication. However, there is not a system satisfying necessary conditions which we considered for the measuring nonverbal information in natural communication. Therefore, we made a real-time system for readily measuring gaze directions and facial feature points at a time. And then, we established an experimental setting for measuring multimodal nonverbal information that participants expressed during communication. We used the system and setting to make an experiment for discriminating lie, as an example which intentions were unconsciously expressed by nonverbal information. As a result, we found that we could discriminate lies by using diverse nonverbal information in the same way people did