Highly realistic collaboration system by using 4K multi JPEG2000 codecs and 6-channel acoustic echo canceller

We develop a novel tele-collaboration system with low latency and high reliability by combining three 4K60p JPEG2000 video streaming systems and a 6-channel echo canceller. Our system realizes the synchronization of multiple video streams without even single frame delay. It can transmit 4K 60p streams with one-way latency of 80 msec, so users can communicate with one another with no unnatural pauses. Using a novel highperformance multi-channel acoustic echo canceller, our system can spatially localize each user's speech to the user's displayed position. We conduct a subjective assessment of our system through confrontational role-playing tasks and find that our system helps the subjects to share their feelings and atmosphere and enhances their cooperation.

[1]  Masaki Emoto,et al.  Viewing angle effects from wide field video projection images on the human equilibrium , 2005, Displays.

[2]  Jacob Benesty,et al.  A better understanding and an improved solution to the specific problems of stereophonic acoustic echo cancellation , 1998, IEEE Trans. Speech Audio Process..

[3]  Masaoka Kenichiro,et al.  Comparing Visual Realness between High Resolution Images and Real Objects , 2011 .

[4]  Satoru Emura,et al.  Stereo echo cancellation algorithm using adaptive update on the basis of enhanced input-signal vector , 2006, Signal Process..

[5]  Jonathan Freeman,et al.  A Cross-Media Presence Questionnaire: The ITC-Sense of Presence Inventory , 2001, Presence: Teleoperators & Virtual Environments.

[6]  Satoru Emura,et al.  A method of coherence-based step-size control for robust stereo echo cancellation , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[7]  Satoshi Ikada,et al.  Improved Approximate Frequency Counts Algorithm based on "Lossy Counting" , 2008 .

[8]  Sun Yong Kim,et al.  Requirements for developing ultra-realistic live streaming systems , 2009, 2009 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS).

[9]  H. Sakamoto.  The "4K Pure Cinema" joint digital cinema trial , 2006 .

[10]  Masahiko Kitamura,et al.  A Study on the Correlation between QoE of 4K Super High Definition Video Streamings and QoS of Network , 2009, 2009 Proceedings of 18th International Conference on Computer Communications and Networks.

[11]  Satoru Emura,et al.  A method for posterior frequency-domain multi-channel residual echo canceling , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).