Virtual Reality Technologies in Telecommunication Services

Telecommunication service has been growing and progressing from telephone to high reality communication systems that are based on evolution of network and media technologies. Recognizing virtual reality (VR) as a communication tool, we provide a review of communication services and the directions they are moving in, as well as related VR technologies. The Immersive Telepresence System “Kirari!” is also introduced as the latest development example for a new telecommunication service.

[1]  Raffaella Folgieri,et al.  Virtual reality as a communication process , 2011, Virtual Reality.

[2]  Thushara D. Abhayapala,et al.  Practical implementation and analysis of spatial soundfield capture by higher order microphones , 2014, Signal and Information Processing Association Annual Summit and Conference (APSIPA), 2014 Asia-Pacific.

[3]  Andrew Jones,et al.  Achieving eye contact in a one-to-many 3D video teleconferencing system , 2009, ACM Trans. Graph..

[4]  Keigo Wakayama,et al.  Spatial Multi-Zone Sound Field Reproduction Using Higher-Order Loudspeakers in Reverberant Rooms , 2016 .

[5]  Hideshi Yamada,et al.  Rendering for an interactive 360° light field display , 2007, ACM Trans. Graph..

[6]  Sakuichi Ohtsuka,et al.  Apparent 3-D image perceived from luminance-modulated two 2-D images displayed at different depths , 2004, Vision Research.

[7]  Akio Kameda,et al.  VR technologies for rich sports experience , 2016, SIGGRAPH Emerging Technologies.

[8]  Stephan Rusdorf,et al.  V-Pong: an immersive table tennis simulation , 2006, IEEE Computer Graphics and Applications.

[9]  Hiroshi Saruwatari,et al.  Analytical approach to transforming filter design for sound field recording and reproduction using circular arrays with a spherical baffle. , 2016, The Journal of the Acoustical Society of America.

[10]  Yusuke Hioka,et al.  Diffused Sensing for Sharp Directive Beamforming , 2013, IEEE Transactions on Audio, Speech, and Language Processing.

[11]  Robert E. Kraut,et al.  The VideoWindow system in informal communication , 1990, CSCW '90.

[12]  Michitaka Hirose,et al.  Transmission of realistic sensation: Development of a virtual dome , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[13]  Shiro Suyama,et al.  58.2: A Compact Depth‐Fused 3‐D LCD , 2003 .

[14]  Hisao Uose.  GEMnet2: NTT's new network testbed for global R&D , 2005, First International Conference on Testbeds and Research Infrastructures for the DEvelopment of NeTworks and COMmunities.

[15]  G. Mantovani.  Virtual Reality as a Communication Environment: Consensual Hallucination, Fiction, and Possible Selves , 1995 .

[16]  Michitaka Hirose.  Image-Based Virtual World Generation , 1997, IEEE Multim..

[17]  Michitaka Hirose,et al.  Immersive telecommunication using stereo video avatar , 2001, Proceedings IEEE Virtual Reality 2001.

[18]  Masakazu Iwaki,et al.  Production and Live Transmission of 22.2 Multichannel Sound with Ultra-High Definition TV , 2007 .

[19]  Walter Kellermann,et al.  Wave-domain adaptive filtering: acoustic echo cancellation for full-duplex systems based on wave-field synthesis , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[20]  Thushara D. Abhayapala,et al.  Higher-Order Loudspeakers and Active Compensation for Improved 2D Sound Field Reproduction in Rooms , 2015 .

[21]  Jonathan Grudin,et al.  Integration of interpersonal space and shared workspace: ClearBoard design and experiments , 1993, TOIS.

[22]  Rodney A. Kennedy,et al.  On High-Resolution Head-Related Transfer Function Measurements: An Efficient Sampling Scheme , 2012, IEEE Transactions on Audio, Speech, and Language Processing.

[23]  Paul Dourish,et al.  Awareness and coordination in shared workspaces , 1992, CSCW '92.

[24]  Akira Omoto,et al.  Sound field reproduction and sharing system based on the boundary surface control principle , 2015 .

[25]  Serban R. Pop,et al.  A Virtual Environment for Rugby Skills Training , 2011 .

[26]  Christian Heath,et al.  Disembodied conduct: communication through video in a multi-media office environment , 1991, CHI.

[27]  Muhanna Muhanna,et al.  Virtual reality and the CAVE: Taxonomy, interaction challenges and research directions , 2015, J. King Saud Univ. Comput. Inf. Sci..

[28]  Tovi Grossman,et al.  YouMove: enhancing movement training with an augmented reality mirror , 2013, UIST.

[29]  Paul van Schaik,et al.  The Short-Term Effects of Real-Time Virtual Reality Feedback on Motor Learning in Dance , 2011, PRESENCE: Teleoperators and Virtual Environments.

[30]  Anton Nijholt,et al.  Eye gaze patterns in conversations: there is more to conversational agents than meets the eyes , 2001, CHI.

[31]  John C. Hart,et al.  The CAVE: audio visual experience automatic virtual environment , 1992, CACM.

[32]  R. Rabenstein,et al.  The Theory of Wave Field Synthesis Revisited , 2008 .

[33]  Akio Ando,et al.  Binaural Reproduction of 22.2 Multichannel Sound Over Loudspeakers , 2010 .

[34]  Shoichi Koyama,et al.  Analytical Approach to Wave Field Reconstruction Filtering in Spatio-Temporal Frequency Domain , 2013, IEEE Transactions on Audio, Speech, and Language Processing.

[35]  Akira Kojima,et al.  Highly Realistic 3D Display System for Space Composition Telecommunication , 2015 .

[36]  J. Blauert.  Spatial Hearing: The Psychophysics of Human Sound Localization , 1983 .

[37]  B. Katz,et al.  Framework for Real-Time Auralization in Architectural Acoustics , 2008 .

[38]  Woon-Seng Gan,et al.  Wave Field Synthesis: The Future of Spatial Audio , 2013, IEEE Potentials.

[39]  Heidi Sveistrup,et al.  Motor rehabilitation using virtual reality , 2004, Journal of NeuroEngineering and Rehabilitation.

[40]  Bruno Arnaldi,et al.  Real Handball Goalkeeper vs. Virtual Handball Thrower , 2003, Presence: Teleoperators & Virtual Environments.

[41]  Prashant Sharma.  Challenges with virtual reality on mobile devices , 2015, SIGGRAPH Talks.

[42]  Kazunobu Fukuhara,et al.  Recognition of Tennis Serve Performed by a Digital Player: Comparison among Polygon, Shadow, and Stick-Figure Models , 2012, PloS one.

[43]  Frank Melchior,et al.  Object-Based 3D Audio Production for Virtual Reality Using the Audio Definition Model , 2016 .

[44]  S. Ise.  A principle of sound field control based on the Kirchhoff-Helmholtz integral equation and the theory of inverse systems , 1999 .

[45]  Deep Sen,et al.  Efficient, Compelling, and Immersive VR Audio Experience Using Scene Based Audio/Higher Order Ambisonics , 2016 .

[46]  Shoichi Koyama,et al.  Real-Time Sound Field Transmission System by Using Wave Field Reconstruction Filter and Its Evaluation , 2014, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[47]  Shoichi Koyama,et al.  Reproducing Virtual Sound Sources in Front of a Loudspeaker Array Using Inverse Wave Propagator , 2012, IEEE Transactions on Audio, Speech, and Language Processing.

[48]  Ning Hu,et al.  Training for physical tasks in virtual environments: Tai Chi , 2003, IEEE Virtual Reality, 2003. Proceedings..

[49]  F. Biocca,et al.  Communication in the age of virtual reality , 1995 .

[50]  Nicolas Tsingos,et al.  Immersive Audio for VR , 2016 .

[51]  Paul Dourish,et al.  Portholes: supporting awareness in a distributed work group , 1992, CHI.

[52]  Hideaki Kuzuoka,et al.  Agora: a remote collaboration system that enables mutual monitoring , 1999, CHI Extended Abstracts.

[53]  Makoto Otani,et al.  Sound Image Localization Using Dynamic Transaural Reproduction with Non-contact Head Tracking , 2014, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[54]  Shuichi Sakamoto,et al.  Sound-space recording and binaural presentation system based on a 252-channel microphone array , 2015 .

[55]  Giuseppe Riva,et al.  Virtual Reality as Communication Tool: A Sociocognitive Analysis , 1999, Presence.

[56]  Ryo Ishii,et al.  MoPaCo: High telepresence video communication system using motion parallax with monocular camera , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[57]  Masahiko Inami,et al.  Immersive autostereoscopic display for mutual telexistence: TWISTER I (Telexistence wide-angle immersive STEReoscope model I) , 2001, Proceedings IEEE Virtual Reality 2001.

[58]  Kazuhiro Otsuka.  MMSpace: Kinetically-augmented telepresence for small group-to-group conversations , 2016, 2016 IEEE Virtual Reality (VR).

[59]  Hiroshi Ishii.  TeamWorkStation: towards a seamless shared workspace , 1990, CSCW '90.

[60]  Philip A. Nelson,et al.  Surround System Based on Three-Dimensional Sound Field Reconstruction , 2008 .

[61]  John C. Tang,et al.  Videodraw: a video interface for collaborative drawing , 1991, TOIS.

[62]  Maureen K. Holden,et al.  Use of Virtual Environments in Motor Learning and Rehabilitation , 2002 .

[63]  Carolina Cruz-Neira,et al.  Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE , 2023 .

[64]  Mark A. Poletti,et al.  Three-Dimensional Surround Sound Systems Based on Spherical Harmonics , 2005 .

[65]  Takeshi Naemura,et al.  E-IMPACT: exaggerated illustrations using multi-perspective animation control tree structure , 2011, Advances in Computer Entertainment Technology.

[66]  H. Takada.  A compact depth-fused 3-D LCD , 2003 .

[67]  Satoshi Iwaki,et al.  On natural living room communication with "ComAdapter": adapting to the differences in room structure , 2003, CHI Extended Abstracts.

[68]  Shinichi Shiwa,et al.  Motion tracking method for the CAVE/sup TM/ system , 2000, WCC 2000 - ICSP 2000. 2000 5th International Conference on Signal Processing Proceedings. 16th World Computer Congress 2000.

[69]  Satoru Emura,et al.  Echo Canceler for Real-Time Audio Communication with Wave Field Reconstruction , 2015 .

[70]  Kazuho Ono,et al.  Portable Spherical Microphone for Super Hi-Vision 22.2 Multichannel Audio , 2013 .

[71]  Yutaka Matsushita,et al.  Multiparty videoconferencing at virtual social distance: MAJIC design , 1994, CSCW '94.

[72]  Junji Yamato,et al.  t-Room: Next Generation Video Communication System , 2008, IEEE GLOBECOM 2008 - 2008 IEEE Global Telecommunications Conference.

[73]  Emiko Charbonneau,et al.  Teach me to dance: exploring player experience and performance in full body dance games , 2011, Advances in Computer Entertainment Technology.

[74]  Nigel Simpson,et al.  Porta-person: telepresence for the connected conference room , 2007, CHI Extended Abstracts.

[75]  Masaya Hirashima,et al.  Intermittent Visual Feedback Can Boost Motor Learning of Rhythmic Movements: Evidence for Error Feedback Beyond Cycles , 2012, The Journal of Neuroscience.

[76]  K. Iso,et al.  Video Conference 3D Display That Fuses Images to Replicate Gaze Direction , 2012, Journal of Display Technology.

[77]  Francis M. Boland,et al.  Comparing Ambisonic Microphones – Part 1 , 2016 .

[78]  Franck Multon,et al.  Using Virtual Reality to Analyze Sports Performance , 2010, IEEE Computer Graphics and Applications.

[79]  Yukio Iwaya,et al.  3D Spatial Sound Systems Compatible with Human's Active Listening to Realize Rich High-Level kansei Information , 2012 .

[80]  Munekazu Date,et al.  Highly Realistic 3D Display System for Space Composition Telecommunication , 2015, Journal of Display Technology.

[81]  Shefeng Yan,et al.  Optimal Modal Beamforming for Spherical Microphone Arrays , 2011, IEEE Transactions on Audio, Speech, and Language Processing.