Remote 3D medical consultation

Two-dimensional (2D) video-based telemedical consultation has been explored widely in the past 15-20 years. Two issues that seem to arise in most relevant case studies are the difficulty associated with obtaining the desired 2D camera views, and poor depth perception To address these problems we are exploring the use of a small array of cameras to reconstruct a real-time, on-line 3D computer model of the real environment and events. We call this 3D medical consultation (3DMC). The idea is to give remote users what amounts to an infinite set of stereoscopic viewpoints, simultaneously addressing the visibility and depth perception problems associated with 2D video. Here we describe our current prototype system, some of the methods we use, and some early experimental results

[1]  Austin Henderson,et al.  Your place or mine? Learning from long-term use of Audio-Video communication , 1996, Computer Supported Cooperative Work (CSCW).

[2]  Judith S. Olson,et al.  Distance Matters , 2000, Hum. Comput. Interact..

[3]  William Buxton,et al.  The Chameleon: spatially aware palmtop computers , 1994, CHI '94.

[4]  A. Bandura.  Self-Efficacy: The Exercise of Control , 1997, Journal of Cognitive Psychotherapy.

[5]  Ruigang Yang,et al.  A Unified Approach To Real-Time, Multi-Resolution, Multi-Baseline 2d View Synthesis And 3d Depth Estimation Using Commodity Graphics Hardware , 2004, Int. J. Image Graph..

[6]  B. Johnston,et al.  Outcomes of the Kaiser Permanente Tele-Home Health Research Project. , 2000, Archives of family medicine.

[7]  Dieter Schmalstieg,et al.  First steps towards handheld augmented reality , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[8]  Ilona Heldal,et al.  Collaborating in networked immersive spaces: as good as being there together? , 2001, Comput. Graph..

[9]  Wanda J. Orlikowski,et al.  Learning from Notes: organizational issues in groupware implementation , 1992, CSCW '92.

[10]  Tj Coats,et al.  Towards improving prehospital trauma care , 2001, The Lancet.

[11]  Michael Potter Snow,et al.  Charting presence in virtual environments and its effects on performance , 1998 .

[12]  Karen Ruhleder,et al.  Steps Toward an Ecology of Infrastructure: Design and Access for Large Information Spaces , 1996, Inf. Syst. Res..

[13]  Ketan Mayer-Patel,et al.  A utility-driven framework for loss and encoding aware video adaptation , 2007, ACM Multimedia.

[14]  S. Dimmick,et al.  A Case Study of Benefits & Potential Savings in Rural Home Telemedicine , 2000, Home healthcare nurse.

[15]  Randy Pausch,et al.  A user study comparing head-mounted and stationary displays , 1993, Proceedings of 1993 IEEE Research Properties in Virtual Reality Symposium.

[16]  A. Meyer.  Death and disability from injury: a global challenge. , 1998, The Journal of trauma.

[17]  S. Tachakra.  Depth perception in telemedical consultations. , 2001, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[18]  Wanda J. Orlikowski,et al.  Learning from Notes: organizational issues in groupware implementation , 1992, CSCW '92.

[19]  J. Mayrose,et al.  A telemedicine model for emergency care in a short-term correctional facility. , 2001, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[20]  James P. Downey,et al.  Measuring General Computer Self-Efficacy: The Surprising Comparison of Three Instruments in Predicting Performance, Attitudes, and Usage , 2006, Proceedings of the 39th Annual Hawaii International Conference on System Sciences (HICSS'06).

[21]  Oliver Bimber,et al.  Video see-through AR on consumer cell-phones , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[22]  M. Roseman,et al.  A usability study of awareness widgets in a shared workspace groupware system , 1996, CSCW '96.

[23]  Woodrow Barfield,et al.  Presence within Virtual Environments as a Function of Visual Display Parameters , 1996, Presence: Teleoperators & Virtual Environments.

[24]  Dieter Schmalstieg,et al.  Handheld Augmented Reality Displays , 2006, IEEE Virtual Reality Conference (VR 2006).

[25]  Xin Huang,et al.  WISTA: a wireless transmission system for disaster patient care , 2005, 2nd International Conference on Broadband Networks, 2005..

[26]  M. Kienzle.  Rural-academic integration: Iowas national laboratory for the study of rural telemedicine , 2000 .

[27]  George W. Fitzmaurice,et al.  Situated information spaces and spatially aware palmtop computers , 1993, CACM.

[28]  G. Welch,et al.  Complementary Tracking and Two-Handed Interaction for Remote 3 D Medical Consultation with a PDA , 2007 .

[29]  Tom Drummond,et al.  Going out: robust model-based tracking for outdoor augmented reality , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[30]  Mary C. Whitton,et al.  Evaluating a scientific collaboratory: Results of a controlled experiment , 2003, TCHI.

[31]  Reginald L. Lagendijk,et al.  Accurate overlaying for mobile augmented reality , 1999, Comput. Graph..

[32]  Ken Hinckley,et al.  Passive real-world interface props for neurosurgical visualization , 1994, International Conference on Human Factors in Computing Systems.

[33]  Karen Ruhleder,et al.  Steps toward an ecology of infrastructure , 1996 .

[34]  Stephanie D. Teasley,et al.  Groupware in the wild: lessons learned from a year of virtual collocation , 1996, CSCW '96.

[35]  Z. Agha,et al.  Cost effectiveness of telemedicine for the delivery of outpatient pulmonary care to a rural population. , 2002, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[36]  Shumin Zhai,et al.  Virtual reality for palmtop computers , 1993, TOIS.

[37]  Jaehoon Jung,et al.  Hand-held virtual reality: a feasibility study , 2006, VRST '06.

[38]  Jaehoon Jung,et al.  Requirements, Implementation and Applications of Hand-held Virtual Reality , 2006, Int. J. Virtual Real..

[39]  Ruigang Yang,et al.  View-Dependent Pixel Coloring-A Physically-Based Approach for 2 D View Synthesis , 2003 .

[40]  Ketan Mayer-Patel,et al.  A general framework for multidimensional adaptation , 2004, MULTIMEDIA '04.