Human-machine interface for a VR-based medical imaging environment

Modern 3D scanning techniques like magnetic resonance imaging (MRI) or computed tomography (CT) produce high- quality images of the human anatomy. Virtual environments open new ways to display and to analyze those tomograms. Compared with today's inspection of 2D image sequences, physicians are empowered to recognize spatial coherencies and examine pathological regions more facile, diagnosis and therapy planning can be accelerated. For that purpose a powerful human-machine interface is required, which offers a variety of tools and features to enable both exploration and manipulation of the 3D data. Man-machine communication has to be intuitive and efficacious to avoid long accustoming times and to enhance familiarity with and acceptance of the interface. Hence, interaction capabilities in virtual worlds should be comparable to those in the real work to allow utilization of our natural experiences. In this paper the integration of hand gestures and visual focus, two important aspects in modern human-computer interaction, into a medical imaging environment is shown. With the presented human- machine interface, including virtual reality displaying and interaction techniques, radiologists can be supported in their work. Further, virtual environments can even alleviate communication between specialists from different fields or in educational and training applications.

[1]  Karl-Hans Englmeier,et al.  Method for combining fast surface and exact volume visualization techniques in medicine , 1994, Medical Imaging.

[2]  W BARRY,et al.  INFLUENCE OF EYE LID MOVEMENT UPON ELECTRO-OCULOGRAPHIC RECORDING OF VERTICAL EYE MOVEMENTS. , 1965, Aerospace medicine.

[3]  David Zeltzer,et al.  A survey of glove-based input , 1994, IEEE Computer Graphics and Applications.

[4]  Stephen R. Ellis,et al.  What are virtual environments? , 1994, IEEE Computer Graphics and Applications.

[5]  Myron W. Krueger Automating virtual reality , 1995, IEEE Computer Graphics and Applications.

[6]  Dinesh Manocha,et al.  OBBTree: a hierarchical structure for rapid interference detection , 1996, SIGGRAPH.

[7]  Ulrich Schmitz Kommunikation zwischen Mensch und Maschine , 1992 .

[8]  Jean-Daniel Boissonnat,et al.  Steps Toward the Automatic Interpretation of 3D Images , 1990 .

[9]  L. Young,et al.  Survey of eye movement recording methods , 1975 .

[10]  R. B. Knapp,et al.  A real-time digital signal processing system for bioelectric control of music , 1988, ICASSP-88., International Conference on Acoustics, Speech, and Signal Processing.

[11]  Suzanne Weghorst,et al.  Virtual reality in medicine , 1994, Artif. Intell. Medicine.

[12]  O Rienhoff,et al.  Virtual Reality in Medicine , 1993, Methods of Information in Medicine.