Chirurgie augmentée : un cas de réalité augmentée ; Conception et réalisation centrées sur l'utilisateur. (Augmented Surgery : an Augmented Reality Case Study ; User-Centred Design and Realization)

Les travaux pluridisciplinaires de cette these, contribuent a deux domaines : les Interfaces Homme-Machine (IHM), en particulier la Realite Augmentee (RA), et les Gestes Medico-Chirurgicaux Assistes par Ordinateur (GMCAO), domaine concret de mise en oeuvre de la RA. La contribution est double : d'une part elle enrichit et organise les concepts d'IHM pour la RA en adoptant un point de vue centre sur la tâche, et d'autre part elle ameliore l'utilisabilite par les cliniciens des systemes de GMCAO. La fusion du monde reel et du monde virtuel ouvre des voies nouvelles pour la conception de systemes de RA, comme les systemes de GMCAO. Mais les limites sont mal cernees. Dans ce contexte, nous avons identifie des caracteristiques intrinseques des systemes de RA et etabli un espace taxinomique. Afin de caracteriser plus finement la dualite de l'interaction (Utilisateur-Monde Reel et Utilisateur-Monde Virtuel), nous avons defini la notation ASUR. Pour decrire l'interaction, ASUR identifie les entites intervenant dans le systeme, en particulier les adaptateurs, composants ASUR realisant le lien entre les deux mondes. L'utilisation d'ASUR, par ces aspects descriptifs, taxinomiques et conceptuels constitue la base de notre demarche de conception ergonomique et logicielle de systemes de RA. Cette demarche se fonde en outre sur l'etude de proprietes ergonomiques au sein de la description ASUR d'un systeme et sur l'adaptation du modele d'architecture PAC-Amodeus aux systemes de RA. En collaboration avec le chirurgien, nous avons applique et teste nos resultats methodologiques sur une application concrete de chirurgie cardiaque. Cette application, CASPER, assiste le chirurgien lors de la realisation d'une ponction pericardique, en lui procurant des informations de guidage du geste clinique sur un ecran. Une re-conception de CASPER nous a amene a implementer un casque semi-transparent permettant de visualiser ces informations directement sur le patient.

[1]  Steven K. Feiner,et al.  Knowledge-based augmented reality , 1993, CACM.

[2]  Lisa Stifelman,et al.  Augmenting real-world objects: a paper-based audio notebook , 1996, CHI Conference Companion.

[3]  P. Dillenbourg,et al.  Miscommunication in Multi-modal Collaboration , 1995 .

[4]  Abigail Sellen,et al.  One is not enough: multiple views in a media space , 1993, INTERCHI.

[5]  Tsutomu Miyasato,et al.  A palmtop display for dextrous manipulation with haptic sensation , 1996, CHI.

[6]  Michel Beaudouin-Lafon,et al.  Charade: remote control of objects using free-hand gestures , 1993, CACM.

[7]  Stéphane Lavallée,et al.  Gestes médico-chirurgicaux assistés par ordinateur : application à la neurochirurgie stéréotaxique , 1989 .

[8]  Christophe Bruley.  Analyse des représentations graphiques de l'information : extensions aux représentations tridimensionnelles , 1999 .

[9]  Steven K. Feiner,et al.  Augmented Reality in Architectural Construction, Inspection, and Renovation , 1996 .

[10]  D Glauser,et al.  Neurosurgical robot Minerva: first results and current developments. , 1995, Journal of image guided surgery.

[11]  Thomas Berlage,et al.  Supporting ultrasound diagnosis using an animated 3D model of the heart , 1996, Proceedings of the Third IEEE International Conference on Multimedia Computing and Systems.

[12]  S. Lavallée,et al.  Image-guided spinal surgery: Technology, operative technique, and clinical practice , 2000 .

[13]  Joëlle Coutaz,et al.  A dimension space for the design of interactive systems within their physical environments , 2000, DIS '00.

[14]  Frédéric Vernier.  La multimodalité en sortie et son application à la visualisation de grandes quantités d'information , 2001 .

[15]  P. S. Green,et al.  Mobile Telepresence Surgery , 1995 .

[16]  Steve Benford,et al.  A Spatial Model of Interaction in Large Virtual Environments , 1993, ECSCW.

[17]  H. E. Pople,et al.  Internist-1, an experimental computer-based diagnostic consultant for general internal medicine. , 1982, The New England journal of medicine.

[18]  Andy Hopper,et al.  The active badge location system , 1992, TOIS.

[19]  David J. Hawkes,et al.  Neurosurgical Guidance Using the Stereo Microscope , 1995, CVRMed.

[20]  A Hamadeh,et al.  Computer Assisted Spine Surgery , 1997, Clinical orthopaedics and related research.

[21]  Katashi Nagao,et al.  The world through the computer: computer augmented interaction with real world environments , 1995, UIST '95.

[22]  David E. Breen,et al.  Object Calibration for Augmented Reality , 1995, Comput. Graph. Forum.

[23]  Catherine Barbe-Zoppis.  Guidage de gestes médico-chirurgicaux sur tissus mous : application à la ponction péricardique assistée par échographie 2,5D , 1997 .

[24]  Gilbert Cockton,et al.  Design Principles for Interactive Software , 1997, IFIP — The International Federation for Information Processing.

[25]  Harry E. Pople,et al.  An Experimental Computer-Based Diagnostic Consultant for General Internal Medicine , 1982 .

[26]  Niels Ole Bernsen,et al.  Foundations of Multimodal Representations: A Taxonomy of Representational Modalities , 1994, Interact. Comput..

[27]  P. Cinquin.  Gestes médico-chirurgicaux assistes par ordinateur , 1993 .

[28]  Norbert A. Streitz,et al.  DOLPHIN: integrated meeting support across local and remote desktop environments and LiveBoards , 1994, CSCW '94.

[29]  François Bérard.  Vision par ordinateur pour l'interaction homme-machine fortement couplée. (Computer vision for tightly coupled human computer interaction) , 1999 .

[30]  T. Ohlmann,et al.  Les systèmes perceptifs spatiaux vicariants , 1990 .

[31]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[32]  Philippe Coiffet,et al.  Virtual Reality Technology , 2003, Presence: Teleoperators & Virtual Environments.

[33]  Colin Ware.  Multimedia output devices and techniques , 1996, CSUR.

[34]  Carolina Cruz-Neira,et al.  Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE , 2023 .

[35]  Hiroshi Ishii,et al.  Illuminating light: an optical design tool with a luminous-tangible interface , 1998, CHI.

[36]  R. D. Hibberd,et al.  Robot assisted knee surgery , 1995 .

[37]  Takeo Kanade,et al.  An Image Overlay System for Medical Data Visualization , 1998, MICCAI.

[38]  Klaus Radermacher,et al.  Image guided Orthopedic Surgery using individual templates , 1997 .

[39]  D. Karron,et al.  Surgical navigation using audio feedback. , 1997, Studies in health technology and informatics.

[40]  Peter Kazanzides,et al.  Development of a surgical robot for cementless total hip replacement , 1993, Robotica.

[41]  James L. Crowley,et al.  Early Experience with the Mediaspace CoMedi , 1998, EHCI.

[42]  David E. Breen,et al.  Confluence of Computer Vision and Interactive Graphies for Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[43]  S. Lavallée,et al.  Computer Assisted Reconstruction of the Anterior Cruciate Ligament , 1998, Clinical orthopaedics and related research.

[44]  SystemRoy Want,et al.  The Active Badge Location , 1992 .

[45]  David Blatner,et al.  Silicon Mirage: The Art and Science of Virtual Reality , 1992 .

[46]  S Weghorst,et al.  The representation of blood flow in endourologic surgical simulations. , 2001, Studies in health technology and informatics.

[47]  Yutaka Matsushita,et al.  Multiparty videoconferencing at virtual social distance: MAJIC design , 1994, CSCW '94.

[48]  H. McGurk,et al.  Hearing lips and seeing voices , 1976, Nature.

[49]  Ben Shneiderman,et al.  The eyes have it: a task by data type taxonomy for information visualizations , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[50]  Russell H. Taylor,et al.  Human Versus Robotic Organ Retraction During Laparoscopic Nissen Fundoplication , 1998, MICCAI.

[51]  R. Kikinis,et al.  Interactive virtual endoscopy. , 1997, AJR. American journal of roentgenology.

[52]  Kensaku Mori,et al.  Automated Extraction and Visualization of Bronchus from 3D CT Images of Lung , 1995, CVRMed.

[53]  J L Coudert,et al.  Computer-assisted dental implant surgery using computed tomography. , 1995, Journal of image guided surgery.

[54]  W. Buxton.  Human-Computer Interaction , 1988, Springer Berlin Heidelberg.

[55]  Ronald Azuma,et al.  Predictive tracking for augmented reality , 1995 .

[56]  Jocelyne Troccaz,et al.  Semi-active guiding systems in surgery. A two-dof prototype of the passive arm with dynamic constraints (PADyC) , 1996 .

[57]  W. Mackay.  Réalité augmentée : Le meilleur des deux mondes , 1996 .

[58]  Alain Tanguy,et al.  Virtual Reality as an Operative Tool During Scoliosis Surgery , 1995, CVRMed.

[59]  Ken Hinckley,et al.  Passive real-world interface props for neurosurgical visualization , 1994, CHI '94.

[60]  Jocelyne Troccaz,et al.  Computer-Guided Pericardiocentesis: Experimental Results and Clinical Perspectives , 2000, Herz.

[61]  W. Eric L. Grimson,et al.  An automatic registration method for frameless stereotaxy, image guided surgery, and enhanced reality visualization , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[62]  Philip J. Barnard,et al.  Modelling multimodal interaction: A theory-based technique for design analysis support , 1997, INTERACT.

[63]  Laurence Nigay,et al.  Mobile Collaborative Augmented Reality: The Augmented Stroll , 2001, EHCI.

[64]  Robert van Liere,et al.  User Interface Management Systems , 1987, Advances in Computer Graphics.

[65]  Koji Ikuta,et al.  Virtual Endoscope System with Force Sensation , 1998, MICCAI.

[66]  Clarence A. Ellis,et al.  Groupware: some issues and experiences , 1991, CACM.

[67]  Takeo Kanade,et al.  Development and validation of a navigational guidance system for acetabular implant placement , 1997, CVRMed.

[68]  Jocelyne Troccaz,et al.  Computer-ASsisted PERicardial punctures: animal feasibility study , 1997, CVRMed.

[69]  Yoram Reich,et al.  Varieties and issues of participation and design , 1996 .

[70]  M Scholz,et al.  Development of an endoscopic navigation system based on digital image processing. , 1998, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[71]  Ramin Shahidi,et al.  Volumetric Image Guidance via a Stereotactic Endoscope , 1998, MICCAI.

[72]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[73]  Hideaki Kuzuoka,et al.  GestureCam: a video communication system for sympathetic remote collaboration , 1994, CSCW '94.

[74]  Philippe Palanque,et al.  Software Architecture Modelling: Bridging Two Worlds Using Ergonomics and Software Properties , 1998 .

[75]  Ramesh Raskar,et al.  Augmented Reality Visualization for Laparoscopic Surgery , 1998, MICCAI.

[76]  Pierre David Wellner,et al.  Interacting with paper on the DigitalDesk , 1993, CACM.

[77]  Herbert H. Clark,et al.  Contributing to Discourse , 1989, Cogn. Sci..

[78]  Robert L. Mason,et al.  Statistical Principles in Experimental Design , 2003 .

[79]  Michael Gervautz,et al.  Collaborative gaming in augmented reality , 1998, VRST '98.

[80]  Philippe Cinquin,et al.  Computer-augmented surgery , 1996 .