A New User-Adapted Search Haptic Algorithm to Navigate along Filiform Structures

One of the mayor research challenges of this century is the understanding of the human brain. Regarding this field line, simulation based research is gaining importance. A large amount of money is being spent in huge international projects such as The Human Brain Project [1] and The Blue Brain [2]. The behavior of the brain and, therefore, the behavior of brain simulations depend to a large extend on the neural topology. Neural elements are organized in a connected, dense, complex network of thread-like (i.e, filiform) structures. The analysis of a computer-based simulation using just the visual modality is a highly complex task due to the complexity of the neural topology and the large amounts of multi-variable and multi-modal data generated by computer simulations. In this paper, we propose the use of haptic devices to aid in the navigation along these neural structures, helping neurobiologists in the analysis of neural network topologies. However, haptic navigation constrained to complex filiform networks entails problems when these structures have high frequency features, noise and/or complex branching nodes. We address these issues by presenting a new user-adapted search haptic method that uses the forces exerted by the users to infer their intentions. In addition, we propose a specific calibration technique to adapt the haptic navigation to the user's skills and to the data. We validate this approach through a perceptual study. Finally, we show in this paper the application of our method to the analysis of dense and complex filiform structures in the neurobiology context. Additionally, our technique could be applied to other problems such as electronic circuits and graph exploration.

[1]  Lisa J. K. Durbeck,et al.  SCIRun Haptic Display for Scientific Visualization , 1999 .

[2]  Jonathan C. Roberts Visualization Display Models – ways to classify visual representations , 2009 .

[3]  Charles D. Hansen,et al.  A constraint-based technique for haptic volume exploration , 2003, IEEE Visualization, 2003. VIS 2003..

[4]  H. Markram The Blue Brain Project , 2006, Nature Reviews Neuroscience.

[5]  Carlos Renato Vázquez,et al.  Haptic guidance based on harmonic functions for the execution of teleoperated assembly tasks , 2007 .

[6]  Nelson L. Max,et al.  Progress in scientific visualization , 2005, The Visual Computer.

[7]  Piero Mussio,et al.  Multimodal Exploration and Manipulation of Graph Structures , 2008, ICCHP.

[8]  Stephane Cotin,et al.  Interactive physically-based simulation of catheter and guidewire , 2006, Comput. Graph..

[9]  Jean-Yves Fourquet,et al.  Interactive path planning for haptic assistance in assembly tasks , 2010, Comput. Graph..

[10]  James F. O'Brien,et al.  Interactive simulation of surgical needle insertion and steering , 2009, ACM Trans. Graph..

[11]  Jonathan C. Roberts,et al.  Virtual haptic exploratory visualization of line graphs and charts , 2002, IS&T/SPIE Electronic Imaging.

[12]  Anatole Lécuyer,et al.  Path-planning and manipulation of nanotubes using visual and haptic guidance , 2009, 2009 IEEE International Conference on Virtual Environments, Human-Computer Interfaces and Measurements Systems.

[13]  Stephen A. Brewster,et al.  Haptic Graphs for Blind Computer Users , 2000, Haptic Human-Computer Interaction.

[14]  Mandayam A. Srinivasan,et al.  Force Shading for Haptic Shape Perception , 1996, Dynamic Systems and Control.

[15]  Felix Schürmann,et al.  Practical Parallel Rendering of Detailed Neuron Simulations , 2013, EGPGV@Eurographics.

[16]  Ève Coste-Manière,et al.  Haptically augmented teleoperation , 2000, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[17]  Frederick P. Brooks,et al.  Project GROPE-HapticDisplays for Scientific Visualization , 1990 .

[18]  Shahram Payandeh,et al.  Artificial and natural force constraints in haptic-aided path planning , 2005, IEEE International Workshop on Haptic Audio Visual Environments and their Applications.

[19]  Stephane Cotin,et al.  Interactive Simulation of Flexible Needle Insertions Based on Constraint Models , 2009, MICCAI.

[20]  Oussama Khatib,et al.  The haptic display of complex graphical environments , 1997, SIGGRAPH.

[21]  Miguel A. Otaduy,et al.  Haptic navigation along filiform neural structures , 2011, 2011 IEEE World Haptics Conference.

[22]  Kanav Kahol,et al.  Tactile Cueing in Haptic Visualization , 2005 .

[23]  Jonathan C. Roberts,et al.  Review of Designs for Haptic Data Visualization , 2010, IEEE Transactions on Haptics.

[24]  J. Edward Colgate,et al.  Factors affecting the Z-Width of a haptic display , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[25]  Helwig Hauser,et al.  Visualization of Multi‐Variate Scientific Data , 2009, Comput. Graph. Forum.

[26]  Chung Hyuk Park,et al.  Haptically Guided Teleoperation for Learning Manipulation Tasks , 2007 .

[27]  Zeng-xuan Hou,et al.  Research of haptic techniques for computer-based education , 2009, 2009 4th International Conference on Computer Science & Education.

[28]  John Kenneth Salisbury,et al.  A constraint-based god-object method for haptic display , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.