Project GROPEHaptic displays for scientific visualization

We began in 1967 a project to develop a haptic+display for 6-D force fields of interacting protein molecules. We approached it in four stages: a 2-D system, a 3-D system tested with a simple task, a 6-D system tested with a simple task, and a full 6-D molecular docking system, our initial goal. This paper summarizes the entire project---the four systems, the evaluation experiments, the results, and our observations. The molecular docking system results are new.Our principal conclusions are:• Haptic display as an augmentation to visual display can improve perception and understanding both of force fields and of world models populated with impenetrable objects.• Whereas man-machine systems can outperform computer-only systems by orders of magnitude on some problems, haptic-augmented interactive systems seem to give about a two-fold performance improvement over purely graphical interactive systems. Better technology may give somewhat more, but a ten-fold improvement does not seem to be in the cards.• Chemists using GROPE-III can readily reproduce the true docking positions for drugs whose docking is known (but not to them) and can find very good docks for drugs whose true docks are unknown. The present tool promises to yield new chemistry research results; it is being actively used by research chemists.• The most valuable result from using GROPE-III for drug docking is probably the radically improved situation awareness that serious users report. Chemists say they have a new understanding of the details of the receptor site and its force fields, and of why a particular drug docks well or poorly.• We see various scientific/education applications for haptic displays but believe entertainment, not scientific visualization, will drive and pace the technology.• The hardware-software system technology we have used is barely adequate, and our experience sets priorities for future development.• Some unexpected perceptual phenomena were observed. All of these worked for us, not against us.

[1]  C. O. Weber.  The Properties of Space and Time in Kinaesthetic Fields of Force , 1927 .

[2]  C. O. Weber,et al.  The Properties of Space in Kinaesthetic Fields of Force , 1929 .

[3]  Paul W. Carhart,et al.  Webster's New International Dictionary , 1935 .

[4]  G. Mowbray,et al.  MAN'S SENSES AS INFORMATIONAL CHANNELS, , 1958 .

[5]  H. Wallace Sinaiko,et al.  Selected Papers on Human Factors in the Design and Use of Control Systems , 1961 .

[6]  Herbert Stanley Steelman,et al.  The grope-1 system. analysis of friction and backlash problems. , 1969 .

[7]  Joseph John Capowski.  Remote manipulators as a computer input device. , 1971 .

[8]  Frederick P. Brooks,et al.  GROPE-1: A Computer Display to the Sense of Feel , 1971, IFIP Congress.

[9]  Paul Jerome Kilpatrick,et al.  The use of a kinesthetic supplement in an interactive graphics system. , 1976 .

[10]  J. W. Hill.  Two measures of performance in a peg-in-hole manipulation task with force feedback , 1977 .

[11]  Frederick P. Brooks,et al.  The Computer "Scientist" as Toolsmith-Studies in Interactive Computer Graphics , 1977, IFIP Congress.

[12]  A K Bejczy,et al.  Sensors, Controls, and Man-Machine Interface for Advanced Teleoperation , 1980, Science.

[13]  L. Kuyper,et al.  Receptor-based design of dihydrofolate reductase inhibitors: comparison of crystallographically determined enzyme binding with enzyme affinity in a series of carboxy-substituted trimethoprim analogues. , 1982, Journal of medicinal chemistry.

[14]  M. L. Connolly.  Solvent-accessible surfaces of proteins and nucleic acids. , 1983, Science.

[15]  Thomas E. Ferrin,et al.  Computer graphics in real‐time docking with energy calculation and minimization , 1985 .

[16]  John C. Briggs,et al.  Getting graphics in gear , 1986 .

[17]  Neville Hogan,et al.  Stable execution of contact tasks using impedance control , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[18]  Lawrence W. Stark,et al.  Cooperative control in telerobotics , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[19]  Megan Joan Smith.  Tactile interface for three-dimensional computer-simulated environments : experimentation and the design of a brake-motor device , 1988 .

[20]  John A. Briggs,et al.  Getting graphics in gear: graphics and dynamics in driving simulation , 1988, SIGGRAPH.

[21]  Frederick P. Brooks,et al.  Using a manipulator for force display in molecular docking , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[22]  F. P. Brooks,et al.  Grasping reality through illusion—interactive graphics serving science , 1988, CHI '88.

[23]  Frederick P. Brooks,et al.  Force display performs better than visual display in a simple 6-D docking task , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[24]  Greg Turk,et al.  Interactive Collision Detection for Molecular Graphics , 1990 .

[25]  F. Brooks,et al.  Force display in molecular docking , 1990 .

[26]  Frederick P. Brooks,et al.  Feeling and seeing: issues in force display , 1990, I3D '90.

[27]  John E. Howland,et al.  Computer graphics , 1990, IEEE Potentials.