Virtual reality: a reality for future military pilotage?

Virtual reality (VR) systems provide exciting new ways to interact with information and with the world. The visual VR environment can be synthetic (computer generated) or be an indirect view of the real world using sensors and displays. With the potential opportunities of a VR system, the question arises about what benefits or detriments a military pilot might incur by operating in such an environment. Immersive and compelling VR displays could be accomplished with an HMD (e.g., imagery on the visor), large area collimated displays, or by putting the imagery on an opaque canopy. But what issues arise when, instead of viewing the world directly, a pilot views a "virtual" image of the world? Is 20/20 visual acuity in a VR system good enough? To deliver this acuity over the entire visual field would require over 43 megapixels (MP) of display surface for an HMD or about 150 MP for an immersive CAVE system, either of which presents a serious challenge with current technology. Additionally, the same number of sensor pixels would be required to drive the displays to this resolution (and formidable network architectures required to relay this information), or massive computer clusters are necessary to create an entirely computer-generated virtual reality with this resolution. Can we presently implement such a system? What other visual requirements or engineering issues should be considered? With the evolving technology, there are many technological issues and human factors considerations that need to be addressed before a pilot is placed within a virtual cockpit.

[1]  B. Wandell.  Foundations of vision , 1995 .

[2]  Kenneth R. Boff,et al.  Engineering data compendium : human perception and performance , 1988 .

[3]  William E. Glenn.  Visual perception studies to improve the perceived sharpness of television images , 2004, J. Electronic Imaging.

[4]  Richard May,et al.  A Survey of Large High-Resolution Display Technologies, Techniques, and Applications , 2006, IEEE Virtual Reality Conference (VR 2006).

[5]  Wolfgang Heidrich,et al.  High dynamic range display systems , 2004, SIGGRAPH 2004.

[6]  Darrel G. Hopper,et al.  Capability of the human visual system , 2003, SPIE Defense + Commercial Sensing.

[7]  Chris North,et al.  Effects of tiled high-resolution display on basic visualization and navigation tasks , 2005, CHI Extended Abstracts.

[8]  Christhard Deter,et al.  High-power laser projection displays , 2001, IS&T/SPIE Electronic Imaging.

[9]  Patrick Ledda,et al.  Product Review: High Dynamic Range Displays , 2007, PRESENCE: Teleoperators and Virtual Environments.

[10]  Josephine Shallo-Hoffmann,et al.  Maximum Angle of Ocular Duction During Visual Fixation as a Function of Age , 2005, Strabismus.

[11]  Doug A. Bowman,et al.  Increased display size and resolution improve task performance in Information-Rich Virtual Environments , 2006, Graphics Interface.

[12]  Barry A. Po,et al.  Comparing CAVE, wall, and desktop displays for navigation and wayfinding in complex 3D models , 2004, Proceedings Computer Graphics International, 2004..