Virtual Vouchers: Prototyping a Mobile Augmented Reality User Interface for Botanical Species Identification

the tools that botanists require for field-work must evolve and take on new forms. Of particular importance is the ability to identify existing and new species in the field. Mobile augmented reality systems can make it possible to access, view, and inspect a large database of virtual species examples side-by-side with physical specimens. In this paper, we present prototypes of a mobile augmented reality electronic field guide and techniques for displaying and inspecting computer vision-based visual search results in the form of virtual vouchers. Our work addresses head-movement controlled augmented reality for hands-free interaction and tangible augmented reality. We describe results from our design and investigation process and discuss observations and feedback from lab trials by botanists.

[1]  William C. Donelson.  Spatial management of information , 1978, SIGGRAPH.

[2]  Christopher F. Herot.  Spatial Management Of Data , 1979, VLDB 1979.

[3]  Christopher F. Herot,et al.  A prototype Spatial Data Management System , 1980, SIGGRAPH '80.

[4]  Robert F. Gurwitz,et al.  MIDAS: A Microprocessor Display and Animation System , 1981, IEEE Transactions on Education.

[5]  Mark Friedell,et al.  Context-sensitive, graphic presentation of information , 1982, SIGGRAPH.

[6]  G. W. Furnas,et al.  Generalized fisheye views , 1986, CHI '86.

[7]  Steven K. Feiner,et al.  Worlds within worlds: metaphors for exploring n-dimensional virtual worlds , 1990, UIST '90.

[8]  Scott P. Robertson,et al.  Proceedings of the SIGCHI Conference on Human Factors in Computing Systems , 1991 .

[9]  James C. Chung.  A comparison of head-tracked and non-head-tracked steering modes in the targeting of radiotherapy treatment beams , 1992, I3D '92.

[10]  Ken Perlin,et al.  Pad: an alternative approach to the computer interface , 1993, SIGGRAPH.

[11]  Kenneth A. Pier,et al.  Toolglass and magic lenses: the see-through interface , 1993, SIGGRAPH.

[12]  James D. Hollan,et al.  Pad++: a zooming graphical interface for exploring alternate interface physics , 1994, UIST '94.

[13]  Deborah Hix,et al.  Pre-screen projection: from concept to testing of a new interaction technique , 1995, CHI '95.

[14]  William Buxton,et al.  A taxonomy of See-Through Tools , 1995 .

[15]  Scott E. Hudson,et al.  Head-tracked orbital viewing: an interaction technique for immersive virtual environments , 1996, UIST '96.

[16]  John Viega,et al.  3D magic lenses , 1996, UIST '96.

[17]  Gregory D. Abowd,et al.  Cyberguide: A mobile context‐aware tour guide , 1997, Wirel. Networks.

[18]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[19]  Jun Rekimoto.  A Magnifying Glass Approach to Augmented Reality Systems , 1997, Presence Teleoperators Virtual Environ..

[20]  Stephen Travis Pope,et al.  A Description of the Model-View-Controller User Interface Paradigm in the Smalltalk-80 System , 1998 .

[21]  Chris Schmandt,et al.  Audio hallway: a virtual acoustic environment for browsing , 1998, UIST '98.

[22]  Dieter Schmalstieg,et al.  Strolling Through Cyberspace With Your Hands In Your Pockets: Head Directed Navigation In Virtual Environments , 1998, EGVE.

[23]  David R. Morse,et al.  FieldNote: a Handheld Information System for the Field , 1999 .

[24]  I. Oliver.  A Virtual Catalogue of Invertebrate Life on Earth , 1999 .

[25]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[26]  George G. Robertson,et al.  Toolspaces and glances: storing, accessing, and retrieving objects in 3D desktop applications , 1999, SI3D.

[27]  David R. Morse,et al.  Using while moving: HCI issues in fieldwork environments , 2000, TCHI.

[28]  Ivan Poupyrev,et al.  Virtual object manipulation on a table-top AR environment , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[29]  Benjamin B. Bederson,et al.  PhotoMesa: a zoomable image browser using quantum treemaps and bubblemaps , 2001, UIST '01.

[30]  Steven K. Feiner,et al.  An annotated situation-awareness aid for augmented reality , 2002, UIST '02.

[31]  Stephen A. Brewster,et al.  Multimodal 'eyes-free' interaction techniques for wearable devices , 2003, CHI '03.

[32]  R. Stevenson,et al.  Electronic Field Guides and User Communities in the Eco-informatics Revolution , 2003 .

[33]  Andy Cockburn,et al.  Through the looking glass: the use of lenses as an interface tool for Augmented Reality interfaces , 2004, GRAPHITE '04.

[34]  W. Kress.  Paper floras: how long will they last? a review of FLOWERING PLANTS OF THE NEOTROPICS , 2004 .

[35]  Haibin Ling,et al.  Using the inner-distance for classification of articulated shapes , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[36]  Scott R. Klemmer,et al.  ButterflyNet: Mobile Capture and Access for Biologists , 2005 .

[37]  Gaurav Agarwal,et al.  Presenting Visual Information to the User: Combining Computer Vision and Interface Design , 2005 .

[38]  Charles Eames,et al.  Powers of ten , 2005 .