Natural Interaction and Wearable Augmented Reality for the Enjoyment of the Cultural Heritage in Outdoor Conditions

In this paper, a first prototype of a wearable, interactive augmented reality (AR) system for the enjoyment of the cultural heritage in outdoor environments, is presented. By using a binocular see-through display and a time-of-flight (ToF) depth sensor, the system provides the users with a visual augmentation of their surroundings and with touchless interaction techniques to interact with synthetic elements overlapping with the real world. The papers describes the hardware and software system components, and details the interface specifically designed for a socially acceptable cultural heritage exploration. Furthermore, the paper discusses the lesson learned from the first public presentation of the prototype we have carried out in Naples, Italy.

[1]  Mark Billinghurst,et al.  Using 3D hand gestures and touch input for wearable AR interaction , 2014, CHI Extended Abstracts.

[2]  John J. Leggett,et al.  Interaction styles and input/output devices , 1993, Behav. Inf. Technol..

[3]  Kenneth J. Waldron,et al.  The Workspaces of a Mechanical Manipulator , 1981 .

[4]  Doug A. Bowman,et al.  Novel Uses of Pinch Gloves™ for Virtual Environment Interaction Techniques , 2002, Virtual Reality.

[5]  Woontack Woo,et al.  Hand Tracking with a Near-Range Depth Camera for Virtual Object Manipulation in an Wearable Augmented Reality , 2014, HCI.

[6]  Thad Starner,et al.  Project Glass: An Extension of the Self , 2013, IEEE Pervasive Computing.

[7]  Mark Billinghurst,et al.  Augmented Reality Interfaces in Human Computation Systems , 2013, Handbook of Human Computation.

[8]  Didier Stricker,et al.  Archeoguide: first results of an augmented reality, mobile computing system in cultural heritage sites , 2001, VAST '01.

[9]  Woontack Woo,et al.  A usability study of multimodal input in an augmented reality environment , 2013, Virtual Reality.

[10]  Marcus Wan,et al.  Wearable mobile augmented reality: evaluating outdoor user experience , 2011, VRCAI '11.

[11]  Natasha Gelfand,et al.  Mobile Visual Computing , 2009, ISUVR 2009.

[12]  Dragos Datcu,et al.  Free-hands interaction in augmented reality , 2013, SUI '13.

[13]  Luigi Gallo,et al.  Low-Cost Augmented Reality Systems via 3D Point Cloud Sensors , 2011, 2011 Seventh International Conference on Signal Image Technology & Internet-Based Systems.

[14]  Steven K. Feiner,et al.  A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[15]  Luigi Gallo,et al.  Design and comparative evaluation of Smoothed Pointing: A velocity-oriented remote pointing enhancement technique , 2012, Int. J. Hum. Comput. Stud..

[16]  Steven K. Feiner,et al.  Exploring MARS: developing indoor and outdoor user interfaces to a mobile augmented reality system , 1999, Comput. Graph..

[17]  Mario Ciampi,et al.  Smoothed Pointing: A User-Friendly Technique for Precision Enhanced Remote Pointing , 2010, 2010 International Conference on Complex, Intelligent and Software Intensive Systems.

[18]  Ernesto Damiani,et al.  Temporal Denoising of Kinect Depth Data , 2012, 2012 Eighth International Conference on Signal Image Technology and Internet Based Systems.

[19]  Marko Jurmu,et al.  Scroll, tilt or move it: using mobile phones to continuously control pointers on large public displays , 2009, OZCHI.

[20]  Mark R. Mine,et al.  Virtual Environment Interaction Techniques , 1995 .