Flexible touch sensor for evaluating geometric properties of virtual shapes through sound

This paper describes the design and implementation of a system for rendering virtual shape through vision, haptic and sound. The system consists of a haptic strip that physically renders virtual curves. A flexible capacitive touch sensor (FCTS) is integrated with the haptic strip, and allows the system to track the position of the user's fingers on the strip. According to the position, the system renders curve properties such as curve shape, inflexion points and curvature through sound metaphors. The goal of this sonification approach is to strengthen the user's understanding of the shape of a virtual prototype, and to inform the user about geometrical attributes that could otherwise remain unseen. Such unseen attributes may either be a result of limitations in the visual and haptic display hardware or a result of limitations in human perception.

[1]  Raphael L. Levien,et al.  From Spiral to Spline: Optimal Techniques in Interactive Curve Design , 2009 .

[2]  Monica Bordegoni,et al.  Geodesic Spline Interface for Haptic Curve Rendering , 2011, IEEE Transactions on Haptics.

[3]  Umberto Cugini,et al.  Force Sensitive Handles and Capacitive Touch Sensor for Driving a Flexible Haptic-Based Immersive System , 2013, Sensors.

[4]  Insook Choi,et al.  Investigating geometric data with sound , 1996 .

[5]  Hans-Christian Hege,et al.  Visualization and Mathematics III , 2011 .

[6]  Umberto Cugini,et al.  A framework for managing multiprocess applications based on distributed finite-state machine approach , 2010, 19th International Symposium in Robot and Human Interactive Communication.

[7]  Umberto Cugini,et al.  Continuous Surface Rendering, Passing from CAD to Physical Representation , 2013 .

[8]  Tharon Howard.  Unexpected complexity in a traditional usability study , 2008 .

[9]  Monica Bordegoni,et al.  Haptic and Sound Interface for Shape Rendering , 2010, PRESENCE: Teleoperators and Virtual Environments.

[10]  Jean Scholtz,et al.  Common industry format for usability test reports , 2000, CHI Extended Abstracts.

[11]  Michael Pettitt,et al.  Curve shape and curvature perception through interactive sonification , 2012, TAP.

[12]  Joachim Gossmann,et al.  Towards an auditory representation of complexity , 2005 .

[13]  Hans-Christian Hege,et al.  Visualization and mathematics - experiments, simulations and environments , 1997 .

[14]  Thomas Hermann,et al.  Sonification for Exploratory Data Analysis , 2002 .

[15]  Rosane Minghim,et al.  An illustrated analysis of sonification for scientific visualisation , 1995, Proceedings Visualization '95.

[16]  Gregory Kramer,et al.  Auditory Display: Sonification, Audification, And Auditory Interfaces , 1994 .

[17]  Monica Bordegoni,et al.  Design of a Desktop Haptic System driven by CAD and Multi-body Systems Associativity , 2014 .

[18]  Marc Hassenzahl,et al.  User experience - a research agenda , 2006, Behav. Inf. Technol..

[19]  Patrick Roth,et al.  Graphics and User's Exploration via Simple Sonics (GUESS): Providing Interrelational Representation of Objects in a Non-visual Environment , 2001 .