Tactons: Structured Tactile Messages for Non-Visual Information Display

Tactile displays are now becoming available in a form that can be easily used in a user interface. This paper describes a new form of tactile output. Tactons, or tactile icons, are structured, abstract messages that can be used to communicate messages non-visually. A range of different parameters can be used for Tacton construction including: frequency, amplitude and duration of a tactile pulse, plus other parameters such as rhythm and location. Tactons have the potential to improve interaction in a range of different areas, particularly where the visual display is overloaded, limited in size or not available, such as interfaces for blind people or in mobile and wearable devices. This paper describes Tactons, the parameters used to construct them and some possible ways to design them. Examples of where Tactons might prove useful in user interfaces are given.

[1]  A. Edwards.  Extra-ordinary human-computer interaction: interfaces for users with disabilities , 1995 .

[2]  Rupert Ah.  Tactile situation awareness system: proprioceptive prostheses for sensory deficiencies. , 2000 .

[3]  J. Moran,et al.  Sensation and perception , 1980 .

[4]  Alex Pentland,et al.  Tactual displays for sensory substitution and wearable computers , 2005, SIGGRAPH Courses.

[5]  Robert J. Stone,et al.  Haptic Feedback: A Brief History from Telepresence to Virtual Reality , 2000, Haptic Human-Computer Interaction.

[6]  S. Lederman.  Auditory Texture Perception , 1979, Perception.

[7]  Toshiaki Sugimura,et al.  Active click: tactile feedback for touch panels , 2001, CHI Extended Abstracts.

[8]  Susan J. Lederman,et al.  Sensing and Displaying Spatially Distributed Fingertip Forces in Haptic Interfaces for Teleoperator and Virtual Environment Systems , 1999, Presence: Teleoperators & Virtual Environments.

[9]  Ben Shneiderman,et al.  Designing The User Interface , 2013 .

[10]  Richard Martin,et al.  Design for wearability , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[11]  Jun Rekimoto,et al.  Ambient touch: designing tactile interfaces for handheld devices , 2002, UIST '02.

[12]  J.B.F. van Erp,et al.  Guidelines for the use of vibro-tactile displays in human computer interaction , 2002 .

[13]  G. Gescheider.  Psychophysics: The Fundamentals , 1997 .

[14]  C. Sherrick.  A scale for rate of tactual vibration. , 1985, The Journal of the Acoustical Society of America.

[15]  Stephen A. Brewster,et al.  Evaluation of multimodal graphs for blind people , 2003, Universal Access in the Information Society.

[16]  Lorna M. Brown,et al.  A first investigation into the effectiveness of Tactons , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[17]  S. Lederman.  Tactile roughness of grooved surfaces: The touching process and effects of macro- and microsurface structure , 1974 .

[18]  William Harwin,et al.  A high bandwidth interface for haptic human computer interaction , 2001 .

[19]  Ben P. Challis,et al.  Design Principles for Tactile Interaction , 2000, Haptic Human-Computer Interaction.

[20]  R W Cholewiak,et al.  Vibrotactile threshold in young and old observers: the effects of spatial summation and the presence of a rigid surround. , 1996, The Journal of the Acoustical Society of America.

[21]  W. M. Rabinowitz,et al.  Information transmission with a multifinger tactual display , 1999, Perception & psychophysics.

[22]  F. A. Geldard,et al.  The Cutaneous "Rabbit": A Perceptual Illusion , 1972, Science.

[23]  Andrew Chan,et al.  Designing Haptic Icons to Support an Urgency-Based Turn-Taking Protocol , 2004 .

[24]  Gunnar Jansson,et al.  Identification of haptic virtual objects with different degrees of complexity , 2002 .

[25]  Georg v. Békésy,et al.  Neural Funneling along the Skin and between the Inner and Outer Hair Cells of the Cochlea , 1959 .

[26]  Philip Barker,et al.  Pictorial Dialogue Methods , 1989, Int. J. Man Mach. Stud..

[27]  Hendrik A. H. C. van Veen,et al.  Tactile Information Presentation in the Cockpit , 2000, Haptic Human-Computer Interaction.

[28]  G. D. Goff.  Differential discrimination of frequency of cutaneous mechanical vibration. , 1967, Journal of experimental psychology.

[29]  Frank A. Geldard,et al.  Cutaneous coding of optical signals: The optohapt , 1966 .

[30]  R. Klatzky,et al.  Hand movements: A window into haptic object recognition , 1987, Cognitive Psychology.

[31]  S. Bolanowski,et al.  Four channels mediate the mechanical aspects of touch. , 1988, The Journal of the Acoustical Society of America.

[32]  Shumin Zhai,et al.  What You Feel Must Be What You See: Adding Tactile Feedback to the Trackpoint , 1999, INTERACT.

[33]  Christopher D. Wickens,et al.  Workload Assessment and Prediction , 1990 .

[34]  J.B.F. van Erp,et al.  Vibro-Tactile Information Presentation in Automobiles , 2001 .

[35]  Jun Rekimoto,et al.  TouchEngine: a tactile display for handheld devices , 2002, CHI Extended Abstracts.

[36]  Stephen Brewster,et al.  Providing a Structured Method for Integrating Non-Speech Audio into Human-Computer Interfaces , 1994 .

[37]  R W Cholewiak,et al.  The generation of vibrotactile patterns on a linear array: Influences of body site, time, and presentation mode , 2000, Perception & psychophysics.

[38]  Meera M. Blattner,et al.  Earcons and Icons: Their Structure and Common Design Principles (Abstract only) , 1989, SGCH.

[39]  M. Sile O'Modhrain,et al.  Cutaneous Grooves: Composing for the Sense of Touch , 2002 .

[40]  M Akamatsu,et al.  Please Scroll down for Article Ergonomics a Comparison of Tactile, Auditory, and Visual Feedback in a Pointing Task Using a Mouse-type Device , 2022 .

[41]  Adrianus J. M. Houtsma.  Estimation of mutual information from limited experimental data , 1983 .

[42]  G A Gescheider,et al.  Vibrotactile temporal gap detection as a function of age. , 1990, The Journal of the Acoustical Society of America.

[43]  B. D. Adelstein,et al.  Perceptual decomposition of virtual haptic surfaces , 1993, Proceedings of 1993 IEEE Research Properties in Virtual Reality Symposium.

[44]  R W Cholewiak,et al.  Vibrotactile pattern discrimination and communality at several body sites , 1995, Perception & psychophysics.

[45]  Stephen A. Brewster,et al.  Space, the Final Frontearcon: The Identification of Concurrently Presented Earcons in a Synthetic Spatialised Auditory Environment , 2004, ICAD.

[46]  I. Pollack,et al.  The Information of Elementary Multidimensional Auditory Displays , 1954 .

[47]  David McGookin,et al.  AN INVESTIGATION INTO THE IDENTIFICATION OF CONCURRENTLY PRESENTED EARCONS , 2003 .

[48]  S. Bolanowski,et al.  Hairy skin: psychophysical channels and their physiological substrates. , 1994, Somatosensory & motor research.

[49]  Daniel P. Siewiorek,et al.  Design of a wearable tactile display , 2001, Proceedings Fifth International Symposium on Wearable Computers.

[50]  Sunita Ram,et al.  The people sensor: a mobility aid for the visually impaired , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[51]  S Weinstein,et al.  Intensive and extensive aspects of tactile sensitivity as a function of body part, sex, and laterality , 1968 .

[52]  B H Brown,et al.  Information from time-varying vibrotactile stimuli. , 1997, The Journal of the Acoustical Society of America.

[53]  Alex Pentland,et al.  Tactual displays for wearable computing , 2005, Personal Technologies.

[54]  Hong Z. Tan,et al.  Information transmission with a multi-finger tactual display , 1997, Scandinavian audiology. Supplementum.

[55]  Stephen A. Brewster,et al.  Understanding concurrent earcons: Applying auditory scene analysis principles to concurrent earcon recognition , 2004, TAP.

[56]  Stephen A. Zahorian,et al.  Vibrotactile frequency for encoding a speech parameter , 1976 .

[57]  Jon Driver,et al.  Cross-modal links in attention between audition, vision, and touch: Implications for interface design , 1997 .

[58]  Ga Miller,et al.  Note on the bias of information estimates , 1955 .

[59]  Karon E. MacLean,et al.  The hapticon editor: a tool in support of haptic communication research , 2003, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings..

[60]  Perry R. Hinton.  Statistics Explained: A Guide for Social Science Students , 1995 .

[61]  J. Hahn.  Vibrotactile adaptation and recovery measured by two methods. , 1966, Journal of experimental psychology.

[62]  Marjorie Darrah,et al.  Haptic Display of Mathematical Functions for Teaching Mathematics to Students with Vision Disabilities: Design and Proof of Concept , 2000, Haptic Human-Computer Interaction.

[63]  V. L. Senders,et al.  Measurement and statistics , 1958 .

[64]  Carter C. Collins,et al.  Seeing with the skin , 1970 .

[65]  Martin Kurze,et al.  Rendering drawings for interactive haptic perception , 1997, CHI.

[66]  Ove Franzén,et al.  Vibrotactile frequency discrimination , 1975 .

[67]  J M Weisenberger.  Sensitivity to amplitude-modulated vibrotactile signals. , 1986, The Journal of the Acoustical Society of America.

[68]  Eric Gunther,et al.  Skinscape: A Tool for Composition in the Tactile Modality , 2001 .

[69]  David McGookin.  THE PRESENTATION OF MULTIPLE EARCONS IN A SPATIALISED AUDIO SPACE , 2002 .

[70]  E. Terhardt.  On the perception of periodic sound fluctuations (roughness) , 1974 .

[71]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[72]  K. Sathian,et al.  Temporal Cues Contribute to Tactile Perception of Roughness , 2001, The Journal of Neuroscience.

[73]  A. F. Rovers,et al.  HIM: a framework for haptic instant messaging , 2004, CHI EA '04.

[74]  Ivan Poupyrev,et al.  Haptic feedback for pen computing: directions and strategies , 2004, CHI EA '04.

[75]  P. Anderson.  Touching: The Human Significance of the Skin , 1978 .

[76]  Chapter 12. Non-speech Auditory Output , 2022 .

[77]  M. Hollins,et al.  Vibrotactile adaptation enhances frequency discrimination. , 1994, The Journal of the Acoustical Society of America.

[78]  W.J. Tompkins,et al.  Electrotactile and vibrotactile displays for sensory substitution systems , 1991, IEEE Transactions on Biomedical Engineering.

[79]  N I Durlach,et al.  Multidimensional tactile displays: identification of vibratory intensity, frequency, and contactor area. , 1987, The Journal of the Acoustical Society of America.

[80]  Stephen Brewster,et al.  Experimentally Derived Guidelines for the Creation of Earcons , 2001 .

[81]  R. Stone.  Haptic Feedback : A Potted History , From Telepresence to Virtual Reality , 2000 .

[82]  F A GELDARD,et al.  Some neglected possibilities of communication. , 1960, Science.

[83]  M. Hollins,et al.  Vibrotactile adaptation enhances amplitude discrimination. , 1993, The Journal of the Acoustical Society of America.

[84]  Alan C. Brady,et al.  Results from a Tactile Array on the Fingertip , 2003 .

[85]  Andy Cockburn,et al.  Multimodal feedback for the acquisition of small targets , 2005, Ergonomics.

[86]  James C. Craig.  Tactile pattern recognition and its perturbations , 1983 .

[87]  Karon E. MacLean,et al.  Learning and identifying haptic icons under workload , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[88]  P. Cook,et al.  Memory for musical tempo: Additional evidence that auditory memory is absolute , 1996, Perception & psychophysics.

[89]  Frank A. Geldard,et al.  The cutaneous saltatory area and its presumed neural basis , 1983 .

[90]  F L Wightman,et al.  Localization using nonindividualized head-related transfer functions. , 1993, The Journal of the Acoustical Society of America.

[91]  Angela Chang,et al.  Audio-haptic feedback in mobile phones , 2005, CHI Extended Abstracts.

[92]  B. Shneiderman.  Designing the User Interface (3rd Ed.) , 1998 .

[93]  Hong Z. Tan,et al.  Using spatial vibrotactile cues to direct visual attention in driving scenes , 2005 .

[94]  Martin Kurze.  TGuide: A guidance system for tactile image exploration , 1999, Behav. Inf. Technol..

[95]  Hiroshi Ishii,et al.  ComTouch: design of a vibrotactile communication device , 2002, DIS '02.

[96]  A E Carney,et al.  Vibrotactile perception of suprasegmental features of speech: a comparison of single-channel and multichannel instruments. , 1986, The Journal of the Acoustical Society of America.

[97]  B H Brown,et al.  Vibrotactile and electrotactile perception of time-varying pulse trains. , 1994, The Journal of the Acoustical Society of America.

[98]  David K. McGookin,et al.  Understanding and improving the identification of concurrently presented earcons , 2004 .

[99]  Michiel M. Spapé,et al.  Distilling the underlying dimensions of tactile melodies , 2003 .

[100]  Stephen A. Brewster,et al.  Using nonspeech sounds to provide navigation cues , 1998, TCHI.

[101]  Meera Blattner,et al.  Earcons and Icons: Their Structure and Common Design Principles , 1989, Hum. Comput. Interact..

[102]  Kenneth O. Johnson,et al.  Neural Basis of Haptic Perception , 2002 .

[103]  A. F. Rovers,et al.  FootIO - design and evaluation of a device to enable foot interaction over a computer network , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[104]  R. Cholewiak,et al.  Vibrotactile localization on the abdomen: Effects of place and space , 2004, Perception & psychophysics.

[105]  Angela Chang,et al.  Dimensional Design; Explorations of the Auditory and Haptic Correlate for the Mobile Device , 2005 .

[106]  David A. Ross,et al.  Wearable interfaces for orientation and wayfinding , 2000, Assets '00.

[107]  Carl E. Sherrick,et al.  Apparent haptic movement , 1966 .

[108]  Alan F. Newell,et al.  Extra-ordinary human-computer interaction , 1995 .

[109]  Topi Kaaresoja,et al.  Perception of short tactile pulses generated by a vibration motor in a mobile phone , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[110]  William W. Gaver.  The SonicFinder: An Interface That Uses Auditory Icons , 1989, Hum. Comput. Interact..

[111]  Stephen Brewster,et al.  Designing non-speech sounds to support navigation in mobile phone menus , 2000 .

[112]  J. Phillips,et al.  Neural mechanisms of scanned and stationary touch. , 1985, The Journal of the Acoustical Society of America.

[113]  Stephen Brewster,et al.  A Detailed Investigation into the Effectiveness of Earcons , 1997 .

[114]  F. A. Geldard.  Adventures in tactile literacy. , 1957 .

[115]  M. Sile O'Modhrain,et al.  Web-Based Touch Display for Accessible Science Education , 2000, Haptic Human-Computer Interaction.

[116]  A. A. Collins,et al.  Vibrotactile localization on the arm: Effects of place, space, and age , 2003, Perception & psychophysics.

[117]  Stephen A. Brewster,et al.  The design of sonically-enhanced widgets , 1998, Interact. Comput..

[118]  Stephen A. Brewster,et al.  An Investigation into the Use of Tactons to Present Progress Information , 2005, INTERACT.

[119]  Lorna M. Brown,et al.  Non-visual information display using tactons , 2004, CHI EA '04.

[120]  Ben Shneiderman,et al.  Designing the user interface (videotape) , 1987 .

[121]  Ian Oakley,et al.  Putting the feel in ’look and feel‘ , 2000, CHI.