I can feel it moving: Science Communicators Talking About the Potential of Mid-Air Haptics

We explored the potential of haptics for improving science communication, and recognized that mid-air haptic interaction supports public engagement with science in three relevant themes. While science instruction often focuses on the cognitive domain of acquiring new knowledge, in science communication the primary goal is to produce personal responses, such as awareness, enjoyment, or interest in science. Science communicators seek novel ways of communicating with the public, often using new technologies to produce personal responses. Thus, we explored how mid-air haptics technology could play a role in communicating scientific concepts. We prototyped six mid-air haptic probes for three thematic areas: particle physics, quantum mechanics, cell biology; and conducted three qualitative focus group sessions with domain expert science communicators. Participants highlighted values of the dynamic features of mid-air haptics, its ability to produce shared experiences, and its flexibility in communicating scientific concepts through metaphors and stories. We discuss how mid-air haptics can complement existing approaches of science communication, for example multimedia experiences or live exhibits by helping to create enjoyment or interest, generalized to any fields of science.

[1]  R. Trotta,et al.  Communicating cosmology with multisensory metaphorical experiences , 2020 .

[2]  Marianna Obrist,et al.  Improving Immersive Experiences for Visitors with Sensory Impairments to the Aquarium of the Pacific , 2020, CHI Extended Abstracts.

[3]  Lloyd S. Davis,et al.  Storytelling: the soul of science communication , 2019, Journal of Science Communication.

[4]  Marianna Obrist,et al.  Creating an Illusion of Movement between the Hands Using Mid-Air Touch , 2019, IEEE Transactions on Haptics.

[5]  Elia Gatti,et al.  I'm Sensing in the Rain: Spatial Incongruity in Visual-Tactile Mid-Air Stimulation Can Elicit Ownership in VR Users , 2019, CHI.

[6]  Sriram Subramanian,et al.  Using Spatiotemporal Modulation to Draw Tactile Patterns in Mid-Air , 2018, EuroHaptics.

[7]  Saul Greenberg,et al.  Evaluation Strategies for HCI Toolkit Research , 2018, CHI.

[8]  Orestis Georgiou,et al.  Touchless Haptic Feedback for VR Rhythm Games , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[9]  Karen L. Masters,et al.  Tactile Universe makes outreach feel good , 2018 .

[10]  Chi Thanh Vi,et al.  Not just seeing, but also feeling art: Mid-air haptic experiences integrated in a multisensory art exhibition , 2017, Int. J. Hum. Comput. Stud..

[11]  Karon E. MacLean,et al.  The Haptic Bridge: Towards a Theory for Haptic-Supported Learning , 2017, IDC.

[12]  Carlos Velasco,et al.  Integrating Mid-Air Haptics into Movie Experiences , 2017, TVX.

[13]  Martin Hachet,et al.  HOBIT: Hybrid Optical Bench for Innovative Teaching , 2017, CHI.

[14]  David Borland,et al.  Tracing the Development of a Haptically-enhanced Simulation for Teaching Phase Change , 2016, CHI PLAY.

[15]  D. L. Clements,et al.  Cosmic sculpture: a new way to visualise the cosmic microwave background , 2016, 1610.00501.

[16]  Kenneth R. Koedinger,et al.  Adding Physical Objects to an Interactive Game Improves Learning and Enjoyment , 2016, ACM Trans. Comput. Hum. Interact..

[17]  Karon E. MacLean,et al.  HandsOn: Enabling Embodied, Creative STEM e-learning with Programming-Free Force Feedback , 2016, EuroHaptics.

[18]  Abigail A. Haydon,et al.  Using metaphor to translate the science of resilience and developmental outcomes , 2016, Public understanding of science.

[19]  Allison M. Okamura,et al.  3-D printed haptic devices for educational applications , 2016, 2016 IEEE Haptics Symposium (HAPTICS).

[20]  József Kövecses,et al.  Toward open-source portable haptic displays with visual-force-tactile feedback colocation , 2016, 2016 IEEE Haptics Symposium (HAPTICS).

[21]  Eric Paulos,et al.  HapticPrint: Designing Feel Aesthetics for Digital Fabrication , 2015, UIST.

[22]  Zacharias C. Zacharia,et al.  Examining whether touch sensory feedback is necessary for science learning through experimentation: A literature review of two different lines of research across K-16 , 2015 .

[23]  Karon E. MacLean,et al.  VibViz: Organizing, visualizing and navigating vibration libraries , 2015, 2015 IEEE World Haptics Conference (WHC).

[24]  Faisal Taher,et al.  Exploring Interactions with Physically Dynamic Bar Charts , 2015, CHI.

[25]  Ali Israr,et al.  FeelSleeve: Haptic Feedback to Enhance Early Reading , 2015, CHI.

[26]  Sriram Subramanian,et al.  Emotions Mediated Through Mid-Air Haptics , 2015, CHI.

[27]  Sriram Subramanian,et al.  Rendering volumetric haptic shapes in mid-air using ultrasound , 2014, ACM Trans. Graph..

[28]  David Borland,et al.  ASPECT sinking and floating: an interactive playable simulation for teaching buoyancy concepts , 2014, CHI PLAY.

[29]  Michael F. Dahlstrom Using narratives and storytelling to communicate science with nonexpert audiences , 2014, Proceedings of the National Academy of Sciences.

[30]  Sriram Subramanian,et al.  Correspondence: Dexterous ultrasonic levitation of millimeter-sized objects in air , 2014, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[31]  Simon Stusak,et al.  Beyond physical bar charts: an exploration of designing physical visualizations , 2014, CHI Extended Abstracts.

[32]  Sriram Subramanian,et al.  Perception of ultrasonic haptic feedback on the hand: localisation and apparent motion , 2014, CHI.

[33]  Marcia Kilchenman O'Malley,et al.  Design and characterization of a haptic paddle for dynamics education , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[34]  Young J. Kim,et al.  Interactive generalized penetration depth computation for rigid and articulated models using object norm , 2014, ACM Trans. Graph..

[35]  Sriram Subramanian,et al.  UltraHaptics: multi-point mid-air haptic feedback for touch surfaces , 2013, UIST.

[36]  Hiroshi Ishii,et al.  inFORM: dynamic physical affordances and constraints through shape and object actuation , 2013, UIST.

[37]  Sriram Subramanian,et al.  Talking about tactile experiences , 2013, CHI.

[38]  E. Green,et al.  Man-made black holes and Big Bangs: Diffusion and integration of scientific information into everyday thinking , 2013, Public understanding of science.

[39]  Sriram Subramanian,et al.  Adding haptic feedback to mobile tv , 2011, CHI Extended Abstracts.

[40]  R. Klatzky,et al.  Haptic perception: A tutorial , 2009, Attention, perception & psychophysics.

[41]  G. W. Saunders,et al.  Using stories in an introductory college biology course , 2008 .

[42]  Hiroyuki Shinoda,et al.  Non-contact Method for Producing Tactile Sensation Using Airborne Ultrasound , 2008, EuroHaptics.

[43]  M. Gail Jones,et al.  Visualizing Without Vision at the Microscale: Students With Visual Impairments Explore Cells With Touch , 2006 .

[44]  M. Rowe,et al.  Vibrotactile frequency discrimination in human hairy skin. , 2006, Journal of neurophysiology.

[45]  V. Braun,et al.  Using thematic analysis in psychology , 2006 .

[46]  Nicolas Guéguen,et al.  Nonverbal Encouragement of Participation in a Course: the Effect of Touching , 2004 .

[47]  Susan Stocklmayer,et al.  Science Communication: A Contemporary Definition , 2003 .

[48]  M. Gail Jones,et al.  Learning at the nanoscale: The impact of students' use of remote microscopy on concepts of viruses, scale, and microscopy , 2003 .

[49]  T Rahola,et al.  Chernobyl fallout and outcome of pregnancy in Finland. , 2001, Environmental health perspectives.

[50]  Allison M. Okamura,et al.  Getting a Feel for Dynamics: Using Haptic Interface Kits for Teaching Dynamics and Controls , 1997, Dynamic Systems and Control.

[51]  G. Domenighetti,et al.  The Chernobyl accident and induced abortions: only one-way information. , 1990, Scandinavian journal of work, environment & health.

[52]  F. A. Geldard,et al.  The Cutaneous "Rabbit": A Perceptual Illusion , 1972, Science.

[53]  Benjamin S. Bloom,et al.  Taxonomy of Educational Objectives: The Classification of Educational Goals. , 1957 .

[54]  Thomas R. Tretter,et al.  Haptic Augmentation of Science Instruction: Does Touch Matter? , 2006 .

[55]  C. Wieman Interactive simulations for science and math , 2002 .