Using force-feedback devices in educational settings: a short review

In this short review, we aim at providing an update about recent research on force-feedback devices in educational settings, with a particular focus on primary school teaching. This review describes haptic devices and education virtual environments before entering into the details of domain-specific applications of this technology in schools. Currently, the number of studies that investigated the potential of haptic devices in educational settings is limited, in particular for primary schools. The absence of longitudinal studies makes it difficult to reach any strong conclusion about the learning outcomes of this technology. Additional research is needed about how this technology might contribute to teach specific concepts at different ages. In particular, we point out the need to do more research on how to combine haptic feedback with visual and audio information, which seems important both on the basis of the results of previous studies and on recent research in neuroscience demonstrating the importance of multi-modal integration in the cognitive development of children. Demonstrating the potential benefit of haptic devices in a learning environment is also important to create a demand for this technology which might lead to the commercialization of haptic devices with an affordable price for schools.

[1]  Mandayam A. Srinivasan,et al.  The Effect of Auditory Cues on the Haptic Perception of Stiffness in Virtual Environments , 1997, Dynamic Systems and Control.

[2]  Tassos A. Mikropoulos,et al.  Educational virtual environments: A ten-year review of empirical research (1999-2009) , 2011, Comput. Educ..

[3]  Ryan Robidoux,et al.  Investigating the Mathematical Discourse of Young Learners Involved in Multi-Modal Mathematical Investigations: The Case of Haptic Technologies , 2013 .

[4]  J. Dankelman,et al.  Haptics in minimally invasive surgery – a review , 2008, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[5]  Makoto Sato,et al.  A Haptic Virtual Environment for Molecular Chemistry Education , 2008, Trans. Edutainment.

[6]  G. Sandini,et al.  Impairment of auditory spatial localization in congenitally blind human subjects , 2013, Brain : a journal of neurology.

[7]  Insook Han Embodiment: A New Perspective for Evaluating Physicality in Learning , 2013 .

[8]  Lucy Y. Pao,et al.  Synergistic visual/haptic rendering modes for scientific visualization , 2004, IEEE Computer Graphics and Applications.

[9]  Greg Hallman,et al.  Possibilities of Haptic Feedback Simulation for Physics Learning , 2009 .

[10]  M. G. Jones,et al.  Haptics in Education: Exploring an Untapped Sensory Modality , 2006 .

[11]  Allison M. Okamura,et al.  Feeling is Believing: Using a Force‐Feedback Joystick to Teach Dynamic Systems , 2000 .

[12]  J. Wessberg,et al.  The neurophysiology of unmyelinated tactile afferents , 2010, Neuroscience & Biobehavioral Reviews.

[13]  M. Gail Jones,et al.  The impact of haptic augmentation on middle school students’ conceptions of the animal cell , 2006, Virtual Reality.

[14]  David C. Burr,et al.  Young Children Do Not Integrate Visual and Haptic Form Information , 2008, Current Biology.

[15]  G. Sandini,et al.  Poor Haptic Orientation Discrimination in Nonsighted Children May Reflect Disruption of Cross-Sensory Calibration , 2010, Current Biology.

[16]  Andy C. H. Lee,et al.  Visual cues and virtual touch: Role of visual stimuli and intersensory integration in cross-modal haptic illusions and the sense of presence. , 2002 .

[17]  R. Klatzky,et al.  There's more to touch than meets the eye: The salience of object attributes for haptics with and without vision. , 1987 .

[18]  Frederick P. Brooks,et al.  Project GROPEHaptic displays for scientific visualization , 1990, SIGGRAPH.

[19]  S. Balachandran,et al.  Unpacking students' conceptualizations through haptic feedback , 2017, J. Comput. Assist. Learn..

[20]  Margaret Wilson,et al.  Six views of embodied cognition , 2002, Psychonomic bulletin & review.

[21]  Allison M. Okamura,et al.  Getting a Feel for Dynamics: Using Haptic Interface Kits for Teaching Dynamics and Controls , 1997, Dynamic Systems and Control.

[22]  Jean-Luc Velay,et al.  Basic and supplementary sensory feedback in handwriting , 2015, Front. Psychol..

[23]  Anders Ynnerman,et al.  Designing and Evaluating a Haptic System for Biomolecular Education , 2007, 2007 IEEE Virtual Reality Conference.

[24]  John B. Black,et al.  Incorporating haptic feedback in simulation for learning physics , 2011, Comput. Educ..

[25]  Etienne Burdet,et al.  A robotic teacher of Chinese handwriting , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[26]  R. Brent Gillespie,et al.  Haptic interface for hands-on instruction in system dynamics and embedded control , 2003, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings..

[27]  D. Burr,et al.  The Ventriloquist Effect Results from Near-Optimal Bimodal Integration , 2004, Current Biology.

[28]  J. Randall Flanagan,et al.  Coding and use of tactile signals from the fingertips in object manipulation tasks , 2009, Nature Reviews Neuroscience.

[29]  Mark R. Cutkosky,et al.  Reducing error rates with low-cost haptic feedback in virtual reality-based training applications , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[30]  Lucian Panait,et al.  The role of haptic feedback in laparoscopic simulation training. , 2009, The Journal of surgical research.

[31]  Eric N. Wiebe,et al.  Haptic feedback and students' learning about levers: Unraveling the effect of simulated touch , 2009, Comput. Educ..

[32]  Kofi Nyarko,et al.  Network intrusion visualization with NIVA, an intrusion detection visual analyzer with haptic integration , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[33]  Zacharias C. Zacharia,et al.  Examining whether touch sensory feedback is necessary for science learning through experimentation: A literature review of two different lines of research across K-16 , 2015 .

[34]  Allison M. Okamura,et al.  [D81] Hapkit: An open-hardware haptic device for online education , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[35]  Miriam Reiner,et al.  Conceptual Construction of Fields Through Tactile Interface , 1999, Interact. Learn. Environ..

[36]  Zahira Merchant,et al.  Effectiveness of virtual reality-based instruction on students' learning outcomes in K-12 and higher education: A meta-analysis , 2014, Comput. Educ..

[37]  Paul Lemmens,et al.  A body-conforming tactile jacket to enrich movie viewing , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[38]  Konrad J. Schönborn,et al.  Exploring relationships between students' interaction and learning with a haptic virtual biomolecular model , 2011, Comput. Educ..

[39]  L. Niy,et al.  Application of haptic, visual and audio integration in astronomy education , 2006, 2006 IEEE International Workshop on Haptic Audio Visual Environments and their Applications (HAVE 2006).

[40]  Thomas R. Tretter,et al.  Haptic Augmentation of Science Instruction: Does Touch Matter? , 2006 .

[41]  Erica Harvey,et al.  Haptic representation of the atom , 2000, 2000 IEEE Conference on Information Visualization. An International Conference on Computer Visualization and Graphics.

[42]  Marjorie Darrah,et al.  Framework for K-12 education haptic applications , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[43]  Christian Gütl,et al.  Virtual laboratories for education in science, technology, and engineering: A review , 2016, Comput. Educ..

[44]  James Minogue,et al.  Measuring the Impact of Haptic Feedback Using the SOLO Taxonomy , 2009 .

[45]  Wijnand A. IJsselsteijn,et al.  Mediated social touch: a review of current research and future directions , 2006, Virtual Reality.

[46]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[47]  C. Thinus-Blanc,et al.  Representation of space in blind persons: vision as a spatial sense? , 1997, Psychological bulletin.

[48]  M. Gail Jones,et al.  Learning at the nanoscale: The impact of students' use of remote microscopy on concepts of viruses, scale, and microscopy , 2003 .

[49]  Robert L. Williams,et al.  Haptics-Augmented Simple-Machine Educational Tools , 2003 .

[50]  Marjorie Darrah,et al.  Haptics-Based Apps for Middle School Students with Visual Impairments , 2015, IEEE Transactions on Haptics.

[51]  Florence Bara,et al.  A Visuo-Haptic Device - Telemaque - Increases Kindergarten Children's Handwriting Acquisition , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[52]  Monica Gori,et al.  Developing a pedagogical framework for designing a multisensory serious gaming environment , 2017, MIE@ICMI.

[53]  Monica Gori,et al.  WeDRAW: using multisensory serious games to explore concepts in primary mathematics , 2017 .

[54]  Abdulmotaleb El-Saddik,et al.  A haptic multimedia handwriting learning system , 2007, Emme '07.

[55]  Z. Zacharia,et al.  Physical and Virtual Laboratories in Science and Engineering Education , 2013, Science.

[56]  L. Witmer The Montessori Method , 1914, The Psychological clinic.

[57]  David Tall,et al.  Foundations for the Future: The Potential of Multimodal Technologies for Learning Mathematics , 2015 .