Tactile Display Design for Flight Envelope Protection and Situational Awareness

Spatial disorientation and visual channel saturation are defined as critical situations encountered by military pilots. Such subjects are interesting research areas likely to create innovative systems able to surmount obstacles of this kind. The integration of new stimulation techniques (sensory substitute, adjunct for visual and audio feedback) may be considered to make the visual channel better. This contribution may help in integrating tactile stimulation to improve or substitute the visual channel. It may also help to better interpret the spatial disorientation awareness signals and the vestibulo-ocular response limitations. The innovation of the proposed approach translates in: (i) the development of the PI-Inverse dynamics controller to provide a time delay reduction of the low cost tactile actuator, and thus, high-performance tactile system; (ii) an approach based on fuzzy logic controller (FLC) is being used in order to translate the turn rate angle, the flight path climb angle and the warning messages into tactile signal features instead of a conventional approach based on direct coding of the pitch and bank angles; and (iii) the consideration of the flight envelope. The fuzzy set translation of flight parameters into tactile signals is also a pragmatic and useful way to design the system.

[1]  Florian Holzapfel,et al.  On the Solution of Bilevel Optimal Control Problems to Increase the Fairness in Air Races , 2010 .

[2]  Michael Rohs,et al.  Increasing Presence in Virtual Reality with a Vibrotactile Grid Around the Head , 2017, INTERACT.

[3]  B. P. Self,et al.  Chapter 3 – HUMAN FACTORS ISSUES OF TACTILE DISPLAYS FOR MILITARY ENVIRONMENTS , 2008 .

[4]  Daniela Rus,et al.  Safe Local Navigation for Visually Impaired Users With a Time-of-Flight and Haptic Feedback Device , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[5]  Topi Kaaresoja,et al.  Perception of short tactile pulses generated by a vibration motor in a mobile phone , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[6]  Radu-Emil Precup,et al.  A survey on industrial applications of fuzzy control , 2011, Comput. Ind..

[7]  Peter Hecker,et al.  Tactile Feedback and Situation Awareness - Improving Adherence to an Envelope in Sidestick-Controlled Fly-by-Wire Aircrafts , 2015 .

[8]  Hendrik A. H. C. van Veen,et al.  Tactile Information Presentation in the Cockpit , 2000, Haptic Human-Computer Interaction.

[9]  Thomas Hulin,et al.  Evaluation of a vibrotactile feedback device for spatial guidance , 2011, 2011 IEEE World Haptics Conference.

[10]  F. Fisch Development of a Framework for the Solution of High-Fidelity Trajectory Optimization Problems and Bilevel Optimal Control Problems , 2011 .

[11]  J.B.F. van Erp,et al.  Tactile Torso Display as Countermeasure to Reduce Night Vision Goggles Induced Drift , 2003 .

[12]  G. Labiale,et al.  In-Car Road Information: Comparisons of Auditory and Visual Presentations , 1990 .

[13]  Grégory Petit Conception, prototypage et évaluation d’un système pourl'exploration audio-tactile et spatiale de pages web pardes utilisateurs non-voyants , 2013 .

[14]  Markus Funk,et al.  Tactile Drones - Providing Immersive Tactile Feedback in Virtual Reality through Quadcopters , 2017, CHI Extended Abstracts.

[15]  Chris Jansen,et al.  FlyTact: A Tactile Display Improves a Helicopter Pilot's Landing Performance in Degraded Visual Environments , 2008, EuroHaptics.

[16]  R. Cholewiak,et al.  Vibrotactile localization on the abdomen: Effects of place and space , 2004, Perception & psychophysics.

[17]  Christopher D. Wickens,et al.  Multimodal Information Presentation in Support of NextGen Operations , 2017 .

[18]  Tao Jiang,et al.  Generalized defuzzification strategies and their parameter learning procedures , 1996, IEEE Trans. Fuzzy Syst..

[19]  Catherine Neubauer How Close Is Close Enough? A Multimodal Analysis of Temporal Matching Between Visual and Tactile Signaling , 2017 .

[20]  J.B.F. van Erp,et al.  A multi-purpose tactile vest for astronauts in the international space station , 2003 .

[21]  Linda R. Elliott,et al.  Identifying Errors in Tactile Displays and Best Practice Usage Guidelines , 2017 .

[22]  Yael Salzer,et al.  Evaluation of an “On-Thigh” Vibrotactile Collision Avoidance Alerting Component in a Simulated Flight Mission , 2015, IEEE Transactions on Human-Machine Systems.

[23]  Fei Tang,et al.  Development of a low-cost tactile sleeve for autism intervention , 2014, 2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games (HAVE) Proceedings.

[24]  Nariman Sepehri,et al.  Fuzzy logic control of a teleoperated log loader machine , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[25]  Max Mulder,et al.  Design of a Haptic Feedback System for Flight Envelope Protection , 2018 .

[26]  G. Feng,et al.  A Survey on Analysis and Design of Model-Based Fuzzy Control Systems , 2006, IEEE Transactions on Fuzzy Systems.

[27]  Arianna Menciassi,et al.  Neuromorphic Vibrotactile Stimulation of Fingertips for Encoding Object Stiffness in Telepresence Sensory Substitution and Augmentation Applications , 2018, Sensors.

[28]  Mohamed Guiatni,et al.  Tactile Display Design for Securing Flight and Reducing the Saturation of Pilot's Visual Channel , 2016, ICINCO.

[29]  Lorna M. Brown,et al.  Feel who's talking: using tactons for mobile phone alerts , 2006, CHI Extended Abstracts.

[30]  Martin Pielot,et al.  Tactile Wayfinder: Comparison of Tactile Waypoint Navigation with Commercial Pedestrian Navigation Systems , 2010, Pervasive.

[31]  Y C Liu,et al.  Comparative study of the effects of auditory, visual and multimodality displays on drivers' performance in advanced traveller information systems , 2001, Ergonomics.

[32]  Edwige E. Pissaloux,et al.  Constructing Tactile Languages for Situational Awareness Assistance of Visually Impaired People , 2018 .

[33]  Evangelos Papadopoulos,et al.  Analysis, design and control of a planar micro-robot driven by two centripetal-force actuators , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[34]  Natasha Merat,et al.  Crossmodal links between audition and touch in covert endogenous spatial attention , 2003, Perception & psychophysics.

[35]  Lynette A. Jones,et al.  Tactile Displays: Guidance for Their Design and Application , 2008, Hum. Factors.

[36]  Mohamed Guiatni,et al.  Fuzzy-PID side-stick force control for flight simulation , 2016 .

[37]  Kyle Renwick,et al.  Effectiveness of Vibration-based Haptic Feedback Effects for 3D Object Manipulation , 2008 .

[38]  Angus H. Rupert,et al.  Integrating DVE, cueing technologies, and pilot performance metrics into a research grade helicopter simulator , 2017, Defense + Security.

[39]  James R Marston,et al.  An n-back task using vibrotactile stimulation with comparison to an auditory analogue , 2008, Behavior research methods.

[40]  Ying Zhang,et al.  An Indoor Navigation Service Robot System Based on Vibration Tactile Feedback , 2017, Int. J. Soc. Robotics.

[41]  Robert Hardy,et al.  NaviRadar: a novel tactile information display for pedestrian navigation , 2011, UIST.

[42]  J.B.F. van Erp Tactile displays for navigation and orientation : perception and behaviour , 2007 .

[43]  Linda R. Elliott,et al.  Can You Feel Me Now? Wearable Concept for Soldier Communications , 2017 .

[44]  Andrew Rutherford,et al.  Introducing Anova and Ancova: A Glm Approach , 2000 .

[45]  Robert Babuska,et al.  Perspectives of fuzzy systems and control , 2005, Fuzzy Sets Syst..

[46]  Virginie van Wassenhove,et al.  Minding time in an amodal representational space , 2009 .

[47]  Ravi Kuber,et al.  Developing a head-mounted tactile prototype to support situational awareness , 2018, Int. J. Hum. Comput. Stud..

[48]  Sethuraman Panchanathan,et al.  Design, Implementation, and Case Study of a Pragmatic Vibrotactile Belt , 2011, IEEE Transactions on Instrumentation and Measurement.

[49]  Braden J. McGrath,et al.  Tactile Instrument for Aviation , 2000 .

[50]  John Chiasson,et al.  Efficacy of Directional Cues from a Tactile System for Target Orientation in Helicopter Extractions over Moving Targets , 2013 .

[51]  Tiziano Bernard,et al.  Haptic Feedback Astronaut Suit for Mitigating Extra-Vehicular Activity Spatial Disorientation , 2017 .

[52]  Florian Holzapfel,et al.  Physically Integrated Reference Model and Its Aids in Model Based Flight Control Development , 2014 .

[53]  Angus H. Rupert,et al.  Coalition Warfare Program Tactile Situation Awareness System for Aviation Applications: System Development , 2014 .

[54]  A H Rupert An instrumentation solution for reducing spatial disorientation mishaps. , 2000, IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society.

[55]  J.B.F. van Erp,et al.  Introduction to tactile displays in military environments , 2008 .

[56]  Juan Wu,et al.  Vibrotactile Display of Flight Attitude with Combination of Multiple Coding Parameters , 2017 .

[57]  Nadine Sarter,et al.  Visual and auditory feedback to improve touchscreen usability in turbulence , 2017 .

[58]  Seungmoon Choi,et al.  Vibrotactile Display: Perception, Technology, and Applications , 2013, Proceedings of the IEEE.

[59]  Hong Z. Tan,et al.  Using spatial vibrotactile cues to direct visual attention in driving scenes , 2005 .

[60]  Cagatay Basdogan,et al.  Haptic stylus with inertial and vibro-tactile feedback , 2013, 2013 World Haptics Conference (WHC).

[61]  Robert D. Howe,et al.  Mechanical Design and Control of a High-Bandwidth Shape Memory Alloy Tactile Display , 1997, ISER.

[62]  Lorna M. Brown,et al.  Tactons: Structured Tactile Messages for Non-Visual Information Display , 2004, AUIC.