Tactile Display Design for Securing Flight and Reducing the Saturation of Pilot's Visual Channel

Visual channel dominates the design of the cockpit, and auditory channel is progressively being used as well. However, tactile displays are almost abstract in the cockpit designs. Whereas, many research proved that several applications exist where the tactile displays may become an important or even essential choice. This is due to the fact that the visual feedback is not suitable, not adequate, or surcharged and that the visual attention is usually limited to a simple entity. In this paper, we propose a design of a low-cost tactile feedback system to provide the pilot with better insight in the flight path and prevent limitations during flight. In the first part of the paper, we develop an effective control strategy based on inverse dynamic to solve the problems of use of the low-cost tactors. The obtained results showed reduction of 48 % in settling time. The second part describes the use of Fuzzy Logic Controllers (FLC) to compute a new form of tactile output of the translation of a pertinent flight data information and flight envelope to vibrotactile feedback signals. And in the last part, we develop a wireless (and USB) vibrotactile feedback device consisting of 16 embedded tactors controlled with an inverse dynamic strategy via an arm Cortex M3 architecture. Pilots equipped with the developed tactile display were capable of successfully flying in a simulator. They confirm that tactile feedback is an interesting way of feeding back information about the airplane’s state, in order to give a better understanding of what the airplane is doing during controlled flight.

[1]  Topi Kaaresoja,et al.  Perception of short tactile pulses generated by a vibration motor in a mobile phone , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[2]  Patrick Langdon,et al.  State-of-the-Art and Future Concepts for Interaction in Aircraft Cockpits , 2015, HCI.

[3]  Angus H. Rupert,et al.  Coalition Warfare Program Tactile Situation Awareness System for Aviation Applications: System Development , 2014 .

[4]  J.B.F. van Erp,et al.  Introduction to tactile displays in military environments , 2008 .

[5]  Robert Babuska,et al.  Perspectives of fuzzy systems and control , 2005, Fuzzy Sets Syst..

[6]  Virginie van Wassenhove,et al.  Minding time in an amodal representational space , 2009 .

[7]  Lorna M. Brown,et al.  A first investigation into the effectiveness of Tactons , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[8]  G. Feng,et al.  A Survey on Analysis and Design of Model-Based Fuzzy Control Systems , 2006, IEEE Transactions on Fuzzy Systems.

[9]  Robert D. Howe,et al.  Mechanical Design and Control of a High-Bandwidth Shape Memory Alloy Tactile Display , 1997, ISER.

[10]  Seungmoon Choi,et al.  Vibrotactile Display: Perception, Technology, and Applications , 2013, Proceedings of the IEEE.

[11]  Lynette A. Jones,et al.  Tactile Displays: Guidance for Their Design and Application , 2008, Hum. Factors.

[12]  Cagatay Basdogan,et al.  Haptic stylus with inertial and vibro-tactile feedback , 2013, 2013 World Haptics Conference (WHC).

[13]  Kyle Renwick,et al.  Effectiveness of Vibration-based Haptic Feedback Effects for 3D Object Manipulation , 2008 .

[14]  Hendrik A. H. C. van Veen,et al.  Waypoint navigation with a vibrotactile waist belt , 2005, TAP.

[15]  Fei Tang,et al.  Development of a low-cost tactile sleeve for autism intervention , 2014, 2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games (HAVE) Proceedings.

[16]  Jan Jantzen,et al.  Tuning Of Fuzzy PID Controllers , 1998 .

[17]  A. A. Collins,et al.  Vibrotactile localization on the arm: Effects of place, space, and age , 2003, Perception & psychophysics.

[18]  Lorna M. Brown,et al.  Feel who's talking: using tactons for mobile phone alerts , 2006, CHI Extended Abstracts.

[19]  Radu-Emil Precup,et al.  A survey on industrial applications of fuzzy control , 2011, Comput. Ind..

[20]  J.B.F. van Erp,et al.  Tactile Torso Display as Countermeasure to Reduce Night Vision Goggles Induced Drift , 2003 .

[21]  Grégory Petit Conception, prototypage et évaluation d’un système pourl'exploration audio-tactile et spatiale de pages web pardes utilisateurs non-voyants , 2013 .

[22]  Tao Jiang,et al.  Generalized defuzzification strategies and their parameter learning procedures , 1996, IEEE Trans. Fuzzy Syst..

[23]  Katherine J. Kuchenbecker,et al.  Spatially distributed tactile feedback for kinesthetic motion guidance , 2010, 2010 IEEE Haptics Symposium.

[24]  Nariman Sepehri,et al.  Fuzzy logic control of a teleoperated log loader machine , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[25]  R. Cholewiak,et al.  Vibrotactile localization on the abdomen: Effects of place and space , 2004, Perception & psychophysics.

[26]  Florian Holzapfel,et al.  On the Solution of Bilevel Optimal Control Problems to Increase the Fairness in Air Races , 2010 .

[27]  B. P. Self,et al.  Chapter 3 – HUMAN FACTORS ISSUES OF TACTILE DISPLAYS FOR MILITARY ENVIRONMENTS , 2008 .

[28]  Peter Hecker,et al.  Tactile Feedback and Situation Awareness - Improving Adherence to an Envelope in Sidestick-Controlled Fly-by-Wire Aircrafts , 2015 .

[29]  Braden J. McGrath,et al.  Tactile Instrument for Aviation , 2000 .

[30]  John Chiasson,et al.  Efficacy of Directional Cues from a Tactile System for Target Orientation in Helicopter Extractions over Moving Targets , 2013 .

[31]  Florian Holzapfel,et al.  Physically Integrated Reference Model and Its Aids in Model Based Flight Control Development , 2014 .

[32]  Hendrik A. H. C. van Veen,et al.  Tactile Information Presentation in the Cockpit , 2000, Haptic Human-Computer Interaction.

[33]  Takuya Nojima,et al.  Cockpit display using tactile sensation , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[34]  Chris Jansen,et al.  FlyTact: A Tactile Display Improves a Helicopter Pilot's Landing Performance in Degraded Visual Environments , 2008, EuroHaptics.

[35]  Yael Salzer,et al.  Evaluation of an “On-Thigh” Vibrotactile Collision Avoidance Alerting Component in a Simulated Flight Mission , 2015, IEEE Transactions on Human-Machine Systems.

[36]  Evangelos Papadopoulos,et al.  Analysis, design and control of a planar micro-robot driven by two centripetal-force actuators , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[37]  Natasha Merat,et al.  Crossmodal links between audition and touch in covert endogenous spatial attention , 2003, Perception & psychophysics.