Real-Time Multibody Model-Based Heads-Up Display Unit of a Tractor

The concept of heads-up display can be used to provide augmented information onto the windshield of a tractor. The objective of this paper is to introduce a detailed real-time multibody model that is used in the design of a novel heads-up display unit of a tractor. To this end, a tractor is described using a multibody dynamics approach. A heads-up display unit is designed using a series of tasks that are associated with sets of logical conditions and instructions. These conditions and instructions, in turn, determine/design the analog and digital gauges. The gauges are linked with the virtual sensors installed at a number of locations on the tractor. In this study, the heads-up display unit includes elements, such as tachometer, speedometer, roll inclinometer, gear indicator, fuel gauge, and bucket height, tilt, and weight indicators. The effectiveness of the heads-up display unit is determined based on a goal of moving a certain amount of sand from one place to another. The results demonstrate the utility of the heads-up display unit.

[1]  Alistair Sutcliffe,et al.  Simulation-based evaluation of an in-vehicle smart situation awareness enhancement system , 2018, Ergonomics.

[2]  M. Weihrauch,et al.  THE FIRST HEAD UP DISPLAY INTRODUCED BY GENERAL MOTORS , 1989 .

[3]  Aki Mikkola,et al.  Comparing double-step and penalty-based semirecursive formulations for hydraulically actuated multibody systems in a monolithic approach , 2021, Multibody System Dynamics.

[4]  M. J. Vilenius,et al.  Flexible Semi-Empirical Models for Hydraulic Flow Control Valves , 1991 .

[5]  Yansong He,et al.  The validation of a semi-recursive vehicle dynamics model for a real-time simulation , 2020 .

[6]  Yang Liu,et al.  A Real-Time Three-Dimensional Tracking and Registration Method in the AR-HUD System , 2018, IEEE Access.

[7]  Daniel Dopico,et al.  A Combined Penalty and Recursive Real-Time Formulation for Multibody Dynamics , 2004 .

[8]  N J Ward,et al.  Head-up displays and their automotive application: an overview of human factors issues affecting safety. , 1994, Accident; analysis and prevention.

[9]  R J Sojourner,et al.  The Effects of a Simulated Head-Up Display Speedometer on Perceptual Task Performance , 1990, Human factors.

[10]  Daniel Dopico,et al.  Dealing with multiple contacts in a human-in-the-loop application , 2011 .

[11]  Wei Dai,et al.  Iterative refinement algorithm for efficient velocities and accelerations solutions in closed-loop multibody dynamics , 2021 .

[12]  Guoyuan Wu,et al.  Driver Behavior Modeling Using Game Engine and Real Vehicle: A Learning-Based Approach , 2020, IEEE Transactions on Intelligent Vehicles.

[13]  Teruhisa Misu,et al.  Effects of "Real-World" Visual Fidelity on AR Interface Assessment: A Case Study Using AR Head-up Display Graphics in Driving , 2019, 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[14]  Woojin Park,et al.  Perceived Importance of Automotive HUD Information Items: a Study With Experienced HUD Users , 2018, IEEE Access.

[15]  D. Dopico,et al.  Penalty, Semi-Recursive and Hybrid Methods for MBS Real-Time Dynamics in the Context of Structural Integrators , 2004 .

[16]  Yu Wang,et al.  User-defined gesture interaction for in-vehicle information systems , 2019, Multimedia Tools and Applications.

[17]  Yu Zhang,et al.  Research on Interface Design of Full Windshield Head-Up Display Based on User Experience , 2018, Advances in Usability, User Experience and Assistive Technology.

[18]  Thomas K. Ferris,et al.  Driving While Interacting With Google Glass: Investigating the Combined Effect of Head-Up Display and Hands-Free Input on Driving Safety and Multitask Performance , 2017, Hum. Factors.

[19]  H. Nijmeijer,et al.  New directions in nonlinear observer design , 1999 .

[20]  Monica Bordegoni,et al.  Evaluation of hydraulic excavator Human–Machine Interface concepts using NASA TLX , 2014 .

[21]  Ming-Hui Wen,et al.  Comparison of head-up display (HUD) vs. head-down display (HDD): driving performance of commercial vehicle operators in Taiwan , 2004, Int. J. Hum. Comput. Stud..

[22]  Jane Wilhelms,et al.  Collision Detection and Response for Computer Animation , 1988, SIGGRAPH.

[23]  Andreas Butz,et al.  Augmenting the Driver's View with Peripheral Information on a Windshield Display , 2015, IUI.

[24]  David K. Harrison,et al.  Prototype gesture recognition interface for vehicular head-up display system , 2018, 2018 IEEE International Conference on Consumer Electronics (ICCE).

[25]  Daniel Dopico,et al.  State and force observers based on multibody models and the indirect Kalman filter , 2018, Mechanical Systems and Signal Processing.

[26]  S N Roscoe,et al.  Eye accommodation to head-up virtual images. , 1988, Human factors.

[27]  Aki Mikkola,et al.  An Efficient High-Order Time-Step Algorithm With Proportional-Integral Control Strategy for Semirecursive Vehicle Dynamics , 2019, IEEE Access.

[28]  Annie Pauzié.  Head Up Display in Automotive: A New Reality for the Driver , 2015, HCI.

[29]  Jussi Sopanen,et al.  Deformable Terrain Model for the Real-Time Multibody Simulation of a Tractor With a Hydraulically Driven Front-Loader , 2019, IEEE Access.

[30]  Yung-ching Liu.  Effects of using head-up display in automobile context on attention demand and driving performance , 2003 .

[31]  J. G. Jalón,et al.  A simple and highly parallelizable method for real-time dynamic simulation based on velocity transformations , 1993 .

[32]  Teruhisa Misu,et al.  Augmented Reality Interface Design Approaches for Goal-directed and Stimulus-driven Driving Tasks , 2018, IEEE Transactions on Visualization and Computer Graphics.

[33]  Yi Wang,et al.  Guidance-oriented advanced curve speed warning system in a connected vehicle environment. , 2020, Accident; analysis and prevention.

[35]  Evan Drumwright,et al.  A Fast and Stable Penalty Method for Rigid Body Simulation , 2008, IEEE Transactions on Visualization and Computer Graphics.

[36]  Lea Hannola,et al.  Gamification Procedure Based on Real-Time Multibody Simulation , 2018, International Review on Modelling and Simulations (IREMOS).

[37]  David K. Harrison,et al.  Reducing Driver Distraction by Utilizing Augmented Reality Head-Up Display System for Rear Passengers , 2019, 2019 IEEE International Conference on Consumer Electronics (ICCE).

[38]  A. Mikkola,et al.  Gamification and the marketing of agricultural machinery , 2021, Real-time Simulation for Sustainable Production.

[39]  Anind K. Dey,et al.  Simulated augmented reality windshield display as a cognitive mapping aid for elder driver navigation , 2009, CHI.

[40]  Cheryl Z. Qian,et al.  Effects of perception of head-up display on the driving safety of experienced and inexperienced drivers , 2020, Displays.

[41]  Jin-Hee Lee,et al.  Simulation framework for improved UI/UX of AR-HUD display , 2018, 2018 IEEE International Conference on Consumer Electronics (ICCE).

[42]  Asko Rouvinen,et al.  Real-time multibody application for tree harvester truck simulator , 2014 .

[43]  Aurelio Soma,et al.  Multibody simulation of a tracked vehicle with deformable ground contact model , 2018, Proceedings of the Institution of Mechanical Engineers, Part K: Journal of Multi-body Dynamics.

[44]  Jun Ma,et al.  Assessing the driving distraction effect of vehicle HMI displays using data mining techniques , 2020 .

[45]  Aki Mikkola,et al.  Efficiency comparison of various friction models of a hydraulic cylinder in the framework of multibody system dynamics , 2021, Nonlinear Dynamics.

[46]  Emilio Sanjurjo,et al.  Online Kinematic and Dynamic-State Estimation for Constrained Multibody Systems Based on IMUs , 2016, Sensors.

[47]  Dinesh Manocha,et al.  OBBTree: a hierarchical structure for rapid interference detection , 1996, SIGGRAPH.

[48]  David K. Harrison,et al.  Mitigating Driver's Distraction: Automotive Head-Up Display and Gesture Recognition System , 2019, IEEE Consumer Electronics Magazine.

[49]  C. Canudas de Wit,et al.  Dynamic tire friction models for vehicle traction control , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[50]  Javier García de Jalón,et al.  Kinematic and Dynamic Simulation of Multibody Systems: The Real Time Challenge , 1994 .

[51]  Stylianos Papanastasiou,et al.  Human–machine collaboration through vehicle head up display interface , 2010, Cognition, Technology & Work.

[52]  Paul A. Grygier,et al.  Vehicle dynamics modelling for the National Advanced Driving Simulator , 2002 .

[53]  Xiaoping Pang,et al.  Comprehensive theoretical digging performance analysis for hydraulic excavator using convex polytope method , 2019 .

[54]  Daniel R. Tufano,et al.  Automotive HUDs: The Overlooked Safety Issues , 1997, Hum. Factors.

[55]  John Watton.  Fluid Power Systems: Modeling, Simulation, Analog and Microcomputer Control , 1989 .

[56]  Paolo Montuschi,et al.  Building Trust in Autonomous Vehicles: Role of Virtual Reality Driving Simulators in HMI Design , 2019, IEEE Transactions on Vehicular Technology.

[57]  Vassilis Charissis,et al.  Employing Emerging Technologies to Develop and Evaluate In-Vehicle Intelligent Systems for Driver Support: Infotainment AR HUD Case Study , 2021, Applied Sciences.

[58]  Juneyoung Park,et al.  Effects of crash warning systems on rear-end crash avoidance behavior under fog conditions , 2018, Transportation Research Part C: Emerging Technologies.

[59]  M. A. Serna,et al.  A modified Lagrangian formulation for the dynamic analysis of constrained mechanical systems , 1988 .

[60]  Mohan M. Trivedi,et al.  A Novel Active Heads-Up Display for Driver Assistance , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[61]  Marcel Bauer,et al.  Multibody Systems Approach To Vehicle Dynamics , 2016 .