Haptics for Product Design and Manufacturing Simulation

Product design and manufacturing simulation is a promising research and application area for haptics. By benefiting from its natural human-computer interaction and realistic force/torque feedback, haptics can change the traditional design and manufacturing approaches which are mainly based on physical mock-ups or CAD (Computer Aided Design) modes. This paper provides a detailed and comprehensive survey of haptics for product design and manufacturing simulation in the past 10 years, mainly from 2004-2014, including haptics for product design and shape modelling, haptics for machining simulation, and haptics for virtual assembly and maintenance simulation. The new haptic devices and rendering algorithms involved in this area are introduced, the major research efforts and the typical systems are discussed, and the new ideas and research progresses are investigated. Then, conclusions and future trends are summarized.

[1]  James Millar Ritchie,et al.  The development of an integrated haptic VR machining environment for the automatic generation of process plans , 2013, Comput. Ind..

[2]  Wei Du,et al.  Force Feedback Rendering with Material Removal Rate in Virtual Clay Modeling , 2009, 2009 Second International Conference on Intelligent Computation Technology and Automation.

[3]  Angel Rubio,et al.  Decreasing the Apparent Inertia of an Impedance Haptic Device by Using Force Feedforward , 2009, IEEE Transactions on Control Systems Technology.

[4]  Diego Borro,et al.  A large haptic device for aircraft engine maintainability , 2004, IEEE Computer Graphics and Applications.

[5]  Cagatay Basdogan,et al.  Haptic Rendering in Virtual Environments , 2002 .

[6]  Mikel Sagardia,et al.  An interactive virtual reality system for on-orbit servicing , 2013, 2013 IEEE Virtual Reality (VR).

[7]  Andrea F. Abate,et al.  A haptic-based approach to virtual training for aerospace industry , 2009, J. Vis. Lang. Comput..

[8]  Zhan Gao,et al.  Haptic perception evaluation for the virtual prototyping of elastic hand-held product designs , 2012 .

[9]  Monica Bordegoni,et al.  Geodesic Spline Interface for Haptic Curve Rendering , 2011, IEEE Transactions on Haptics.

[10]  Yonghua Chen,et al.  On the development of a haptic system for rapid product development , 2005, Comput. Aided Des..

[11]  Monica Bordegoni,et al.  An haptic-based immersive environment for shape analysis and modelling , 2009, Journal of Real-Time Image Processing.

[12]  Gunther Reinhart,et al.  An investigation of haptic feedback effects in telepresent microassembly , 2011, Prod. Eng..

[13]  Judy M. Vance,et al.  Combining Geometric Constraints With Physics Modeling for Virtual Assembly Using SHARP , 2007 .

[14]  Umberto Cugini,et al.  Touch and design: novel haptic interfaces for the generation of high quality surfaces for industrial design , 2007, The Visual Computer.

[15]  Yoshitaka Adachi,et al.  Generation of collision-free 5-axis tool paths using a haptic surface , 2002, Comput. Aided Des..

[16]  Monica Bordegoni,et al.  Use of interactive Virtual Prototypes to define product design specifications: A pilot study on consumer products , 2011, 2011 IEEE International Symposium on VR Innovation.

[17]  Samir Garbaya,et al.  Modeling Dynamic Behavior of Parts in Virtual Assembly Environment , 2009 .

[18]  Jungwon Yoon,et al.  Full length Article: Assembly simulations in virtual environments with optimized haptic path and sequence , 2011 .

[19]  Johan Wagemans,et al.  Visual aesthetics: Relevant measures and their dependence on object class , 2010 .

[20]  Judy M. Vance,et al.  Assessment of haptics-based interaction for assembly tasks in virtual reality , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[21]  António M. Lopes,et al.  Design and implementation of a haptic‐based virtual assembly system , 2011 .

[22]  Hong Qin,et al.  Haptics-based dynamic implicit solid modeling , 2004, IEEE Transactions on Visualization and Computer Graphics.

[23]  Stefan Seipel,et al.  SplineGrip: an eight degrees-of-freedom flexible haptic sculpting tool , 2013, SIGGRAPH '13.

[24]  Judy M. Vance,et al.  Collision Detection and Part Interaction Modeling to Facilitate Immersive Virtual Assembly Methods , 2004, J. Comput. Inf. Sci. Eng..

[25]  Judy M. Vance,et al.  Desktop haptic virtual assembly using physically based modelling , 2007, Virtual Reality.

[26]  George K. Knopf,et al.  Efficient algorithm to detect collision between deformable B-spline surfaces for virtual sculpting , 2008, Comput. Aided Des..

[27]  Umberto Cugini,et al.  Desktop haptic Strip for exploration of virtual objects , 2011, 2011 IEEE Symposium on 3D User Interfaces (3DUI).

[28]  Zhengyi Yang,et al.  Haptic rendering of milling , 2003 .

[29]  Zhengyi Yang,et al.  Haptic modeling as an integrating tool for product development , 2003 .

[30]  Yonghua Chen,et al.  Haptic function evaluation of multi-material part design , 2005, Comput. Aided Des..

[31]  Doru Talaba,et al.  Virtual prototyping of a car turn-signal switch using haptic feedback , 2009, Engineering with Computers.

[32]  Judy M. Vance,et al.  Interacting With a Large Virtual Environment by Combining a Ground-Based Haptic Device and a Mobile Robot Base , 2013 .

[33]  Abhishek Seth,et al.  , PA DETC 06 / CIE-99476 SHARP : A SYSTEM FOR HAPTIC ASSEMBLY & REALISTIC PROTOTYPING , 2006 .

[34]  Monica Bordegoni,et al.  A method for capturing and translating qualitative user experience into design specifications: the haptic feedback of appliance interfaces , 2013 .

[35]  Yuru Zhang,et al.  A NOVEL HAPTIC RENDERING ALGORITHM FOR STABLE AND PRECISE 6-DOF VIRTUAL ASSEMBLY , 2010 .

[36]  Alejandro García-Alonso,et al.  Simultaneous remote haptic collaboration for assembling tasks , 2007, Multimedia Systems.

[37]  Theodore Lim,et al.  A new methodology to evaluate the performance of physics simulation engines in haptic virtual assembly , 2014 .

[38]  Maud Marchal,et al.  Toward Adaptive VR Simulators Combining Visual, Haptic, and Brain-Computer Interfaces , 2013, IEEE Computer Graphics and Applications.

[39]  P. Desmet,et al.  Framework of product experience , 2007 .

[40]  Frans C. T. van der Helm,et al.  The Impact of Haptic Feedback Quality on the Performance of Teleoperated Assembly Tasks , 2013, IEEE Transactions on Haptics.

[41]  Monica Bordegoni,et al.  Digitalizing and capturing haptic feedback in virtual prototypes for User Experience design , 2013, 2013 18th International Conference on Digital Signal Processing (DSP).

[42]  Xin Zhang,et al.  Configuration-Based Optimization for Six Degree-of-Freedom Haptic Rendering for Fine Manipulation , 2011, IEEE Transactions on Haptics.

[43]  Yonghua Chen,et al.  Haptic rendering: An approach to tactile property perception in early product design , 2005 .

[44]  Xun Xu,et al.  Review: Virtual machine tools and virtual machining-A technological review , 2011 .

[45]  Yuan-Shin Lee,et al.  Networked Collaborative Design and Control for Collaborative Product Development Using Haptic Interface , 2012 .

[46]  Georges Dumont,et al.  Interactive simulation of CAD models assemblies using virtual constraint guidance , 2010 .

[47]  Yonghua Chen,et al.  A reverse engineering method based on haptic volume removing , 2005, Comput. Aided Des..

[48]  Monica Bordegoni,et al.  Design of a Desktop Haptic System driven by CAD and Multi-body Systems Associativity , 2014 .

[49]  Florian Gosselin,et al.  Widening 6-DOF haptic devices workspace with an additional degree of freedom , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[50]  Michitaka Hirose,et al.  HapticGEAR: the development of a wearable force display system for immersive projection displays , 2001, Proceedings IEEE Virtual Reality 2001.

[51]  Teresa Gutiérrez,et al.  IMA-VR: A multimodal virtual training system for skills transfer in Industrial Maintenance and Assembly tasks , 2010, 19th International Symposium in Robot and Human Interactive Communication.

[52]  Alberto Lozano-Rodero,et al.  Natural and hybrid bimanual interaction for virtual assembly tasks , 2013, Virtual Reality.

[53]  Dorin M. Popovici,et al.  Comparative Study of APIs and Frameworks for Haptic Application Development , 2012, 2012 International Conference on Cyberworlds.

[54]  Jungwon Yoon,et al.  An enhanced haptic assembly simulation system for the efficiency of assembly tasks , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[55]  Umberto Cugini,et al.  Requirements for an enactive tool to support skilled designers in aesthetic surfaces definition , 2012, International Journal on Interactive Design and Manufacturing (IJIDeM).

[56]  Hong Qin,et al.  Virtual clay: a real-time sculpting system with haptic toolkits , 2001, I3D '01.

[57]  Claus-Christian Carbon,et al.  A Model for Haptic Aesthetic Processing and Its Implications for Design , 2013, Proceedings of the IEEE.

[58]  Anatole Lécuyer,et al.  Virtual technical trainer: learning how to use milling machines with multi-sensory feedback in virtual reality , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[59]  Xin Zhang,et al.  Configuration-Based Optimization for Six Degree-of-Freedom Haptic Rendering for Fine Manipulation , 2013, IEEE Trans. Haptics.

[60]  Robin Wolff,et al.  A modular architecture for an interactive real-time simulation and training environment for satellite on-orbit servicing , 2014, J. Simulation.

[61]  Alberto Lozano-Rodero,et al.  The Influence of Interaction Technology on the Learning of Assembly Tasks Using Virtual Reality , 2014, J. Comput. Inf. Sci. Eng..

[62]  J. Wagemans,et al.  All is beautiful? Generality vs. specificity of word usage in visual aesthetics. , 2012, Acta psychologica.

[63]  Charlie C. L. Wang,et al.  Toward Stable and Realistic Haptic Interaction for Tooth Preparation Simulation , 2010, J. Comput. Inf. Sci. Eng..

[64]  Saeid Nahavandi,et al.  Haptically enabled interactivity and immersive virtual assembly , 2009 .

[65]  Ming C. Lin,et al.  inTouch: interactive multiresolution modeling and 3D painting with a haptic interface , 2000, Proceedings IEEE Virtual Reality 2000 (Cat. No.00CB37048).

[66]  Maud Marchal,et al.  Combining Brain-Computer Interfaces and Haptics: Detecting Mental Workload to Adapt Haptic Assistance , 2012, EuroHaptics.

[67]  Jungwon Yoon,et al.  Haptic based optimized path planning approach to virtual maintenance assembly / disassembly (MAD) , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[68]  Hong Qin,et al.  Touch-based haptics for interactive editing on point set surfaces , 2004, IEEE Computer Graphics and Applications.

[69]  Judy M. Vance,et al.  SHARP: A System for Haptic Assembly and Realistic Prototyping , 2006 .

[70]  Monica Bordegoni,et al.  Designing interaction with consumer products in a multisensory virtual reality environment , 2013 .

[71]  Gang Sun,et al.  A Haptic-Based Approach for Cable Design and Routing in Industrial Complex Products , 2010 .

[72]  Uma Jayaram,et al.  An Integrated Approach to Combine Computer-Based Training (CBT) and Immersive Training (ImT) for Mechanical Assembly , 2007 .

[73]  Dangxiao Wang,et al.  iFeel6-BH1500: A large-scale 6-DOF haptic device , 2012, 2012 IEEE International Conference on Virtual Environments Human-Computer Interfaces and Measurement Systems (VECIMS) Proceedings.

[74]  Takuji Narumi,et al.  Poster: A wearable augmented reality system with haptic feedback and its performance in virtual assembly tasks , 2013, 2013 IEEE Symposium on 3D User Interfaces (3DUI).

[75]  Umberto Cugini,et al.  The Role of Haptic Technology in the Development of Aesthetic Driven Products , 2008, J. Comput. Inf. Sci. Eng..

[76]  Jongeun Cha,et al.  Haptics Technologies , 2011, Haptics Technologies.

[77]  Yuan-Shin Lee,et al.  Hybrid client-server architecture and control techniques for collaborative product development using haptic interfaces , 2010, Comput. Ind..

[78]  Jungwon Yoon,et al.  A novel optimal assembly algorithm for haptic interface applications of a virtual maintenance system , 2009 .

[79]  R. Iacob.  Evaluation Of A Haptic-based Interaction System For Virtual Manual Assembly , 2015 .

[80]  Germanico Gonzalez-Badillo,et al.  The development of a physics and constraint-based haptic virtual assembly system , 2014 .

[81]  Jungwon Yoon,et al.  Haptic assisted aircraft optimal assembly path planning scheme based on swarming and artificial potential field approach , 2014, Adv. Eng. Softw..

[82]  Zhan Gao,et al.  Haptic sculpting of multi-resolution B-spline surfaces with shaped tools , 2006, Comput. Aided Des..

[83]  Georges Dumont,et al.  Haptic manipulation of deformable CAD parts with a two-stage method , 2011 .

[84]  Gao Zhan,et al.  Haptic perception evaluation for the virtual prototyping of elastic hand-held product designs , 2012 .

[85]  H. Qin,et al.  Enhancing Interactive Editing on Point Set Surfaces Through Touch-based Haptics , 2004 .

[86]  Olga Sourina,et al.  Emotion-enabled haptic-based serious game for post stroke rehabilitation , 2013, VRST '13.

[87]  Jean-Yves Fourquet,et al.  Interactive path planning for haptic assistance in assembly tasks , 2010, Comput. Graph..

[88]  野間 春生,et al.  Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems 参加報告 , 1997 .

[89]  Bert Bras,et al.  A Haptic Assembly and Disassembly Simulation Environment and Associated Computational Load Optimization Techniques , 2001, J. Comput. Inf. Sci. Eng..

[90]  Monica Bordegoni,et al.  Multimodal training and tele-assistance systems for the maintenance of industrial products , 2013 .

[91]  Yuan-Shin Lee,et al.  Interactive Forces Analysis and Haptic Modeling for Virtual Prototyping and Product Development , 2010, 2010 International Conference on Manufacturing Automation.