Sound Simulation and Visualization in virtual Manufacturing Systems

The noise issue in manufacturing system is widely discussed from legal and health aspects. Regarding the existing laws and guidelines, various investigation methods are implemented in industry. The sound pressure level can be measured and reduced by using established approaches in reality. However, a straightforward and low cost approach to study noise issue using existing digital factory models is not found. This thesis attempts to develop a novel concept for sound pressure level investigation in a virtual environment. With this, the factory planners are able to investigate the noise issue during factory design and layout planning phase. Two computer aided tools are used in this approach: acoustic simulation and virtual reality (VR). The former enables the planner to simulate the sound pressure level by given factory layout and facility sound features. And the latter provides a visualization environment to view and explore the simulation results. The combination of these two powerful tools provides the planners a new possibility to analyze the noise in a factory. To validate the simulations, the acoustic measurements are implemented in a real factory. Sound pressure level and sound intensity are determined respectively. Furthermore, a software tool is implemented using the introduced concept and approach. With this software, the simulation results are represented in a Cave Automatic Virtual Environment (CAVE). This thesis describes the development of the approach, the measurement of sound features, the design of visualization framework, and the implementation of VR software. Based on this know-how, the industry users are able to design their own method and software for noise investigation and analysis.

[1]  Jan C. Aurich,et al.  Noise {Investigation} in {Manufacturing} , 2011 .

[2]  Cagatay Basdogan,et al.  An experimental study on the role of touch in shared virtual environments , 2000, TCHI.

[3]  Hans Hagen,et al.  Virtual Reality Animation of Chip Formation during Turning , 2011 .

[4]  Adelaide Marzano,et al.  A Structured Approach to Simulate Manufacturing System In Virtual Environment , 2006 .

[5]  Roman Schirra,et al.  Entwicklung eines Systems zur immersiven Arbeitssystemgestaltung mit CAD-Schnittstelle , 2009 .

[6]  Myrna Flores,et al.  Digital Factory for Human-oriented Production Systems , 2011 .

[7]  Raúl Ademar Valdivia Pacheco,et al.  Distributed visualization of engineering models , 2008 .

[8]  M J Griffin,et al.  Effects of whole-body vibration on short-term memory. , 1990, Aviation, space, and environmental medicine.

[9]  Oriol Guasch,et al.  An inversion modelling method to obtain the acoustic power of the noise sources in a large factory , 2002 .

[10]  K. Hameyer,et al.  Applying Virtual Reality Techniques to Finite Element Solutions , 2008, IEEE Transactions on Magnetics.

[11]  Steffen Strassburger,et al.  Combining Virtual Reality and Assembly Simulation for Production Planning and Worker Qualification , 2005 .

[12]  Rudolf Rabenstein,et al.  Highly Efficient Simulation and Visualization of Acoustic Wave Fields , 2005, SimVis.

[13]  Ning-Ning Zhou,et al.  Virtual reality: A state-of-the-art survey , 2009, Int. J. Autom. Comput..

[14]  G.G. Robertson,et al.  Three views of virtual reality: nonimmersive virtual reality , 1993, Computer.

[15]  Henrik Wann Jensen,et al.  Global Illumination using Photon Maps , 1996, Rendering Techniques.

[16]  Tapio Lokki,et al.  Rays or Waves? Understanding the Strengths and Weaknesses of Computational Room Acoustics Modeling Techniques , 2010 .

[17]  T. Lokki,et al.  Room acoustics modeling with acoustics radiance transfer , 2010 .

[18]  D. Wilson.  Simulation of sound propagation through high-resolution atmospheric boundary layer turbulence fields , 2004 .

[19]  Matthew W. Rohrer.  Seeing is believing: the importance of visualization in manufacturing simulation , 2000, 2000 Winter Simulation Conference Proceedings (Cat. No.00CH37165).

[20]  Michael Vorländer,et al.  Beugungssimulation ohne Rechenzeitexplosion: Die Methode der quantisierten Pyramidenstrahlen : ein neues Berechnungsverfahren für Raumakustik und Lärmimmissionsprognose ; Vergleiche, Ansätze, Lösungen , 2004 .

[21]  Julie Dorsey,et al.  Audioptimization: goal-based acoustic design , 2000 .

[22]  T T Chew,et al.  Major factors of industrial noise-induced hearing loss in Hong Kong , 1991, Environmental monitoring and assessment.

[23]  Yiping Feng,et al.  Virtual Factory Integrated Manufacturing System for Process Simulation and Monitoring , 2011 .

[24]  David G. Kirkpatrick,et al.  The geometry of beam tracing , 1985, SCG '85.

[25]  R Payne.  Uncertainties associated with the use of a sound level meter. , 2004 .

[26]  Thomas A. Funkhouser,et al.  Real-time acoustic modeling for distributed virtual environments , 1999, SIGGRAPH.

[27]  Luis Matey,et al.  VIRTOOL – Virtual Reality for Machine – Tool Training , 2004 .

[28]  Hanwu He,et al.  Web-based virtual operating of CNC milling machine tools , 2009, Comput. Ind..

[29]  Yoshio Yamasaki,et al.  Visualization of 3-dimensional sound fields by numerical solutions of particle displacement , 2005 .

[30]  L. Cremer,et al.  Die wissenschaftlichen Grundlagen der Raumakustik , 1976 .

[31]  George Chryssolouris,et al.  A virtual reality-based experimentation environment for the verification of human-related factors in assembly processes , 2000 .

[33]  Georgios Papaioannou,et al.  Virtual reality systems and applications , 2006, VRST '06.

[34]  Nils Hornung,et al.  Complex Cable Bundle Simulation and Validation in VR , 2008, 2008 Second UKSIM European Symposium on Computer Modeling and Simulation.

[35]  Dietrich Braess,et al.  Finite Elemente - Theorie, schnelle Löser und Anwendungen in der Elastizitätstheorie , 1992 .

[36]  Steven Fortune.  Topological beam tracing , 1999, SCG '99.

[37]  Elizabeth Baron.  Successes and Challenges on Using VR in Product Design and Engineering , 2009, VR.

[38]  Li Jin,et al.  Distributed VR for Collaborative Design and Manufacturing , 2007, 2007 11th International Conference Information Visualization (IV '07).

[39]  Engelbert Westkämper,et al.  VIRTUAL REALITY FOR SUPPORTING THE CONFIGURATION OF TRANSFORMABLE ASSEMBLY SYSTEMS , 2002 .

[40]  Hans Hagen,et al.  Audio-visual Virtual Reality System for Room Acoustics , 2010, Scientific Visualization: Advanced Concepts.

[41]  Roy S. Kalawsky.  A Comprehensive Virtual Environment Laboratory Facility , 1993, Virtual Reality Systems.

[42]  E. Milios,et al.  Sonel mapping: acoustic modeling utilizing an acoustic version of photon mapping , 2004, Proceedings. Second International Conference on Creating, Connecting and Collaborating through Computing.

[43]  N. F. Choong,et al.  Virtual factory: an integrated approach to manufacturing systems modeling , 2001 .

[44]  Gabriel Zachmann,et al.  Virtual reality in assembly simulation: collision detection, simulation algorithms, and interaction techniques , 2000 .

[45]  Michael A. Gigante,et al.  Virtual Reality: Definitions, History and Applications , 1993, Virtual Reality Systems.

[46]  Renate Heinz,et al.  Binaural room simulation based on an image source model with addition of statistical methods to include the diffuse sound scattering of walls and to predict the reverberant tail , 1993 .

[47]  K. Yee.  Numerical solution of initial boundary value problems involving maxwell's equations in isotropic media , 1966 .

[48]  Rudolf Rabenstein,et al.  Simulation of three-dimensional sound propagation with multidimensional wave digital filters , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[49]  Arnd Meyer,et al.  VR tools for the development of energy-efficient products , 2011 .

[50]  A. Krokstad,et al.  Calculating the acoustical room response by the use of a ray tracing technique , 1968 .

[51]  K. F. Riley,et al.  Mathematical Methods for Physics and Engineering , 1998 .

[52]  Karl Rihaczek.  Virtuelle Realität , 2015, Datenschutz und Datensicherheit - DuD.

[53]  Jont B. Allen,et al.  Image method for efficiently simulating small‐room acoustics , 1976 .

[54]  Thomas A. Furness.  The Super Cockpit and its Human Factors Challenges , 1986 .

[55]  Roy Kalawsky,et al.  The science of virtual reality and virtual environments - a technical, scientific and engineering reference on virtual environments , 1993 .

[56]  A. Krokstad,et al.  Extending the image method to higher-order reflections , 1993 .

[57]  Kurt Gramoll,et al.  3 D Finite Element Analysis On The Internet Using Java And Vrml , 2000 .

[58]  Vildan Kocar,et al.  ADVICE: A virtual environment for Engineering Change Management , 2010, Comput. Ind..

[59]  Eduard Deines,et al.  Acoustic simulation and visualization algorithms , 2008 .

[60]  William R. Sherman,et al.  Understanding Virtual RealityInterface, Application, and Design , 2002, Presence: Teleoperators & Virtual Environments.

[61]  J. Borish.  Extension of the image model to arbitrary polyhedra , 1984 .

[62]  U. Peter Svensson,et al.  MODELLING ACOUSTIC SPACES FOR AUDIO VIRTUAL REALITY , 2002 .

[63]  Christian Brecher,et al.  Interactive analysis of the structural mechanic behaviour of machine tools , 2009, Prod. Eng..

[64]  Robert J. K. Jacob,et al.  Interacting with eye movements in virtual environments , 2000, CHI.

[65]  Wookho Son,et al.  Virtual Reality based Paint Spray Training System , 2007, 2007 IEEE Virtual Reality Conference.

[66]  N. Tsingos,et al.  Extending Geometrical Acoustics to Highly Detailed Architectural Environments , 2007 .

[67]  Christoph Runde.  Konzeption und Einführung von Virtueller Realität als Komponente der Digitalen Fabrik in Industrieunternehmen , 2007 .

[68]  M.S.J. Hashmi,et al.  Virtual reality applications in manufacturing process simulation , 2004 .

[69]  Faieza Abdul Aziz,et al.  A REVIEW OF HAPTIC FEEDBACK IN VIRTUAL REALITY FOR MANUFACTURING INDUSTRY , 2009 .

[70]  Richard May,et al.  A Survey of Large High-Resolution Display Technologies, Techniques, and Applications , 2006, IEEE Virtual Reality Conference (VR 2006).

[71]  Gregory Neely,et al.  Stress, subjective experience and cognitive performance during exposure to noise and vibration , 2007 .

[72]  Wilhelm Dangelmaier,et al.  Virtual and augmented reality support for discrete manufacturing system simulation , 2005, Comput. Ind..

[73]  Frank Michel,et al.  Simulation and visualization of in- and outdoor sound , 2008 .

[74]  Sylvain Lefebvre,et al.  Instant Sound Scattering , 2007, Rendering Techniques.

[75]  Nancy Talbert.  Toward Human-Centered Systems , 1997, IEEE Computer Graphics and Applications.

[76]  T. Lewers,et al.  A combined beam tracing and radiatn exchange computer model of room acoustics , 1993 .

[77]  Philippe Coiffet,et al.  Virtual Reality Technology , 2003, Presence: Teleoperators & Virtual Environments.

[78]  Xiang Yang,et al.  Virtual reality enhanced manufacturing system design , 2011 .

[79]  D.M. Oliveira,et al.  Virtual Reality System for Industrial Training , 2007, 2007 IEEE International Symposium on Industrial Electronics.

[80]  Carolina Cruz-Neira,et al.  Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE , 2023 .

[81]  Anand K. Gramopadhye,et al.  3D eye movement analysis for VR visual inspection training , 2002, ETRA.

[82]  N. Lalor,et al.  Analysis of interior acoustic fields using the finite element method and the boundary element method , 1995 .

[83]  James P. Cowan.  Handbook of Environmental Acoustics , 1993 .

[84]  Qinping Zhao,et al.  A survey on virtual reality , 2009, Science in China Series F: Information Sciences.

[85]  D. Botteldooren.  Finite‐difference time‐domain simulation of low‐frequency room acoustic problems , 1995 .

[86]  E. Luzzato,et al.  Some simple and effective methods for sound source identification with geometrical acoustic models , 1986 .

[87]  Y. Kagawa,et al.  Discrete Huygens' model approach to sound wave propagation , 1998 .

[88]  Murray Hodgson,et al.  Improved algorithms and methods for room sound-field prediction by acoustical radiosity in arbitrary polyhedral rooms. , 2004, The Journal of the Acoustical Society of America.

[90]  Jan C. Aurich,et al.  Improvement of manufacturing processes with virtual reality-based CIP workshops , 2009 .

[92]  Bart De Moor,et al.  Real-Time Acoustics Simulation using Mesh-Tracing , 2003, ICMC.

[93]  Richard A. Blade,et al.  Glossary of Virtual Reality Terminology , 1995, Int. J. Virtual Real..

[94]  Ivan E. Sutherland,et al.  A head-mounted three dimensional display , 1968, AFIPS Fall Joint Computing Conference.

[95]  Stanley A. Gelfand,et al.  Hearing: An Introduction to Psychological and Physiological Acoustics, Fourth Edition , 1998 .

[96]  Fritz Klocke,et al.  Modularer Ansatz zur Simulation verfahrensübergreifender fertigungstechnischer Prozessketten , 2004 .

[97]  Hans Hagen,et al.  Visualizing the Phonon Map , 2006, EuroVis.

[98]  Woodrow Barfield,et al.  The Sense of Presence within Auditory Virtual Environments , 1996, Presence: Teleoperators & Virtual Environments.

[99]  Graham Naylor,et al.  ODEON—Another hybrid room acoustical model , 1993 .

[100]  Michael Vorländer,et al.  Virtual Reality System with Integrated Sound Field Simulation and Reproduction , 2007, EURASIP J. Adv. Signal Process..

[101]  Bill Kapralos,et al.  The sonel mapping acoustical modeling method , 2006 .

[102]  Jonathan Steuer,et al.  Defining virtual reality: dimensions determining telepresence , 1992 .

[103]  M. Pomplun,et al.  A Gaze-Controlled Interface to Virtual Reality Applications for Motor-and Speech-Impaired Users , 2009 .

[104]  Rainer Heger.  Entwicklung eines Systems zur interaktiven Gestaltung und Auswertung von manuellen Montagetätigkeiten in der virtuellen Realität , 1998 .

[105]  Lauri Savioja,et al.  REAL-TIME 3D FINITE-DIFFERENCE TIME-DOMAIN SIMULATION OF LOW- AND MID-FREQUENCY ROOM ACOUSTICS , 2010 .

[106]  John C. Hart,et al.  The CAVE: audio visual experience automatic virtual environment , 1992, CACM.

[107]  Tapio Lokki,et al.  The interpolated 3-D digital waveguide mesh method for room acoustic simulation and auralization , 2002 .

[108]  Torsten Bierz.  Intuitive interaction for immersive visualization systems , 2008 .

[109]  Judy M. Vance,et al.  Virtual reality for assembly methods prototyping: a review , 2011, Virtual Reality.

[110]  Eric Sundstrom,et al.  Office Noise, Satisfaction, and Performance , 1994 .

[111]  Joe Cecil,et al.  Virtual engineering approaches in product and process design , 2007 .

[112]  Per H. Christensen,et al.  A practical guide to global illumination using photon mapping , 2000, SIGGRAPH 2000.

[113]  Philippe Dépincé,et al.  Virtual reality: A human centered tool for improving Manufacturing , 2005, ArXiv.

[114]  Marc Erich Latoschik,et al.  Conversational Pointing Gestures for Virtual Reality Interaction: Implications from an Empirical Study , 2008, 2008 IEEE Virtual Reality Conference.

[115]  Helmut V. Fuchs.  Schallabsorber und Schalldämpfer , 2004 .

[116]  Warren Robinett,et al.  Virtual environment display system , 1987, I3D '86.

[117]  R. Sharma,et al.  Interactive evaluation of assembly sequences with mixed (real and virtual) prototyping , 1997, Proceedings of the 1997 IEEE International Symposium on Assembly and Task Planning (ISATP'97) - Towards Flexible and Agile Assembly and Manufacturing -.

[118]  Arthur José Vieira Porto,et al.  Virtual manufacturing as a way for the factory of the future , 2004, J. Intell. Manuf..

[119]  P. K. Banerjee.  The Boundary Element Methods in Engineering , 1994 .

[120]  Fabio Bruno,et al.  Innovative integration techniques between Virtual Reality systems and CAx tools , 2008 .

[121]  David Wessel,et al.  Volumetric modeling of acoustic fields in CNMAT's sound spatialization theatre , 1998 .

[122]  Robert L. Cook,et al.  Distributed ray tracing , 1998 .

[123]  Tapio Lokki,et al.  IMMERSIVE VISUALIZATION OF ROOM ACOUSTICS , 2006 .

[124]  Colin H. Hansen,et al.  Current and future industrial applications of active noise control , 2005 .

[125]  Emil Wolf,et al.  Principles of Optics: Contents , 1999 .

[126]  Henry E. Bass,et al.  Atmospheric absorption of sound: Update , 1990 .

[127]  Antonio Jimeno,et al.  State of the art of the virtual reality applied to design and manufacturing processes , 2007 .

[128]  Tomasz Mazuryk,et al.  Virtual Reality History , Applications , Technology and Future , 1999 .

[129]  Maria V. Sanchez-Vives,et al.  From presence to consciousness through virtual reality , 2005, Nature Reviews Neuroscience.

[130]  Dieter W. Fellner,et al.  Interaction with hand gesture for a back-projection wall , 2004, Proceedings Computer Graphics International, 2004..

[131]  Dianliang Wu,et al.  A Virtual Reality-Based Experiment Environment for Engine Assembly Line Workplace Planning and Ergonomics Evaluation , 2007, HCI.

[132]  James T. Kajiya,et al.  The rendering equation , 1998 .

[133]  Mark R. Mine,et al.  Virtual Environment Interaction Techniques , 1995 .

[134]  Hideki Tachibana,et al.  Visualization of sound propagation and scattering in rooms , 2002 .

[135]  Donald P. Greenberg,et al.  The hemi-cube: a radiosity solution for complex environments , 1985, SIGGRAPH.

[136]  R. Manseur.  Virtual reality in science and engineering education , 2005, Proceedings Frontiers in Education 35th Annual Conference.

[137]  José L. Encarnação,et al.  A modified radiosity algorithm for integrated visual and auditory rendering , 1993, Comput. Graph..

[138]  Ravish Mehra,et al.  Precomputed wave simulation for real-time sound propagation of dynamic sources in complex scenes , 2010, SIGGRAPH 2010.

[139]  Tony F.w. Embleton,et al.  Technical assessment of upper limits on noise in the workplace , 1997 .

[140]  F. Ihlenburg.  Finite Element Analysis of Acoustic Scattering , 1998 .

[141]  Frederick P. Brooks.  What's Real About Virtual Reality? , 1999, IEEE Computer Graphics and Applications.

[142]  Martin Ochmann,et al.  Boundary Element Acoustics Fundamentals and Computer Codes , 2002 .

[143]  Joseph J. LaViola,et al.  A discussion of cybersickness in virtual environments , 2000, SGCH.

[144]  Takao Tsuchiya,et al.  Finite element simulation of non-linear sound wave propagation , 1992 .

[145]  M. Pinar Mengüç,et al.  Thermal Radiation Heat Transfer , 2020 .

[146]  J. Embrechts,et al.  Determination of the scattering coefficient of random rough diffusing surfaces for room acoustics applications , 2001 .

[147]  Judy M. Vance,et al.  The VR Factory : discrete event simulation implemented in a virtual environment , 2003 .

[148]  Luo Bin,et al.  Development an interactive VR training for CNC machining , 2004, VRCAI '04.

[149]  David Zeltzer,et al.  A survey of glove-based input , 1994, IEEE Computer Graphics and Applications.

[150]  R. Rabenstein,et al.  ACOUSTIC RENDERING OF BUILDINGS , 1997 .

[151]  Ronald R. Mourant,et al.  Human Factors Issues in Virtual Environments: A Review of the Literature , 1998, Presence.

[152]  H. Lehnert.  Systematic errors of the ray-tracing algorithm , 1993 .

[153]  Hans Hagen,et al.  Comparative Visualization for Wave-based and Geometric Acoustics , 2006, IEEE Transactions on Visualization and Computer Graphics.

[154]  Judy M. Vance,et al.  Coupling of interactive manufacturing operations simulation and immersive virtual reality , 2010, Virtual Reality.

[155]  A. Kulowski.  Algorithmic representation of the ray tracing technique , 1985 .

[156]  Tapio Lokki,et al.  The room acoustic rendering equation. , 2007, The Journal of the Acoustical Society of America.

[157]  M. Csíkszentmihályi.  Beyond boredom and anxiety , 1975 .

[158]  Robert P. Smith,et al.  Virtual facility layout design: The value of an interactive three-dimensional representation , 1999 .

[159]  Thomas A. Funkhouser,et al.  A beam tracing approach to acoustic modeling for interactive virtual environments , 1998, SIGGRAPH.