A practical development of engineering simulation-assisted educational AR environments

Abstract Engineering simulations have opened several gates for today’s chemical engineers. They are powerful tools to provide technical content as physics-based numerical solvers. Augmented reality (AR) and virtual reality (VR), on the other hand, are already underway to digitize environments in many fields. The combination of AR/VR environments and simulations in engineering education has been attracting widespread interest. Literature has demonstrated a massive amount of digital educational environments in several contexts as being complementary to conventional educational methods. Nevertheless, hosting technical content produced by engineering simulations with educational AR/VR is still challenging and requires expertise from multiple disciplines throughout the technical development. Present work provides a facile and agile methodology for low-cost hardware but content-wise rich AR software development. Inspired by the Covid-19 pandemic, a case study is developed to teach chemical-engineering concepts using a liquid-soap synthesis process. Accordingly, we assess and conclude the digital development process to guide inexperienced developers for the digitalization of teaching content. The present contribution serves as an example of the power of integrating AR/VR with traditional engineering simulations for educational purposes. The digital tool developed in this work is shared in the online version.

[1]  Yannis Hadzigeorgiou.  Fostering a Sense of Wonder in the Science Classroom , 2012 .

[2]  D. Firestone,et al.  Fats and oils. , 2001, Journal of AOAC International.

[3]  Richard M. Felder,et al.  Teaching and Learning Stem: A Practical Guide , 2016 .

[4]  U. Zoller,et al.  Handbook of detergents , 1999 .

[5]  Vincent Heuveline,et al.  Augmented Reality for Urban Simulation Visualization , 2011 .

[6]  A. Olteanu,et al.  A marker-based augmented reality system for mobile devices , 2013, 2013 11th RoEduNet International Conference.

[7]  Gwo-Jen Hwang,et al.  An Augmented Reality-based Mobile Learning System to Improve Students' Learning Achievements and Motivations in Natural Science Inquiry Activities , 2014, J. Educ. Technol. Soc..

[8]  Zainal Arifin Ahmad,et al.  Operator training simulator for biodiesel synthesis from waste cooking oil , 2016 .

[9]  Zeynel Abidin Yılmaz,et al.  Artırılmış Gerçeklik Uygulamalarının Eğitimle Bütünleştirilmesinin Meta-Analitik ve Tematik Karşılaştırmalı Analizi , 2016 .

[10]  Murat Akcay,et al.  Advantages and challenges associated with augmented reality for education : A systematic review of the literature , 2017 .

[11]  Pedro Reis,et al.  Multiple representations in the development of students’ cognitive structures about the saponification reaction , 2019, Chemistry Education Research and Practice.

[12]  Juan Garzón,et al.  Meta-analysis of the impact of Augmented Reality on students’ learning gains , 2019, Educational Research Review.

[13]  Serkan Solmaz,et al.  Integration of Interactive CFD Simulations with AR and VR for Educational Use in CRE , 2020 .

[14]  Nobuyoshi Yabuki,et al.  Integrating Animated Computational Fluid Dynamics into Mixed Reality for Building-Renovation Design , 2019 .

[15]  Silvia Baldiris,et al.  Systematic review and meta-analysis of augmented reality in educational settings , 2019, Virtual Reality.

[16]  Gurutze Arzamendi,et al.  Kinetics of the NaOH-catalyzed transesterification of sunflower oil with ethanol to produce biodiesel , 2015 .

[17]  Daeyong Jung,et al.  Augmented-Reality Visualization of Aerodynamics Simulation in Sustainable Cloud Computing , 2018 .

[18]  Jacob D Durrant,et al.  BlendMol: advanced macromolecular visualization in Blender , 2018, Bioinform..

[19]  Fengfeng Ke,et al.  Mobile augmented-reality artifact creation as a component of mobile computer-supported collaborative learning , 2015, Internet High. Educ..

[20]  A. Y. C. Nee,et al.  A State-ofthe-Art Review of Augmented Reality in Engineering Analysis and Simulation , 2017 .

[21]  Jinghai Li,et al.  Approaching virtual process engineering with exploring mesoscience , 2015 .

[22]  Jorge Bacca,et al.  Augmented Reality Trends in Education: A Systematic Review of Research and Applications , 2014, J. Educ. Technol. Soc..

[23]  M. McDaniel,et al.  Make It Stick , 2014 .

[24]  Verina Cristie,et al.  CFD Post-processing in Unity3D , 2015, ICCS.

[25]  Chris Dede,et al.  Virtual, Augmented, and Mixed Realities in Education , 2017, Smart Computing and Intelligence.

[26]  A. Ozdemir,et al.  The Effect of Teaching Integers through the Problem Posing Approach on Students’ Academic Achievement and Mathematics Attitudes , 2018, Eurasian Journal of Educational Research.

[27]  Dennis Beck,et al.  Special Issue: Augmented and Virtual Reality in Education: Immersive Learning Research , 2019, Journal of Educational Computing Research.

[28]  Wei Ge,et al.  Meso-scale oriented simulation towards virtual process engineering (VPE)-The EMMS Paradigm , 2011 .

[29]  P. Brickman,et al.  Effects of Inquiry-based Learning on Students’ Science Literacy Skills and Confidence , 2009 .

[30]  Simone Colombo,et al.  Bridging between Virtual Reality and accident simulation for training of process-industry operators , 2013, Adv. Eng. Softw..

[31]  Zhihan Lv,et al.  Game On, Science - How Video Game Technology May Help Biologists Tackle Visualization Challenges , 2013, PloS one.

[32]  Marek Woda,et al.  Capabilities of ARCore and ARKit Platforms for AR/VR Applications , 2019, DepCoS-RELCOMEX.

[33]  Luciano P. Soares,et al.  Simulation Training in Oil Platforms , 2016, 2016 XVIII Symposium on Virtual and Augmented Reality (SVR).

[34]  Jorge Martín-Gutiérrez,et al.  Virtual Technologies Trends in Education , 2017 .

[35]  Nobuyoshi Yabuki,et al.  An indoor thermal environment design system for renovation using augmented reality , 2018, J. Comput. Des. Eng..

[36]  Jyh-Chong Liang,et al.  Current status, opportunities and challenges of augmented reality in education , 2013, Comput. Educ..

[37]  Cintia Marangoni,et al.  Educational simulator for multicomponent distillation research and teaching in chemical engineering , 2009, Comput. Appl. Eng. Educ..

[38]  Gang Wang,et al.  A Unity3D‐based interactive three‐dimensional virtual practice platform for chemical engineering , 2018, Comput. Appl. Eng. Educ..

[39]  Stephen E. Zitney.  Process/equipment co-simulation for design and analysis of advanced energy systems , 2010, Comput. Chem. Eng..

[40]  Noel Enyedy,et al.  Learning physics through play in an augmented reality environment , 2012, Int. J. Comput. Support. Collab. Learn..

[41]  Joan Schweikart,et al.  Handbook of Industrial Mixing: Science and Practice , 2004 .

[42]  Éric Marchand,et al.  A real-time tracker for markerless augmented reality , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[43]  Hakan Tekedere,et al.  Examining the Effectiveness of Augmented Reality Applications in Education: A Meta-Analysis. , 2016 .

[44]  Benjamin S. Bloom,et al.  A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives , 2000 .

[45]  Matthew J. Koehler,et al.  Teachers’ Technological Pedagogical Content Knowledge and Learning Activity Types , 2009 .

[46]  eynel Abidin Yılmaz,et al.  A Meta-Analytic and Thematic Comparative Analysis of the Integration of Augmented Reality Applications into Education , 2016 .

[47]  Bernhard Preim,et al.  An Approach for Enhanced Slice Visualization utilizing Augmented Reality : Algorithm and Applications , 2010 .

[48]  Danae Romrell,et al.  The SAMR Model as a Framework for Evaluating mLearning , 2014 .

[49]  Joseph Broun Powell,et al.  Application of multiphase reaction engineering and process intensification to the challenges of sustainable future energy and chemicals , 2017 .

[50]  Hirokazu Kato,et al.  Augmented Reality Learning Experiences: Survey of Prototype Design and Evaluation , 2014, IEEE Transactions on Learning Technologies.

[51]  Pedro Santos,et al.  Aspen Hysys – Unity Interconnection. An Approach for Rigorous Computer- Based Chemical Engineering Training , 2020 .

[52]  M. Özdemir,et al.  The Effect of Augmented Reality Applications in the Learning Process: A Meta-Analysis Study , 2018 .

[53]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[54]  Chris Morley,et al.  Open Babel: An open chemical toolbox , 2011, J. Cheminformatics.

[55]  Robert LiKamWa,et al.  SWISH: Shifting Weight-based Interfaces for Simulated Hydrodynamics in Mixed-Reality Fluid Vessels , 2019, Tangible and Embedded Interaction.

[56]  Shih-Chung Kang,et al.  Use of Tangible and Augmented Reality Models in Engineering Graphics Courses , 2011 .

[57]  Teemu Henrikki Laine,et al.  Mobile Educational Augmented Reality Games: A Systematic Literature Review and Two Case Studies , 2018, Comput..

[58]  Murat Akçayır,et al.  Advantages and challenges associated with augmented reality for education: A systematic review of the literature , 2017 .

[59]  Didier Stricker,et al.  SENSORS FOR LOCATION-BASED AUGMENTED REALITY THE EXAMPLE OF GALILEO AND EGNOS , 2016 .

[60]  Soh-Khim Ong,et al.  A State-of-the-Art Review of Augmented Reality in Engineering Analysis and Simulation , 2017, Multimodal Technol. Interact..

[61]  Jérôme Frisch,et al.  Visualization of indoor thermal environment on mobile devices based on augmented reality and computational fluid dynamics , 2019, Automation in Construction.

[62]  Joshua M. Rosenberg,et al.  The Substitution Augmentation Modification Redefinition ( SAMR ) Model 1 The Substitution Augmentation Modification Redefinition ( SAMR ) Model : A Critical Review and Suggestions for its Use , 2016 .

[63]  José Manuel Andújar Márquez,et al.  Augmented Reality for the Improvement of Remote Laboratories: An Augmented Remote Laboratory , 2011, IEEE Transactions on Education.

[64]  Gwendal Simon,et al.  Dissecting games engines: The case of Unity3D , 2015, 2015 International Workshop on Network and Systems Support for Games (NetGames).

[65]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.