Mobile Cyber-Physical Labs: Integration of Mobile Devices with System and Control Laboratories

Recent years have witnessed the adoption of mobile devices to deliver valuable interactive learning experiences to students. Although prior efforts have led to the development of mobile applications that enhance access to virtual and remote laboratories, research has not yet explored the comprehensive integration of mobile technologies into traditional laboratory activities. In this chapter, we present the development of mobile cyber-physical laboratories (MCPLs) in which hardware and software of mobile devices are leveraged in measurement, control, monitoring, and interaction with physical test-beds in the laboratory. Two separate approaches for realizing cost-effective and portable educational test-beds are proposed that utilize the sensing, storage, computation, and communication (SSCC) capabilities of mobile devices to facilitate inquiry-based educational experiences. In the first approach, smartphones are mounted directly to test-beds to allow inertial- and/or vision-based measurement and control of the test-bed. In the second approach, tablets are held such that their rear-facing cameras allow vision-based measurement and control of the test-bed. By developing mobile applications that incorporate interactive plots and augmented reality visualizations, unique and engaging learning experiences are provided from learners’ personal mobile devices. The implementation and evaluation of each approach is discussed with a motor test-bed used to teach concepts of dynamic systems and control. Results of investigations indicate that by intimately linking concrete physical and cyber representations of phenomena through interactive, visually engaging interfaces, the MCPLs allow learners to make connections necessary for deep conceptual understanding and to engage in activities that hone their design skills.

[1]  Jeffrey V. Nickerson,et al.  Hands-on, simulated, and remote laboratories: A comparative literature review , 2006, CSUR.

[2]  Paul B. Hounshell,et al.  Using three-dimensional models to teach molecular structures in high school chemistry , 1995 .

[3]  Dan Jong Kim,et al.  A study of mobile user engagement (MoEN): Engagement motivations, perceived value, satisfaction, and continued engagement intention , 2013, Decis. Support Syst..

[4]  Vikram Kapila,et al.  Mixed-reality learning environments: Integrating mobile interfaces with laboratory test-beds , 2017, Comput. Educ..

[5]  Jochen Kuhn,et al.  Video analysis of projectile motion using tablet computers as experimental tools , 2014 .

[6]  Kangdon Lee,et al.  Augmented Reality in Education and Training , 2012, TechTrends.

[7]  Vikram Kapila,et al.  Using tablets in the vision-based control of a ball and beam test-bed , 2015, 2015 12th International Conference on Informatics in Control, Automation and Robotics (ICINCO).

[8]  Norbert Pachler,et al.  Bridging the gap? Mobile phones at the interface between informal and formal learning , 2009 .

[9]  Teresa Franklin,et al.  Mobile math: math educators and students engage in mobile learning , 2008, J. Comput. High. Educ..

[10]  Kurt Squire,et al.  Environmental Detectives—the development of an augmented reality platform for environmental simulations , 2008 .

[11]  S.K. Esche,et al.  On the design of a virtual learning environment for mechanical vibrations , 2007, 2007 37th Annual Frontiers In Education Conference - Global Engineering: Knowledge Without Borders, Opportunities Without Passports.

[12]  Florence Martin,et al.  Here and now mobile learning: An experimental study on the use of mobile technology , 2013, Comput. Educ..

[13]  Dorothy L. Gabel,et al.  The Effect of Student Manipulation of Molecular Models on Chemistry achievement According to Piagetian Level. , 1980 .

[14]  Diana Libman,et al.  Chemistry on the Go: Review of Chemistry Apps on Smartphones , 2013 .

[15]  Peter C. Honebein,et al.  Constructivism and the Design of Learning Environments: Context and Authentic Activities for Learning , 1993 .

[16]  Ricardo Quirós,et al.  Collaborative augmented reality for inorganic chemistry education , 2008 .

[17]  Vikram Kapila,et al.  Using inertial and visual sensing from a mounted smartphone to stabilize a ball and beam test-bed , 2016, 2016 American Control Conference (ACC).

[18]  John Millar Carroll The Nurnberg Funnel: Designing Minimalist Instruction for Practical Computer Skill , 1990 .

[19]  Tiffany L. Hesser,et al.  iPads in the Science Laboratory: Experience in Designing and Implementing a Paperless Chemistry Laboratory Course , 2013 .

[20]  Wendy E. Mackay,et al.  Evaluating the benefits of real-time feedback in mobile augmented reality with hand-held devices , 2012, CHI.

[21]  Xinhua Zhuang,et al.  Pose estimation from corresponding point data , 1989, IEEE Trans. Syst. Man Cybern..

[22]  Jochen Kuhn,et al.  Analyzing radial acceleration with a smartphone acceleration sensor , 2013 .

[23]  Patricia E. Blosser,et al.  The Role of the Laboratory in Science Teaching. , 1980 .

[24]  Jochen Kuhn,et al.  iRadioactivity — Possibilities and Limitations for Using Smartphones and Tablet PCs as Radioactive Counters , 2014 .

[25]  John Sweller,et al.  Cognitive Load During Problem Solving: Effects on Learning , 1988, Cogn. Sci..

[26]  Lauri Malmi,et al.  Exploring the role of visualization and engagement in computer science education , 2003, ACM SIGCSE Bull..

[27]  LeMai Nguyen,et al.  iPads in higher education - Hype and hope , 2015, Br. J. Educ. Technol..

[28]  Valérie Gay,et al.  Personal Heart Monitoring and Rehabilitation System using Smart Phones , 2006, 2006 International Conference on Mobile Business.

[29]  Lui Sha,et al.  Cyber-Physical Systems: A New Frontier , 2008, 2008 IEEE International Conference on Sensor Networks, Ubiquitous, and Trustworthy Computing (sutc 2008).

[30]  Albert J. Rosa,et al.  The Role of the Laboratory in Undergraduate Engineering Education , 2005 .

[31]  Chin-Chung Tsai,et al.  Affordances of Augmented Reality in Science Learning: Suggestions for Future Research , 2012, Journal of Science Education and Technology.

[32]  Jeffrey V. Nickerson,et al.  Constructing reality: A study of remote, hands-on, and simulated laboratories , 2007, TCHI.

[33]  Wazir Zada Khan,et al.  Mobile Phone Sensing Systems: A Survey , 2013, IEEE Communications Surveys & Tutorials.

[34]  A. Paivio,et al.  Dual coding theory and education , 1991 .

[35]  Vikram Kapila,et al.  Visual servoing of an inverted pendulum on cart using a mounted smartphone , 2016, 2016 American Control Conference (ACC).

[36]  Jyh-Chong Liang,et al.  Current status, opportunities and challenges of augmented reality in education , 2013, Comput. Educ..

[37]  Joseph Krajcik,et al.  Promoting understanding of chemical representations: Students' use of a visualization tool in the classroom , 2001 .

[38]  M. Sitti,et al.  Augmented reality user interface for an atomic force microscope-based nanorobotic system , 2006, IEEE Transactions on Nanotechnology.

[39]  Dah-Jye Lee,et al.  Stabilization and control of quad-rotor helicopter using a smartphone device , 2013, Electronic Imaging.

[40]  Victor C. M. Leung,et al.  Vita: A Crowdsensing-Oriented Mobile Cyber-Physical System , 2013, IEEE Transactions on Emerging Topics in Computing.

[41]  Malcolm S. Knowles,et al.  Self-directed learning : a guide for learners and teachers , 1975 .

[42]  Ahmed K. Noor,et al.  THE HOLOLENS REVOLUTION , 2016 .

[43]  Andreas Müller,et al.  Classical experiments revisited: smartphones and tablet PCs as experimental tools in acoustics and optics , 2014 .

[44]  Vikram Kapila,et al.  Using mounted smartphones as a platform for laboratory education in engineering , 2016 .

[45]  Rosemary Luckin,et al.  “Making it real”: exploring the potential of augmented reality for teaching primary school science , 2006, Virtual Reality.

[46]  D. May,et al.  Using E-Portfolios to support experiential learning and open the use of tele-operated laboratories for mobile devices , 2012, 2012 9th International Conference on Remote Engineering and Virtual Instrumentation (REV).

[47]  Robert Godwin-Jones,et al.  Mobile apps for language learning , 2011 .

[48]  Joshua M. Pearce,et al.  Building Research Equipment with Free, Open-Source Hardware , 2012, Science.

[49]  Mark Billinghurst,et al.  Augmenting the science centre and museum experience , 2004, GRAPHITE '04.

[50]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[51]  Vikram Kapila,et al.  Towards teleoperation-based interactive learning of robot kinematics using a mobile augmented reality interface on a tablet , 2016, 2016 Indian Control Conference (ICC).

[52]  Kathryn Alexander Instruments in Your PocketSensors and Apps are Turning Smartphones into Engineering Measurement Tools , 2015 .

[53]  Vikram Kapila,et al.  Using Mobile Devices for Mixed-Reality Interactionswith Educational Laboratory Test-Beds , 2016 .

[54]  Ananda Maiti,et al.  Different Platforms for Remote Laboratories in Mobile Devices , 2012 .

[55]  Insup Lee,et al.  Cyber-physical systems: The next computing revolution , 2010, Design Automation Conference.

[56]  Vikram Kapila,et al.  Mounted Smartphones as Measurement and Control Platforms for Motor-Based Laboratory Test-Beds † , 2016, Sensors.

[57]  Lee E. Weiss,et al.  Adaptive Visual Servo Control of Robots , 1983 .

[58]  Vilson Gruber,et al.  Mobile remote experimentation applied to education , 2013 .

[59]  Pablo Orduna,et al.  Enabling mobile access to Remote Laboratories , 2011, 2011 IEEE Global Engineering Education Conference (EDUCON).

[60]  Geoff Rose,et al.  Mobile Phones as Traffic Probes: Practices, Prospects and Issues , 2006 .

[61]  Wolfgang Hürst,et al.  Multimodal Interaction Concepts for Mobile Augmented Reality Applications , 2011, MMM.

[62]  Vikram Kapila,et al.  Development of Mobile Interfaces to Interact with Automatic Control Experiments [Focus on Education] , 2014, IEEE Control Systems.

[63]  Noah S. Podolefsky,et al.  When learning about the real world is better done virtually: A study of substituting computer simulations for laboratory equipment , 2005 .

[64]  Vikram Kapila,et al.  Interactive mobile interface with augmented reality for learning digital control concepts , 2016, 2016 Indian Control Conference (ICC).

[65]  Willian Rochadel,et al.  Application of remote experiments in basic education through mobile devices , 2014, 2014 IEEE Global Engineering Education Conference (EDUCON).

[66]  James A. Landay,et al.  UbiGreen: investigating a mobile tool for tracking and supporting green transportation habits , 2009, CHI.

[67]  Emiliano Miluzzo,et al.  A survey of mobile phone sensing , 2010, IEEE Communications Magazine.

[68]  Dino Schweitzer,et al.  Designing interactive visualization tools for the graphics classroom , 1992, SIGCSE '92.

[69]  Wei Liu,et al.  Mixed reality classroom: learning from entertainment , 2007, DIMEA.

[70]  What Research Says , 1983 .

[71]  Karthikeyan Natesan Ramamurthy,et al.  Work in progress: Performing signal analysis laboratories using Android devices , 2012, 2012 Frontiers in Education Conference Proceedings.

[72]  Harry E. Pence,et al.  Smart Phones, a Powerful Tool in the Chemistry Classroom. , 2011 .

[73]  José Manuel Andújar Márquez,et al.  Augmented Reality for the Improvement of Remote Laboratories: An Augmented Remote Laboratory , 2011, IEEE Transactions on Education.

[74]  Abhinav Valada,et al.  Visual Obstacle Avoidance for Autonomous Watercraft u sing Smartphones , 2013 .

[75]  Andreas Spanias,et al.  Interactive DSP laboratories on mobile phones and tablets , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[76]  Jochen Kuhn,et al.  Applications and Examples of Experiments with Mobile Phones and Smartphones in Physics Lessons , 2013 .

[77]  Bhawani Venkataraman,et al.  Visualization and interactivity in the teaching of chemistry to science and non-science students , 2009 .

[78]  G. A. Miller THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[79]  Joshua M. Pearce,et al.  The RepRap 3-D Printer Revolution in STEM Education , 2014 .