Mechanix: A natural sketch interface tool for teaching truss analysis and free-body diagrams

Abstract Massive open online courses, online tutoring systems, and other computer homework systems are rapidly changing engineering education by providing increased student feedback and capitalizing upon online systems' scalability. While online homework systems provide great benefits, a growing concern among engineering educators is that students are losing both the critical art of sketching and the ability to take a real system and reduce it to an accurate but simplified free-body diagram (FBD). For example, some online systems allow the drag and drop of forces onto FBDs, but they do not allow the user to sketch the FBDs, which is a vital part of the learning process. In this paper, we discuss Mechanix, a sketch recognition tool that provides an efficient means for engineering students to learn how to draw truss FBDs and solve truss problems. The system allows students to sketch FBDs into a tablet computer or by using a mouse and a standard computer monitor. Using artificial intelligence, Mechanix can determine not only the component shapes and features of the diagram but also the relationships between those shapes and features. Because Mechanix is domain specific, it can use those relationships to determine not only whether a student's work is correct but also why it is incorrect. Mechanix is then able to provide immediate, constructive feedback to students without providing final answers. Within this manuscript, we document the inner workings of Mechanix, including the artificial intelligence behind the scenes, and present studies of the effects on student learning. The evaluations have shown that Mechanix is as effective as paper-and-pencil-based homework for teaching method of joints truss analysis; focus groups with students who used the program have revealed that they believe Mechanix enhances their learning and that they are highly engaged while using it.

[1]  Yang Li,et al.  Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes , 2007, UIST.

[2]  R. Mayer Learning strategies for making sense out of expository text: The SOI model for guiding three cognitive processes in knowledge construction , 1996 .

[3]  Vittorio Fuccella,et al.  Gestures and widgets: performance in text editing on multi-touch capable mobile devices , 2013, CHI.

[4]  Randall Davis,et al.  LADDER, a sketching language for user interface developers , 2005, Comput. Graph..

[5]  D. Nicol,et al.  Formative assessment and self‐regulated learning: a model and seven principles of good feedback practice , 2006 .

[6]  David Craig,et al.  The importance of drawing in the mechanical design process , 1990, Comput. Graph..

[7]  Thomas F. Stahovich,et al.  Newton's Pen: a pen-based tutoring system for statics , 2007, SBIM '07.

[8]  Jose P. Mestre Facts and Myths about Pedagogies of Engagement in Science Learning , 2005 .

[9]  Erin McTigue,et al.  Evaluation of a natural sketch interface for truss FBDs and analysis , 2011, 2011 Frontiers in Education Conference (FIE).

[10]  Kenneth D. Forbus,et al.  Open-Domain Sketch Understanding: The nuSketch Approach , 2004, AAAI Technical Report.

[11]  Dean Rubine,et al.  Specifying gestures by example , 1991, SIGGRAPH.

[12]  Candace Thille Open Learning Initiative , 2013 .

[13]  Martin Field,et al.  Defining precise measurements with sketched annotations , 2011, SBIM '11.

[14]  Joseph J. LaViola,et al.  MathPad2: a system for the creation and exploration of mathematical sketches , 2004, SIGGRAPH 2004.

[15]  P. Black,et al.  Assessment and Classroom Learning , 1998 .

[16]  Ivan E. Sutherland,et al.  Sketch pad a man-machine graphical communication system , 1964, DAC.

[17]  R. Kozma Will media influence learning? Reframing the debate , 1994 .

[18]  Hermann G. Ebner,et al.  Improving cross-content transfer in text processing by means of active graphical representation , 2003 .

[19]  Daniel H. Robinson,et al.  Exploring the Boundary Conditions of the Delay Hypothesis With Adjunct Displays , 2004 .

[20]  Randall Davis,et al.  A Visual Approach to Sketched Symbol Recognition , 2009, IJCAI.

[21]  Francisco Vides,et al.  Mechanix: The Development of a Sketch Recognition Truss Tutoring System , 2012 .

[22]  M. Bannert,et al.  Construction and interference in learning from multiple representation , 2003 .

[23]  Julie S. Linsey,et al.  Mechanix: A Sketch Recognition Truss Tutoring System , 2011 .

[24]  Daniel Dixon,et al.  iCanDraw: using sketch recognition and corrective feedback to assist a user in drawing human faces , 2010, CHI.

[25]  Joseph J. LaViola,et al.  SetPad: a sketch-based tool for exploring discrete math set problems , 2012, SBIM '12.

[26]  Wenzhe Li,et al.  Mechanix: A Sketch-Based Tutoring System for Statics Courses , 2012, IAAI.

[27]  Paul S. Steif,et al.  A Statics Concept Inventory: Development and Psychometric Analysis , 2005 .

[28]  Joseph J. LaViola,et al.  LogicPad: a pen-based application for visualization and verification of boolean algebra , 2012, IUI '12.

[29]  Tracy Hammond,et al.  Mechanix: Evaluating the Effectiveness of a Sketch Recognition Truss Tutoring Program against other Truss Programs , 2013 .

[30]  M. D’Esposito Working memory. , 2008, Handbook of clinical neurology.

[31]  P. Chandler,et al.  Why Some Material Is Difficult to Learn , 1994 .

[32]  B. Tversky,et al.  What Does Drawing Reveal about Thinking? , 1999 .

[33]  Ing-Chang Jong,et al.  A Truss Analyzer For Enriching The Learning Experience Of Students , 2000 .

[34]  Kenneth D. Forbus,et al.  CogSketch: open-domain sketch understanding for cognitive science research and for education , 2008, SBM'08.

[35]  Wendy C. Newstetter,et al.  InTEL: Interactive Toolkit for Engineering Learning Contextualizing Statics Problems to Expand and Retain Women and URM Engineers , 2011 .

[36]  Joseph J. LaViola,et al.  CSTutor: a pen-based tutor for data structure visualization , 2012, SIGCSE '12.

[37]  Kurt VanLehn,et al.  The Andes Physics Tutoring System: Lessons Learned , 2005, Int. J. Artif. Intell. Educ..

[38]  Susan R. Goldman,et al.  Learning in complex domains: When and why do multiple representations help? , 2003 .

[39]  Joseph J. LaViola,et al.  PhysicsBook: a sketch-based interface for animating physics diagrams , 2012, IUI '12.

[40]  Tracy Anne Hammond,et al.  PaleoSketch: accurate primitive sketch recognition and beautification , 2008, IUI '08.

[41]  Wenzhe Li,et al.  Mechanix: A Sketch-Based Tutoring and Grading System for Free-Body Diagrams , 2012, AI Mag..

[42]  M. Zrull,et al.  Differences between Selfand Peer Ratings of Interpersonal Problems , 1998, Assessment.

[43]  Mark Sadoski,et al.  Resolving the Effects of Concreteness on Interest, Comprehension, and Learning Important Ideas From Text , 2001 .

[44]  Randall Davis,et al.  ChemInk: a natural real-time recognition system for chemical drawings , 2011, IUI '11.

[45]  Levent Burak Kara,et al.  An image-based, trainable symbol recognizer for hand-drawn sketches , 2005, Comput. Graph..

[46]  Martin Field,et al.  Sketch Recognition Algorithms for Comparing Complex and Unpredictable Shapes , 2011, IJCAI.

[47]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[48]  J. Mathewson Visual-spatial thinking: An aspect of science overlooked by educators , 1999 .

[49]  E. Ferguson The Mind’s Eye: Nonverbal thought in Technology , 1977 .