Teaching data structures with beSocratic

This paper describes a novel intelligent tutoring system called beSocratic, which targets question types that allow students to respond with free-form input but are able to be automatically evaluated and analyzed. Using beSocratic's GraphPad module, students are able to draw data structures using a mouse, touch, or a stylus. Once a student has completed a question, their final answer and a replay of their actions is uploaded to beSocratic's database. This allows teachers to replay student answers and identify common mistakes. In addition, beSocratic contains a set of post-analysis tools that utilize hidden Markov modeling to cluster student submissions with similar sequences of actions. Along with the modeling, beSocratic generates several visualizations to help teachers interpret the results. This can potentially help teachers identify students who are using the same strategies to answer questions. We have begun pilot-testing its use in computer science classrooms to teach student to properly construct splay trees. The splay tree activity teaches students to construct data structures using free-form drawing and the rotations needed for the splay operation. The activity concludes with an extended example where students must construct a splay tree from scratch. At each step, GraphPad evaluates how the students are performing and provides feedback. Students responded positively to the initial pilot study and we believe this warrants further investigation. beSocratic is free to use at beSocratic.clemson.edu.

[1]  Roy P. Pargas Reducing lecture and increasing student activity in large computer science courses , 2006, ITICSE '06.

[2]  Samuel P. Bryfczynski GraphPad: a CS2/CS7 tool for graph creation , 2009, ACM-SE 47.

[3]  P. Fayers,et al.  The Visual Display of Quantitative Information , 1990 .

[4]  Gautam Biswas,et al.  Using Hidden Markov Models to Characterize Student Behaviors in Learning-by-Teaching Environments , 2008, Intelligent Tutoring Systems.

[5]  Roy P. Pargas,et al.  Using ink to expose students' thought processes in CS2/CS7 , 2009, SIGCSE '09.

[6]  M. O’Connor,et al.  Changing assessments : alternative views of aptitude, achievement and instruction , 1994 .

[7]  A. E. Clark-Kennedy,et al.  Teaching of psychology. , 1950, Lancet.

[8]  Proceedings of the 6th IEEE International Conference on Advanced Learning Technologies, ICALT 2006, Kerkrade, The Netherlands, July 5-7, 2006 , 2006, ICALT.

[9]  Edward Rolf Tufte,et al.  The visual display of quantitative information , 1985 .

[10]  Michael W. Kirst,et al.  Interview on Assessment Issues with Lorrie Shepard. , 1991 .

[11]  V. Aleven,et al.  Rapid Authoring of Intelligent Tutors for Real-World and Experimental Use , 2006, Sixth IEEE International Conference on Advanced Learning Technologies (ICALT'06).

[12]  Kenneth D. Forbus,et al.  CogSketch: Sketch Understanding for Cognitive Science Research and for Education , 2011, Top. Cogn. Sci..

[13]  L. Baum,et al.  Statistical Inference for Probabilistic Functions of Finite State Markov Chains , 1966 .

[14]  Paul R. Cohen,et al.  Modeling learning patterns of students with a tutoring system using Hidden Markov Models , 2007, AIED.