Embedded questions in ebooks on programming: useful for a) summative assessment, b) formative assessment, or c) something else?

We discuss uses of embedded computing questions (ECQs) in interactive electronic textbooks on programming, identifying a non-exhaustive list of three main categories of ECQs and nine subcategories. The main categories are: ECQs that introduce content, ECQs that reinforce learning, and ECQs that highlight content. We provide examples from an existing ebook, discuss how student perceptions may pose challenges to the use of ECQs, and invite the research community to debate ECQs and investigate them empirically.

[1]  Tim S. Roberts.  The use of multiple choice tests for formative and summative assessment , 2006 .

[2]  Susan H. Rodger,et al.  Merging interactive visualizations with hypertextbooks and course management , 2006, ITiCSE-WGR '06.

[3]  Orit Hazzan,et al.  Guide to Teaching Computer Science , 2011, Springer London.

[4]  James B. Fenwick,et al.  Developing a highly interactive ebook for CS instruction , 2013, SIGCSE '13.

[5]  D. Nicol.  E‐assessment by design: using multiple‐choice tests to good effect , 2007 .

[6]  D. Kostons,et al.  Effectiveness of learning strategy instruction on academic performance: A meta-analysis , 2014 .

[7]  Diana Laurillard,et al.  Rethinking University Teaching 2nd Edition: A conversational framework for the effective use of learning technologies , 2002 .

[8]  Beth Simon,et al.  Evaluating a new exam question: Parsons problems , 2008, ICER '08.

[9]  Barbara Ericson,et al.  Analysis of Interactive Features Designed to Enhance Learning in an Ebook , 2015, ICER.

[10]  John Hamer,et al.  PeerWise: students sharing their multiple choice questions , 2008, ICER '08.

[11]  Stephen H. Edwards,et al.  The Canterbury QuestionBank: building a repository of multiple-choice CS1 and CS2 questions , 2013, ITiCSE -WGR '13.

[12]  Guido Rößling,et al.  A Visualization-Based Computer Science Hypertextbook Prototype , 2009, TOCE.

[13]  Clifford A. Shaffer,et al.  Requirements and design strategies for open source interactive computer science eBooks , 2013, ITiCSE -WGR '13.

[14]  Camino Fernández,et al.  Assessing the utility of an interactive electronic book for learning the Pascal programming language , 2000, IEEE Trans. Educ..

[15]  Raymond Lister.  Objectives and objective assessment in CS1 , 2001, SIGCSE '01.

[16]  Jennifer L. Chiu,et al.  Evidence for effective uses of dynamic visualisations in science curriculum materials , 2015 .

[17]  Beth Simon,et al.  Halving fail rates using peer instruction: a study of four computer science courses , 2013, SIGCSE '13.

[18]  Orit Hazzan,et al.  Guide to Teaching Computer Science: An Activity-Based Approach , 2011 .

[19]  Jaime Urquiza-Fuentes,et al.  Electronic books for programming education: a review and future prospects , 2002, ITiCSE '02.

[20]  Juha Sorva,et al.  Research-based design of the first weeks of CS1 , 2014, Koli Calling.

[21]  David Pritchard,et al.  CS circles: an in-browser python course for beginners , 2012, SIGCSE '13.

[22]  Clifford A. Shaffer,et al.  OpenDSA: beginning a community active-eBook project , 2011, Koli Calling.

[23]  Eric Mazur,et al.  Peer Instruction: A User's Manual , 1996 .

[24]  Diana Laurillard,et al.  Rethinking University Teaching: A Framework for the Effective Use of Educational Technology , 1993 .

[25]  K. Scouller.  The influence of assessment method on students' learning approaches: Multiple choice question examination versus assignment essay , 1998 .

[26]  Juha Sorva,et al.  How Do Students Use Program Visualizations within an Interactive Ebook? , 2015, ICER.

[27]  Bradley N. Miller,et al.  Beyond PDF and ePub: toward an interactive textbook , 2012, ITiCSE '12.

[28]  Kurt VanLehn,et al.  Evaluation of a meta-tutor for constructing models of dynamic systems , 2013, AIED Workshops.

[29]  Peter Bancroft,et al.  Multiple Choice Questions Not Considered Harmful , 2005, ACE.

[30]  Thomas Buchanan,et al.  The efficacy of a World-Wide Web mediated formative assessment , 2001, J. Comput. Assist. Learn..

[31]  Benjamin S. Bloom,et al.  A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives , 2000 .

[32]  Thomas L. Naps,et al.  Exploring the role of visualization and engagement in computer science education , 2003, ITiCSE-WGR '02.

[33]  G. Boulton‐Lewis.  Teaching for quality learning at university , 2008 .

[34]  Jennifer L. Chiu,et al.  Can desirable difficulties overcome deceptive clarity in scientific visualizations , 2011 .

[35]  Menucha Birenbaum,et al.  Relationships between learning patterns and attitudes towards two assessment formats , 1998 .