The Design Amanuensis An Instrument for Multimodal Design Capture and Playback

The Design Amanuensis supports design protocol analysis by capturing designers’ spoken and drawing actions and converting speech to text to construct a machine-readable multimedia document that can be replayed and searched for words spoken during the design session or for graphical

[1]  Ömer Akin,et al.  Design protocol data and novel design decisions , 1995 .

[2]  Gabriela Goldschmidt,et al.  Linkography : Assessing Design Productivity , 1990 .

[3]  Ömer Akin,et al.  How do Architects Design , 1978 .

[4]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[5]  Timothy D. Wilson,et al.  The Proper Protocol: Validity and Completeness of Verbal Reports , 1994 .

[6]  Leysia Palen,et al.  “I'll get that off the audio”: a case study of salvaging multimedia meeting records , 1997, CHI.

[7]  Ellen Yi-Luen Do,et al.  The right tool at the right time: investigation of freehand drawing as an interface to knowledge-based design tools , 1998 .

[8]  V. Goel.  Sketches of thought , 1995 .

[9]  A. Newell.  ON THE ANALYSIS OF HUMAN PROBLEM SOLVING PROTOCOLS , 1966 .

[10]  Gabriela Goldschmidt.  Serial sketching: visual problem solving in designing , 1992 .

[11]  Gregory D. Abowd,et al.  Teaching and learning as multimedia authoring: the classroom 2000 project , 1997, MULTIMEDIA '96.

[12]  Anoop Gupta,et al.  Auto-summarization of audio-video presentations , 1999, MULTIMEDIA '99.

[13]  Ellen Yi-Luen Do,et al.  Drawing on the Back of an Envelope: a framework for interacting with application programs by freehand drawing , 2000, Comput. Graph..

[14]  Gregory D. Abowd,et al.  Classroom 2000: An Experiment with the Instrumentation of a Living Educational Environment , 1999, IBM Syst. J..

[15]  Philip R. Cohen,et al.  MULTIMODAL INTERFACES THAT PROCESS WHAT COMES NATURALLY , 2000 .

[16]  Jeanette McFadzean,et al.  Computational Sketch Analyser (CSA): Extending the Boundaries of Knowledge in CAAD , 1999, eCAADe proceedings.

[17]  Lisa Stifelman,et al.  Augmenting real-world objects: a paper-based audio notebook , 1996, CHI Conference Companion.