Creativity Support for Computational Literature

The creativity support community has a long history of providing valuable tools to artists and designers. Similarly, creative digital media practice has proven a valuable pedagogical strategy for teaching core computational ideas. Neither strain of research has focused on the domain of literary art however, instead targeting visual, and aural media almost exclusively. To address this situation, this thesis presents a software toolkit created specifically to support creativity in computational literature. Two primary hypotheses direct the bulk of the research presented: first, that it is possible to implement effective creativity support tools for literary art given current resource constraints; and second, that such tools, in addition to facilitating new forms of literary creativity, provide unique opportunities for computer science education. Designed both for practicing artists and for pedagogy, the research presented directly addresses impediments to participation in the field for a diverse range of users and provides an end-to-end solution for courses attempting to engage the creative faculties of computer science students, and to introduce a wider demographic—from writers, to digital artists, to media and literary theorists—to procedural literacy and computational thinking. The tools and strategies presented have been implemented, deployed, and iteratively refined in real-world contexts over the past three years. In addition to their use in large-scale projects by contemporary artists, they have provided effective support for multiple iterations of 'Programming for Digital Art & Literature', a successful inter-disciplinary computer science course taught by the author. Taken together, this thesis provides a novel set of tools for a new domain, and demonstrates their real-world efficacy in providing both creativity and pedagogical support for a diverse and emerging population of users.

[1]  Ben Shneiderman,et al.  Knowledge discovery in high-dimensional data: case studies and a user survey for the rank-by-feature framework , 2006, IEEE Transactions on Visualization and Computer Graphics.

[2]  Casey Reas,et al.  Processing: a programming handbook for visual designers and artists , 2007 .

[3]  Batya Friedman,et al.  Value-sensitive design , 1996, INTR.

[4]  Elliot Soloway,et al.  Should we teach students to program? , 1993, CACM.

[5]  Elliot Soloway,et al.  PUTTING IT ALL TOGETHER IS HARD FOR NOVICE PROGRAMMERS. , 1985 .

[6]  Mark Joseph Guzdial Emile: Software-realized scaffolding for science learners programming in mixed media. , 1993 .

[7]  Elliot Soloway,et al.  Studying the Novice Programmer , 1988 .

[8]  Nigel Ward A connectionist language generator , 1994, Ablex series in artificial intelligence.

[9]  Linda Candy,et al.  Supporting the creative user: a criteria-based approach to interaction design , 1997 .

[10]  Ben Shneiderman,et al.  Design Principles for Tools to Support Creative Thinking , 2005 .

[11]  Michael A. Terry,et al.  Creativity Support Tool Evaluation Methods and Metrics , 2005 .

[12]  Mordechai Ben-Ari,et al.  Constructivism in computer science education , 1998, SIGCSE '98.

[13]  Robert P. Levy,et al.  A Computational Model of Poetic Creativity with Neural Network as Measure of Adaptive Fitness , 2001 .

[14]  Helen Nissenbaum,et al.  Embodying Values in Design: Theory and Practice , 2008 .

[15]  Batya Friedman,et al.  Informed consent in the Mozilla browser: implementing value-sensitive design , 2002, Proceedings of the 35th Annual Hawaii International Conference on System Sciences.

[16]  John E. Pfeiffer The thinking machine , 1962 .

[17]  Roger C. Schank,et al.  Engines for Education , 1995 .

[18]  Mark Guzdial,et al.  EducationPaving the way for computational thinking , 2008, CACM.

[19]  Helen Nissenbaum,et al.  Values at play: design tradeoffs in socially-oriented game design , 2005, CHI.

[20]  Mark Guzdial,et al.  Computers for communication, not calculation: media as a motivation and context for learning , 2004, 37th Annual Hawaii International Conference on System Sciences, 2004. Proceedings of the.

[21]  Charles O. Hartman Virtual Muse: Experiments In Computer Poetry , 1996 .

[22]  E. Reed The Ecological Approach to Visual Perception , 1989 .

[23]  G. Ritchie Assessing Creativity , 2001 .

[24]  Ehud Reiter,et al.  Book Reviews: Building Natural Language Generation Systems , 2000, CL.

[25]  Mark Wolff,et al.  Reading Potential: The Oulipo and the Meaning of Algorithms , 2007, Digit. Humanit. Q..

[26]  F. Cramer,et al.  COMBINATORY POETRY AND LITERATURE IN THE INTERNET , 2001 .

[27]  Yasmin B. Kafai,et al.  Minds In Play: Computer Game Design as a Context for Children''s , 1994 .

[28]  Mitchel Resnick,et al.  LogoBlocks: A Graphical Programming Language for Interacting with the World , 2000 .

[29]  Selmer Bringsjord Chess Is Too Easy. , 1998 .

[30]  Beth Simon,et al.  Evaluating a new exam question: Parsons problems , 2008, ICER '08.

[31]  B. A. Sheil Teaching procedural literacy (Presentation Abstract) , 1980, ACM '80.

[32]  Noah Wardrip-Fruin,et al.  Expressive processing: on the process-intensive literature and digital media , 2006 .

[33]  Kenneth E. Iverson APL syntax and semantics , 1983 .

[34]  Djoerd Hiemstra Language Models , 2009, Encyclopedia of Database Systems.

[35]  Joanna McGrenere,et al.  Affordances: Clarifying and Evolving a Concep , 2000, Graphics Interface.

[36]  Nicolas Szilas,et al.  An experimental tool for digital literature , 2008 .

[37]  Larry Wall,et al.  Programming Perl , 1991 .

[38]  Paul Taylor,et al.  The architecture of the Festival speech synthesis system , 1998, SSW.

[39]  Italo Calvino,et al.  Numbers in the Dark and Other Stories , 1993 .

[40]  R. Sternberg Handbook of Creativity: Subject Index , 1998 .

[41]  James R. Meehan,et al.  The Metanovel: Writing Stories by Computer , 1976, Outstanding Dissertations in the Computer Sciences.

[42]  R. Florida The Rise of the Creative Class : And How It's Transforming Work, Leisure, Community and Everyday Life , 2003 .

[43]  Selmer Bringsjord,et al.  The logicist manifesto: At long last let logic-based artificial intelligence become a field unto itself , 2008, J. Appl. Log..

[44]  Maggie Turp Talking cure. , 2003, Mental health today.

[45]  David Garlan,et al.  GNOME: An introductory programming environment based on a family of structure editors , 1984, SDE 1.

[46]  Mordechai Ben-Ari,et al.  A long-term investigation of the comprehension of OOP concepts by novices , 2005, Comput. Sci. Educ..

[47]  Michael Mateas,et al.  Expressive AI: A Hybrid Art and Science Practice , 2001, Leonardo.

[48]  Matthew Stone,et al.  Microplanning with Communicative Intentions: The SPUD System , 2001, Comput. Intell..

[49]  Donald A. Sch The reflective practitioner: how professionals think in action , 1983 .

[50]  Mitchel Resnick,et al.  “Thick” authenticity: new media and authentic learning , 1999 .

[51]  Mark Guzdial,et al.  Of Black and Glass Boxes: Scaffolding for Doing and Learning , 1996, ICLS.

[52]  Mark Guzdial,et al.  Software-Realized Scaffolding to Facilitate Programming for Science Learning , 1994, Interact. Learn. Environ..

[53]  Ralph Erskine,et al.  Alan Turing: the Enigma - Book Reviem , 1984, Cryptologia.

[54]  Valeriy Naumov,et al.  The life and work of A.A. Markov , 2004 .

[55]  James H. Martin,et al.  Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition , 2000 .

[56]  Derek Attridge,et al.  Poetic Rhythm: An Introduction , 1995 .

[57]  Michael Eisenberg,et al.  Beyond Black Boxes: Bringing Transparency and Aesthetics Back to Scientific Investigation , 2000 .

[58]  I. Bogost,et al.  Procedural Literacy : Problem Solving with Programming , Systems , & Play , 2022 .

[59]  James Clinton Spohrer Marcel: a generate-test-and-debug (gtd) impasse/repair model of student programmers , 1989 .

[60]  J. Murray Hamlet on the Holodeck , 1997 .

[61]  Frederick Jelinek,et al.  Statistical methods for speech recognition , 1997 .

[62]  Steven Bird,et al.  NLTK: The Natural Language Toolkit , 2002, ACL.

[63]  Pedro A. González-Calero,et al.  Poetry Generation in COLIBRI , 2002, ECCBR.

[64]  H. Manurung An evolutionary algorithm approach to poetry generation , 2004 .

[65]  H. Gruber,et al.  Inching our way up Mount Olympus: The evolving-systems approach to creative thinking. , 1988 .

[66]  Judith Good,et al.  Embodied interaction in authoring environments , 2007 .

[67]  Romana Huk Assembling alternatives : reading postmodern poetries transnationally , 2003 .

[68]  Michael Mateas,et al.  Procedural literacy: educating the new media practitioner , 2005 .

[69]  William J. Mitchell,et al.  Beyond Productivity: Information, Technology, Innovation, and Creativity , 2003 .

[70]  Jasia Reichardt,et al.  The computer in art , 1971 .

[71]  Caleb Kelly,et al.  Cracked Media: The Sound of Malfunction , 2009 .

[72]  R. Rosenfeld,et al.  Two decades of statistical language modeling: where do we go from here? , 2000, Proceedings of the IEEE.

[73]  Adele Goldberg,et al.  Personal Dynamic Media , 1977, Computer.

[74]  Dawn Ades,et al.  Dada and Surrealism , 1974 .

[75]  C. T. Funkouser Prehistoric Digital Poetry , 2007 .

[76]  Terri Gullickson The Creative Mind: Myths and Mechanisms. , 1995 .

[77]  Louis T. Milic,et al.  The Possible Usefulness of Poetry Generation. , 1970 .

[78]  Nick Montfort,et al.  The New Media Reader , 2003 .

[79]  Andrea A. diSessa,et al.  A Principled Design for an Integrated Computational Environment , 1985, Hum. Comput. Interact..

[80]  Caitlin Kelleher,et al.  Lessons Learned from Designing a Programming System to Support Middle School Girls Creating Animated Stories , 2006, Visual Languages and Human-Centric Computing (VL/HCC'06).

[81]  Racter The Policeman's Beard Is Half Constructed , 1984 .

[82]  Patricia Haden,et al.  Parson's programming puzzles: a fun and effective learning tool for first programming courses , 2006 .

[83]  A. Collins,et al.  Situated Cognition and the Culture of Learning , 1989 .

[84]  N. Block Psychologism and Behaviorism , 1981 .

[85]  Renan Samurcay The concept of variable in programming-its meaning and use in problem-solving , 1985 .

[86]  John R. Anderson,et al.  Skill Acquisition and the LISP Tutor , 1989, Cogn. Sci..

[87]  Chris Mellish,et al.  Evaluation in the context of natural language generation , 1998, Comput. Speech Lang..

[88]  A. diSessa Local sciences: viewing the design of human-computer systems as cognitive science , 1991 .

[89]  Helen Nissenbaum,et al.  New Design Methods for Activist Gaming , 2005, DiGRA Conference.

[90]  B. Mak Learning art with computers - a LISREL model , 2001, J. Comput. Assist. Learn..

[91]  Ralph Johnson,et al.  design patterns elements of reusable object oriented software , 2019 .

[92]  David G. Kay Computer scientists can teach writing: an upper division course for computer science majors , 1998, SIGCSE '98.

[93]  Mark Guzdial,et al.  SODA: A Computer Aided Design Environment for the Doing and Learning of Software Design , 1992, ICCAL.

[94]  Paul Ernest Constructing Mathematical Knowledge: Epistemology and Mathematics Education , 1996 .

[95]  Ben Shneiderman,et al.  Creativity Support Tools: Report From a U.S. National Science Foundation Sponsored Workshop , 2006, Int. J. Hum. Comput. Interact..

[96]  Mitchel Resnick,et al.  All I really need to know (about creative thinking) I learned (by studying how children learn) in kindergarten , 2007, C&C '07.

[97]  William W. Gaver Cultural commentators: Non-native interpretations as resources for polyphonic assessment , 2007, Int. J. Hum. Comput. Stud..

[98]  Michael Mateas,et al.  Expressive AI: Games and Artificial Intelligence , 2003, DiGRA Conference.

[99]  Stephanie W. Haas The Creative Process: A Computer Model of Storytelling and Creativity, by Scott R. Turner , 1996, J. Am. Soc. Inf. Sci..

[100]  Mitchel Resnick,et al.  Pianos not stereos: creating computational construction kits , 1996, INTR.

[101]  Mark E. Hoffman,et al.  Bridging writing to learn and writing in the discipline in computer science education , 2006, SIGCSE '06.

[102]  Tracy Kidder,et al.  Soul of a New Machine , 1981 .

[103]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[104]  Avril Loveless,et al.  Literature Review in Creativity, New Technologies and Learning , 2002 .

[105]  Mark Dougherty What Has Literature to Offer Computer Science , 2004 .

[106]  Ted Selker Fostering motivation and creativity for computer users , 2005, Int. J. Hum. Comput. Stud..

[107]  A. Turing On Computable Numbers, with an Application to the Entscheidungsproblem. , 1937 .

[108]  Ben Shneiderman,et al.  Teaching programming: A spiral approach to syntax and semantics , 1977 .

[109]  B. Zimmerman,et al.  Self-regulated learning : from teaching to self-reflective practice , 1998 .

[110]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[111]  Enrique Vidal,et al.  Computation of Normalized Edit Distance and Applications , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[112]  M. Hammersley The politics of social research , 1995 .

[113]  Caitlin Kelleher,et al.  Storytelling alice motivates middle school girls to learn computer programming , 2007, CHI.

[114]  Russell Tytler,et al.  Constructivist views of teaching and learning , 2004 .

[115]  Nicolas Szilas,et al.  Authoring Highly Generative Interactive Drama , 2003, International Conference on Virtual Storytelling.

[116]  Tommy Burnette,et al.  Alice: lessons learned from building a 3D system for novices , 2000, CHI.

[117]  Jean-Jacques Thomas,et al.  Oulipo: A Primer of Potential Literature , 1988 .

[118]  P. Fishwick An Introduction to Aesthetic Computing , 2006 .

[119]  Mark Woodman,et al.  Avoiding object misconceptions , 1997, SIGCSE '97.

[120]  D. Hofstadter Fluid Concepts and Creative Analogies: Computer Models of the Fundamental Mechanisms of Thought, Douglas Hofstadter. 1994. Basic Books, New York, NY. 512 pages. ISBN: 0-465-05154-5. $30.00 , 1995 .

[121]  Christopher J. Van Wyk,et al.  Programming as writing: using portfolios , 1995, ACM SIGCSE Bull..

[122]  Aravind K. Joshi,et al.  Tree Adjunct Grammars , 1975, J. Comput. Syst. Sci..

[123]  Joseph Weizenbaum,et al.  and Machine , 1977 .

[124]  Thomas Swiss,et al.  New media poetics : contexts, technotexts, and theories , 2006 .

[125]  Vladimir I. Levenshtein,et al.  Binary codes capable of correcting deletions, insertions, and reversals , 1965 .

[126]  三嶋 博之 The theory of affordances , 2008 .

[127]  Noah Wardrip-Fruin,et al.  First Person: New Media As Story, Performance, And Game , 2004 .

[128]  Karen Anewalt Experiences teaching writing in a computer science course for the first time , 2002 .

[129]  Eric Brill,et al.  A Simple Rule-Based Part of Speech Tagger , 1992, HLT.

[130]  Batya Friedman,et al.  Trust online , 2000, CACM.

[131]  Colin Potts,et al.  Design of Everyday Things , 1988 .

[132]  Frederick P. Brooks,et al.  The computer scientist as toolsmith II , 1996, CACM.

[133]  Tim O'Shea,et al.  The black box inside the glass box: presenting computing concepts to novices , 1999, Int. J. Hum. Comput. Stud..

[134]  Peter J. Denning Great Principles of Computing , 2008, Wiley Encyclopedia of Computer Science and Engineering.

[135]  John Maeda,et al.  Design By Numbers , 1999 .

[136]  Julian Warner,et al.  Leonardo's Laptop: Human Needs and the New Computing Technologies , 2006, J. Documentation.

[137]  Linda H. Pesante Integrating writing into computer science courses , 1991, SIGCSE '91.

[138]  Ricki Goldman,et al.  RAPUNSEL: How a computer game design based on educational theory can improve girls self-efficacy and self-esteem , 2007 .

[139]  C. S. Strachey,et al.  Logical or non-mathematical programmes , 1952, ACM '52.

[140]  Ben Shneiderman,et al.  Creativity support tools: accelerating discovery and innovation , 2007, CACM.

[141]  D. Harrington The ecology of human creativity: A psychological perspective. , 1990 .

[142]  Allen S. Weiss,et al.  MUSICAGE: Cage Muses on Words * Art * Music , 1998 .

[143]  M. Greenberger,et al.  Management and the Computer of the Future. , 1963 .

[144]  John Cayley Beyond Codexspace: Potentialities of Literary Cybertext , 1996 .

[145]  Mark Guzdial A media computation course for non-majors , 2003 .

[146]  L. Manovich,et al.  The language of new media , 2001 .

[147]  Henry S. Thompson,et al.  A Flexible Integrated Architecture For Generating Poetic Texts , 2000 .

[148]  Steven Bird,et al.  The Annotation Graph Toolkit: Software Components for Building Linguistic Annotation Tools , 2001, HLT.

[149]  M. Resnick Sowing the Seeds for a more Creative Society , 2009, CHI 2009.

[150]  Daniel C. Howe and A. Braxton Soderman Hyperrhiz 06 The Aesthetics of Generative Literature: Lessons from a Digital Writing Workshop , 2009 .

[151]  Noah Wardrip-Fruin,et al.  Expressive Processing: Digital Fictions, Computer Games, and Software Studies , 2009 .

[152]  Jasia Reichardt,et al.  Cybernetic serendipity : the computer and the arts , 1969 .

[153]  Ronald Rosenfeld,et al.  Statistical language modeling using the CMU-cambridge toolkit , 1997, EUROSPEECH.

[154]  Mike Sharples,et al.  An Account of Writing as Creative Design , 1996 .

[155]  Greg Turner,et al.  Supportive methodology and technology for creating interactive art , 2006 .

[156]  Mark Guzdial,et al.  Computer science is more important than calculus: the challenge of living up to our potential , 2003, SGCS.

[157]  Elliot Soloway,et al.  Children Designers: Interdisciplinary Constructions for Learning and Knowing Mathematics in a Computer-Rich School , 1991 .

[158]  Noam Chomsky,et al.  वाक्यविन्यास का सैद्धान्तिक पक्ष = Aspects of the theory of syntax , 1965 .

[159]  Matthew Stone,et al.  Sentence Planning as Description Using Tree Adjoining Grammar , 1997, ACL.

[160]  Seymour Papert,et al.  Mindstorms: Children, Computers, and Powerful Ideas , 1981 .

[161]  Adam L. Berger,et al.  A Maximum Entropy Approach to Natural Language Processing , 1996, CL.

[162]  Mark C. Marino,et al.  Literatronica: adaptive digital narrative , 2008, Creating '08.

[163]  Andrew Donald Booth Digital Computers in Action , 1965 .

[164]  R. Queneau Cent Mille Milliards de poèmes , 1961 .

[165]  Graeme Ritchie,et al.  The transformational creativity hypothesis , 2006, New Generation Computing.

[166]  Albert Gatt,et al.  SimpleNLG: A Realisation Engine for Practical Applications , 2009, ENLG.

[167]  Matthew Stone Lexicalized Grammar 101 , 2002, ACL 2002.

[168]  Jaime G. Carbonell,et al.  Interactive drama, art and artificial intelligence , 2002 .

[169]  J.G.E.M. Vos New Media Poetry--Theory and Strategies. , 1996 .

[170]  Solomon W. Golomb,et al.  Claude Elwood Shannon (1916–2001), Volume 49, Number 1 , 1916 .

[171]  Andrea A. diSessa,et al.  Changing Minds: Computers, Learning, and Literacy , 2000 .

[172]  Raymond S. Nickerson,et al.  Human-Computer Interaction: Background and Issues , 1997 .

[173]  Michael Zock,et al.  Architectures for Natural Language Generation: Problems and Perspectives , 1993, EWNLG.

[174]  Jeannette M. Wing An introduction to computer science for non-majors using principles of computation , 2007, SIGCSE.

[175]  Elliot Soloway,et al.  Learning to program = learning to construct mechanisms and explanations , 1986, CACM.

[176]  Selmer Bringsjord,et al.  Artificial Intelligence and Literary Creativity: Inside the Mind of Brutus, A Storytelling Machine , 1999 .

[177]  Martin H. Levinson Creativity: Flow and the Psychology of Discovery and Invention , 1997 .

[178]  Kalina Bontcheva,et al.  Using GATE as an Environment for Teaching NLP , 2002, ACL 2002.

[179]  J. Harrington,et al.  Techniques in Speech Acoustics , 1999, Computational Linguistics.

[180]  John A. Carroll,et al.  Applied morphological processing of English , 2001, Natural Language Engineering.