"It will discourse most eloquent music": Sonifying variants of Hamlet

Sonification is a complementary technique to visualization that uses sound to describe relationships in data. We describe work to aid exploratory textual analysis by sonifying textual variants. The sonification presented focuses on using pitch and tones to help the user listen to differences in the structure between variations of a text or texts encoded in Text Encoding Initiative (TEI) XML. Extracting hyperstructures, we describe our conversion of TEI elements and attributes into sounds for a listener. We discuss our approaches to creating the sounds used to represent the data from the Bodleian Libraries’ First Folio project and early visualizations, and we consider the issues raised by the use of this novel technique. The use of sound provides an exciting alternative way of exploring textual structures to determine differences between them. While the novelty in this area is a major challenge, we suggest that this method can be useful in the exploration of variants between texts marked up with TEI.

[1]  S. Smith,et al.  The Eternal Verities Verified: Charlton Hinman and the Roots of Mechanical Collation , 2000 .

[2]  David De Roure,et al.  On hyperstructure and musical structure , 2002, HYPERTEXT '02.

[3]  K.V. Nesbitt,et al.  Finding trading patterns in stock market data , 2004, IEEE Computer Graphics and Applications.

[4]  Gregory Kramer,et al.  Auditory Display: Sonification, Audification, And Auditory Interfaces , 1994 .

[5]  Claire Holden.  Recreating early 19th- century style in a 21st-century marketplace: An orchestral violinist’s perspective , 2012 .

[6]  William W. Gaver,et al.  Chapter 42 – Auditory Interfaces , 1997 .

[7]  Ralf Steinmetz,et al.  Automatic Detection and Visualisation of Overlap for Tracking of Information Flow , 2010, I-KNOW 2010.

[8]  Arno Mittelbach,et al.  The Holinshed Project: Comparing and linking two editions of Holinshed's Chronicle , 2010, Int. J. Humanit. Arts Comput..

[9]  Stephen Barrass,et al.  EVALUATION OF A MULTIMODAL SONIFICATION AND VISUALISATION OF DEPTH OF MARKET STOCK DATA , 2002 .

[10]  Andrés Cabrera,et al.  Application of Gestalt Principles to Multimodal Data Representation , 2014 .

[11]  Dan Gärdenfors,et al.  Auditory Interfaces , 2016 .

[12]  C. M. Sperberg-McQueen,et al.  Guidelines for electronic text encoding and interchange , 1994 .

[13]  Meera Blattner,et al.  Earcons and Icons: Their Structure and Common Design Principles , 1989, Hum. Comput. Interact..

[14]  C HINMAN.  Mechanized Collation: A Preliminary Report , 1947, The Papers of the Bibliographical Society of America.