Investigating Page Turning Methods for Sheet Music during Piano Play

Musical pieces composed for the piano are registered on paper sheets. Since the space for sheets on the piano is limited, pianists have to turn pages while playing the piano to get access to the registered without having to stop playing. In this work, we present two methods to support page turning during piano play: 1) turning by touch and 2) turning by pedal in combination with two types of note layouts in (1) DIN A4 and (2) an adaptive display size. We compared these page turning methods to the baseline of using paper pages with 10 participants in a controlled lab experiment. Our results show that the pedal-adaptive turning method leads to the lowest interruption time while playing and pedal-based methods have a high usability and low cognitive load.

[1]  Philip T. Kortum,et al.  Determining what individual SUS scores mean: adding an adjective rating scale , 2009 .

[2]  Peter J. Jutras.  The Benefits of Adult Piano Study as Self-Reported by Selected Adult Piano Students , 2006 .

[3]  Erwin Schoonderwaldt,et al.  MusicJacket—Combining Motion Capture and Vibrotactile Feedback to Teach Violin Bowing , 2011, IEEE Transactions on Instrumentation and Measurement.

[4]  Rafael Ramírez,et al.  Air violin: a machine learning approach to fingering gesture recognition , 2017, MIE@ICMI.

[5]  Christopher Raphael.  A Bayesian Network for Real-Time Musical Accompaniment , 2001, NIPS.

[6]  Timothy C. Bell,et al.  Page turning and Image Size in a Digital Music Stand , 2005, ICMC.

[7]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[8]  Max Mühlhäuser,et al.  Let’s Frets! Assisting Guitar Students During Practice via Capacitive Sensing , 2021, CHI.

[9]  György Fazekas,et al.  Piano pedaller: a measurement system for classification and visualisation of piano pedalling techniques , 2017, NIME.

[10]  François Bérard,et al.  An Augmented Reality Based Learning Assistant for Electric Bass Guitar , 2003 .

[11]  Soonuk Seol,et al.  Real-time Recognition of Guitar Performance Using Two Sensor Groups for Interactive Lesson , 2018, Tangible and Embedded Interaction.

[12]  Tsutomu Terada,et al.  A Piano Learning Support System considering rhythm , 2012, ICMC.

[13]  Georg Essl,et al.  Visual Associations in Augmented Keyboard Performance , 2013, NIME.

[14]  Hiroshi Ishii,et al.  MirrorFugue: communicating hand gesture in remote piano collaboration , 2010, TEI.

[15]  George Wolberg,et al.  Page turning solutions for musicians: a survey. , 2012, Work.

[16]  Susan Hallam,et al.  The power of music in the lives of older adults , 2013 .

[17]  Katja Rogers,et al.  P.I.A.N.O.: Faster Piano Learning with Interactive Projection , 2014, ITS '14.

[18]  W. Gibbs.  Hands-free sheet music [Resources-Hands On] , 2014, IEEE Spectrum.

[19]  Max Mühlhäuser,et al.  Analysis of Piano Playing Movements Spanning Multiple Touches , 2010, NIME.

[20]  John R. McPherson,et al.  Page turning : score automation for musicians , 1999 .

[21]  Kris Luyten,et al.  Game of tones: learning to play songs on a piano using projected instructions and games , 2014, CHI Extended Abstracts.

[22]  Sofia Seinfeld,et al.  Effects of music learning and piano practice on cognitive function, mood and quality of life in older adults , 2013, Front. Psychol..

[23]  Hideo Saito,et al.  REAL-TIME GUITAR CHORD ESTIMATION BY STEREO CAMERAS FOR SUPPORTING GUITARISTS(International Workshop on Advanced Image Technology 2007) , 2007 .

[24]  Shantanu Das,et al.  Music everywhere - augmented reality piano improvisation learning system , 2017, NIME.

[25]  Gerhard Tröster,et al.  Finger Position and Pressure Sensing Techniques for String and Keyboard Instruments , 2013, NIME.

[26]  Andrew P. McPherson,et al.  A Low-Cost Real-Time Tracking System for Violin , 2015 .

[27]  Gerhard Widmer,et al.  Automatic Page Turning for Musicians via Real-Time Machine Listening , 2008, ECAI.

[28]  Jorge Martín-Gutiérrez,et al.  AR Graphic Representation of Musical Notes for Self-Learning on Guitar , 2019, Applied Sciences.

[29]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[30]  Karola Marky,et al.  Supporting Musical Practice Sessions Through HMD-Based Augmented Reality , 2019, Mensch & Computer Workshopband.

[31]  Stefania Cristina,et al.  Automated Page Turner for Musicians , 2020, Frontiers in Artificial Intelligence.

[32]  Hideo Saito,et al.  Support system for guitar playing using augmented reality display , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.