We Can Do More to Save Guqin: Design and Evaluate Interactive Systems to Make Guqin More Accessible to the General Public

Guqin is a plucked seven-string traditional Chinese musical instrument that exists for over 3,000 years. However, as an Intangible World Cultural Heritage, the inheritance of Guqin and its culture in modern society is in deep danger. According to our study with 1,006 Chinese worldwide, Guqin as an instrument is not well-known and barely accessible. To better promote Guqin, we developed two interactive systems: VirGuqin and MRGuqin. VirGuqin was developed using a low-cost motion tracking device and was tested in a museum. 89% of 308 participants expressed an increase in interest in learning Guqin after using our system. MRGuqin was developed as a mixed reality learning environment to reduce the entry barrier to Guqin, and was tested by 16 participants, allowing them to learn Guqin significantly faster and perform better than the current practice. Our study demonstrates how technology can be used to help the inheritance of this dying art.

[1]  Marc Leman,et al.  Physical modeling of the guqin - a Chinese string instrument , 2006 .

[2]  Hong Zeng,et al.  FunPianoAR: A Novel AR Application for Piano Learning Considering Paired Play Based on Multi-Marker Tracking , 2019, Journal of Physics: Conference Series.

[3]  Matthias Rauterberg,et al.  3D Guqin: Digital Playground to Explore Music that Embodies Chinese Culture and Philosophy , 2011, 2011 Second International Conference on Culture and Computing.

[4]  Changle Zhou,et al.  Handwriting input system of chinese guqin notation , 2011, JOCCH.

[5]  Azrul Hazri Jantan,et al.  VIRTUAL KOMPANG: MAPPING IN-AIR HAND GESTURES FOR MUSIC INTERACTION USING GESTURAL MUSICAL CONTROLLER , 2018 .

[6]  Joseph A. Paradiso,et al.  Digito: A Fine-Grain Gesturally Controlled Virtual Musical Instrument , 2012, NIME.

[7]  Ajay Kapur,et al.  Developing a physical gesture acquisition system for guqin performance , 2015, NIME.

[8]  Matthew Cox,et al.  A Dynamic 3D Performance Space for Control of Virtual Musical Instruments , 2016, ISS.

[9]  Jorge Martín-Gutiérrez,et al.  AR Graphic Representation of Musical Notes for Self-Learning on Guitar , 2019, Applied Sciences.

[10]  Petros Maragos,et al.  A Web-based Real-Time Kinect Application for Gestural Interaction with Virtual Musical Instruments , 2018, Audio Mostly Conference.

[11]  MaryAlice Bitts Jackson.  The Guitar Hero , 2015 .

[12]  N. Bryan-Kinns,et al.  ReImagining: Cross-cultural Co-Creation of a Chinese Traditional Musical Instrument with Digital Technologies , 2020, NIME.

[13]  Burkhard Wünsche,et al.  Mixed Reality Piano Tutor: A Gamified Piano Practice Environment , 2019, 2019 International Conference on Electronics, Information, and Communication (ICEIC).

[14]  Katja Rogers,et al.  P.I.A.N.O.: Faster Piano Learning with Interactive Projection , 2014, ITS '14.

[15]  Antonio Krüger,et al.  guitAR: supporting guitar learning through mobile projection , 2011, CHI Extended Abstracts.

[16]  Bin Ma,et al.  Ancient Chinese zither (guqin) music recovery with support vector machine , 2010, JOCCH.

[17]  Junsong Yuan,et al.  Barehanded music: real-time hand interaction for virtual piano , 2016, I3D.

[18]  Debby Paseru,et al.  The development of a cross-platform multi-player virtual application of Kolintang musical instruments using various controllers , 2015, 2015 International Conference on Electrical Engineering and Informatics (ICEEI).

[19]  Changle Zhou,et al.  Decomposition of reduced character of Chinese Guqin notation , 2010, 2010 IEEE International Conference on Intelligent Systems and Knowledge Engineering.

[20]  Burkhard Wünsche,et al.  Music Education using Augmented Reality with a Head Mounted Display , 2013, AUIC.

[21]  Monica Tentori,et al.  BendableSound: An elastic multisensory surface using touch-based interactions to assist children with severe autism during music therapy , 2017, Int. J. Hum. Comput. Stud..

[22]  Zixue Cheng,et al.  Spider King: Virtual musical instruments based on microsoft Kinect , 2013, 2013 International Joint Conference on Awareness Science and Technology & Ubi-Media Computing (iCAST 2013 & UMEDIA 2013).

[23]  Yuanchun Shi,et al.  ChinAR: Facilitating Chinese Guqin Learning through Interactive Projected Augmentation , 2015, CCHI.

[24]  Stephen Chi-fai Chan,et al.  MelodicBrush: a novel system for cross-modal digital art creation linking calligraphy and music , 2012, DIS '12.

[25]  Ming C. Lin,et al.  Designing virtual instruments with touch-enabled interface , 2012, CHI Extended Abstracts.

[26]  Sotiris Manitsaris,et al.  A Natural User Interface for Gestural Expression and Emotional Elicitation to Access the Musical Intangible Cultural Heritage , 2018, ACM Journal on Computing and Cultural Heritage.

[27]  Emmanuel Dubois,et al.  Augmented reality: which augmentation for which reality? , 2000, DARE '00.

[28]  Bingjun Zhang,et al.  iDVT: an interactive digital violin tutoring system based on audio-visual fusion , 2008, ACM Multimedia.

[29]  Changlin Chen.  Preliminary application of the computer technique to GuQin music research , 2008, Journal of Computer Science and Technology.

[30]  Raimund Dachselt,et al.  ScaleDial: A Novel Tangible Device for Teaching Musical Scales & Triads , 2019, CHI Extended Abstracts.