ChinAR: Facilitating Chinese Guqin Learning through Interactive Projected Augmentation

The Guqin, a seven-stringed fretless zither, is the most representative traditional musical instrument in China. However, the complexity of its unique notation and theory has severely limited its popularity in the modern world. With the goal of providing an easy and effective way of learning Guqin, we have created an interactive learning system called ChinAR which employs augmented reality. We have made three main contributions in this paper: (1) a systematic method to design for instrumental learning combing eastern and western musical concepts; (2) a primary validation of the effect of augmented reality in facilitating learning of the Chinese Guqin (3) a natural user interface for the learning system applying gesture detection. The result of user study shows our design is helpful in providing better learning experience and enhancing performance and memorization with markedly less time spent learning. This work shows how a new interface helps promote the use of heritage instruments and culture.

[1]  Marc Leman,et al.  Physical modeling of the guqin - a Chinese string instrument , 2006 .

[2]  Antonio Krüger,et al.  guitAR: supporting guitar learning through mobile projection , 2011, CHI Extended Abstracts.

[3]  James T. Enns,et al.  Attention and Visual Memory in Visualization and Computer Graphics , 2012, IEEE Transactions on Visualization and Computer Graphics.

[4]  Burkhard Wünsche,et al.  Music Education using Augmented Reality with a Head Mounted Display , 2013, AUIC.

[5]  Changlin Chen Preliminary application of the computer technique to GuQin music research , 2008, Journal of Computer Science and Technology.

[6]  David Hsu,et al.  Digital violin tutor: an integrated system for beginning violin learners , 2005, ACM Multimedia.

[7]  Wolfgang Schnotz,et al.  External and internal representations in the acquisition and use of knowledge: visualization effects on mental model construction , 2008 .

[8]  Katja Rogers,et al.  P.I.A.N.O.: Faster Piano Learning with Interactive Projection , 2014, ITS '14.

[9]  Scott Dirkse A survey of the development of sight-reading skills in instructional piano methods for average-age beginners and a sample primer-level sight-reading curriculum , 2009 .

[10]  Changle Zhou,et al.  Decomposition of reduced character of Chinese Guqin notation , 2010, 2010 IEEE International Conference on Intelligent Systems and Knowledge Engineering.

[11]  Siw Graabræk Nielsen,et al.  Self-regulating Learning Strategies in Instrumental Music Practice , 2001 .

[12]  Hiroshi Ishii,et al.  MirrorFugue iii: conjuring the recorded pianist , 2013, CHI Extended Abstracts.

[13]  Chen Changlin Preliminary application of the computer technique to GuQin music research , 1989 .

[14]  Carman Neustaedter,et al.  Autobiographical design in HCI research: designing and learning through use-it-yourself , 2012, DIS '12.