STAMPER: Human-machine Integrated Drumming

STAMPER enables drummers to generate innovative performances by controlling multiple bass drums. STAMPER consists of several “Actuated Pedals (APs),” bass drum pedals embedded with an EC motor, paired with bass drums, and a machine vision system. The APs are used both as input and output. One AP in input mode senses the position of the pedal being used by the drummer. Other APs in actuated mode respond to the input mode AP’s motion. Machine vision is used to monitor the drummer’s movements to control the behavior of the actuated APs. In this paper, we describe the current prototype of STAMPER and what kind of drum performances can be achieved with the system by reporting a study conducted with an experienced drummer.

[1]  M. Inami,et al.  Social Digital Cyborgs: The Collaborative Design Process of JIZAI ARMS , 2023, CHI.

[2]  M. Inami,et al.  Machine-Mediated Teaming: Mixture of Human and Machine in Physical Gaming Experience , 2022, CHI.

[3]  M. Inami,et al.  Cyborgs, Human Augmentation, Cybernetics, and JIZAI Body , 2022, AHs.

[4]  Jun Rekimoto,et al.  Human Augmentation for Skill Acquisition and Skill Transfer , 2021, CHI Extended Abstracts.

[5]  Pedro Lopes,et al.  Do Cyborgs dream of Electric Limbs? Experiential Factors in Human-Computer Integration Design and Evaluation , 2021, CHI Extended Abstracts.

[6]  Sang-won Leigh,et al.  A Study on Learning Advanced Skills on Co-Playable Robotic Instruments , 2021, NIME.

[7]  Atsushi Hiyama,et al.  Dynamic Motor Skill Synthesis with Human-Machine Mutual Actuation , 2020, CHI.

[8]  Wendy Ju,et al.  Next Steps for Human-Computer Integration , 2020, CHI.

[9]  Pedro Lopes,et al.  Preemptive Action: Accelerating Human Reaction using Electrical Muscle Stimulation Without Compromising Agency , 2019, CHI.

[10]  Scott Barton,et al.  Cyther: a human-playable, self-tuning robotic zither , 2017, NIME.

[11]  Jun Rekimoto,et al.  Superhuman Sports: Applying Human Augmentation to Physical Exercise , 2017, IEEE Pervasive Computing.

[12]  Mason Bretan,et al.  A Robotic Prosthesis for an Amputee Drummer , 2016, ArXiv.

[13]  William Singhose,et al.  User oriented assessment of vibration suppression by command shaping in a supernumerary wearable robotic arm , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[14]  H. Harry Asada,et al.  Bracing the human body with supernumerary Robotic Limbs for physical assistance and load reduction , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[15]  Andrew P. McPherson,et al.  The Magnetic Resonator Piano: Electronic Augmentation of an Acoustic Grand Piano , 2010 .

[16]  Gil Weinberg,et al.  Toward Robotic Musicianship , 2006, Computer Music Journal.