Synchronizing the motion of a quadrocopter to music

This paper presents a quadrocopter flying in rhythm to music. The quadrocopter performs a periodic side-to-side motion in time to a musical beat. Underlying controllers are designed that stabilize the vehicle and produce a swinging motion. Synchronization is then achieved by using concepts from phase-locked loops. A phase comparator combined with a correction algorithm eliminate the phase error between the music reference and the actual quadrocopter motion. Experimental results show fast and effective synchronization that is robust to sudden changes in the reference amplitude and frequency. Changes in frequency and amplitude are tracked precisely when adding an additional feedforward component, based on an experimentally determined look-up table.

[1]  Guan-Chyun Hsieh,et al.  Phase-locked loop techniques. A survey , 1996, IEEE Trans. Ind. Electron..

[2]  P. N. Paraskevopoulos,et al.  Modern Control Engineering , 2001 .

[3]  Stefan Schaal,et al.  Rapid synchronization and accurate phase-locking of rhythmic motor primitives , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Changjiu Zhou,et al.  Neural Oscillator for Rhythmic Motion Control of Biped Robot , 2008, 2008 International Conference on Signal Processing, Communications and Networking.

[5]  Kazuhiro Kosuge,et al.  Cheek to Chip: Dancing Robots and AI's Future , 2008, IEEE Intelligent Systems.

[6]  Dong Sun,et al.  Adaptive synchronized control for coordination of multirobot assembly tasks , 2002, IEEE Trans. Robotics Autom..

[7]  Raffaello D'Andrea,et al.  A simple learning strategy for high-speed quadrocopter multi-flips , 2010, 2010 IEEE International Conference on Robotics and Automation.

[8]  Yan Wang,et al.  Motion Control of a Dancing Character with Music , 2007, 6th IEEE/ACIS International Conference on Computer and Information Science (ICIS 2007).

[9]  William F. Egan,et al.  Phase-Lock Basics , 1998 .

[10]  Raffaello D'Andrea,et al.  Autonomous quadrotor flight using a vision system and accommodating frames misalignment , 2009, 2009 IEEE International Symposium on Industrial Embedded Systems.

[11]  Brian Scassellati,et al.  Synchronization in Social Tasks: Robotic Drumming , 2006, ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication.

[12]  Marek P. Michalowski,et al.  A dancing robot for rhythmic social interaction , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[13]  Shinya Kotosaka,et al.  Synchronized Robot Drumming by Neural Oscillator , 2001 .

[14]  Tetsuya Ogata,et al.  A biped robot that keeps steps in time with musical beats while listening to music with its own ears , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Kazuhiro Kosuge,et al.  Dance partner robot - Ms DanceR , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[16]  J. Borenstein,et al.  Cross-coupling motion controller for mobile robots , 1993, IEEE Control Systems.

[17]  Yoram Koren,et al.  Cross-Coupled Biaxial Computer Control for Manufacturing Systems , 1980 .

[18]  Gerd Hirzinger,et al.  Energy-efficient Autonomous Four-rotor Flying Robot Controlled at 1 kHz , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[19]  Jinjun Shan,et al.  Adaptive Synchronization Control of Multiple Spacecraft Formation Flying , 2007 .

[20]  Masayoshi Tomizuka,et al.  Synchronization of Two Motion Control Axes Under Adaptive Feedforward Control , 1990 .

[21]  Sung Yong Shin,et al.  Rhythmic-motion synthesis based on motion-beat analysis , 2003, ACM Trans. Graph..

[22]  B. Bethke,et al.  Real-time indoor autonomous vehicle test environment , 2008, IEEE Control Systems.

[23]  Kazuyoshi Yoshii,et al.  A Robot Singer with Music Recognition Based on Real-Time Beat Tracking , 2008, ISMIR.

[24]  Kazuyoshi Yoshii,et al.  A robot uses its own microphone to synchronize its steps to musical beats while scatting and singing , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  James K. Mills,et al.  Trajectory Tracking Control for a 3-DOF Planar Parallel Manipulator Using the Convex Synchronized Control Method , 2008, IEEE Transactions on Control Systems Technology.