Systems design and implementation with jerk-optimized trajectory generation for UAV calligraphy

Unmanned aerial vehicle (UAV) and Chinese calligraphy seem like two completely unrelated subjects in today’s world. UAV, as one of the most advanced technology to date, has gathered much attention lately due to its potentially unlimited applications. Contrarily, Chinese calligraphy is one of the most beautiful and ancient calligraphy art originally developed from China few thousand years ago. Today in this manuscript, we present to you the art of autonomous calligraphy writing with UAVs. The proposed UAV calligraphy system is able to trace the user handwritten inputs, and then execute the writing by mimicking the user handwriting with four autonomous UAVs. This manuscript details the design considerations and implementation process of such a system. The UAV calligraphy system was performed in Singapore Airshow 2014. Robustness and reliability of the system has been well tested, and high performance can be seen from the resulting calligraphy writing.

[1]  N. Roy,et al.  Polynomial Trajectory Planning for Quadrotor Flight , 2012 .

[2]  Hiroyuki Kano,et al.  A new approach to synthesizing free motions of robotic manipulators based on a concept of unit motions , 1995, IEEE Trans. Syst. Man Cybern..

[3]  Carl de Boor,et al.  A Practical Guide to Splines , 1978, Applied Mathematical Sciences.

[4]  Hiroyuki Fujioka,et al.  Optimal smoothing and interpolating splines with constraints , 2007, CDC.

[5]  Vaibhav Ghadiok,et al.  Autonomous indoor aerial gripping using a quadrotor , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Hsi-Jian Lee,et al.  A Bezier curve-based approach to shape description for Chinese calligraphy characters , 2001, Proceedings of Sixth International Conference on Document Analysis and Recognition.

[7]  Vijay Kumar,et al.  Minimum snap trajectory generation and control for quadrotors , 2011, 2011 IEEE International Conference on Robotics and Automation.

[8]  Yeung Yam,et al.  Stroke trajectory generation experiment for a robotic Chinese calligrapher using a geometric brush footprint model , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Raffaello D'Andrea,et al.  A computationally efficient algorithm for state-to-state quadrocopter trajectory generation and feasibility verification , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Etienne Burdet,et al.  A robotic teacher of Chinese handwriting , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[11]  Geovany de Araújo Borges,et al.  A split-and-merge segmentation algorithm for line extraction in 2D range images , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[12]  Horace Ho-Shing Ip,et al.  Virtual brush: a model-based synthesis of Chinese calligraphy , 2000, Comput. Graph..

[13]  Marc Pollefeys,et al.  Autonomous obstacle avoidance and maneuvering on a vision-guided MAV using on-board processing , 2011, 2011 IEEE International Conference on Robotics and Automation.

[14]  Marc Pollefeys,et al.  PIXHAWK: A micro aerial vehicle design for autonomous flight using onboard computer vision , 2012, Auton. Robots.

[15]  Kai-Yuan Cai,et al.  Quadrotor aircraft control without velocity measurements , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[16]  Nelson Siu-Hang Chu,et al.  Real-time painting with an expressive virtual Chinese brush , 2004, IEEE Computer Graphics and Applications.

[17]  Yeung Yam,et al.  Brush Footprint Acquisition and Preliminary Analysis for Chinese Calligraphy using a Robot Drawing Platform , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Claire J. Tomlin,et al.  Quadrotor Helicopter Trajectory Tracking Control , 2008 .

[19]  Fei Wang,et al.  UAV calligraphy , 2014, 11th IEEE International Conference on Control & Automation (ICCA).

[20]  Yunhe Pan,et al.  Automatic generation of artistic chinese calligraphy , 2004, IEEE Intelligent Systems.

[21]  Vijay Kumar,et al.  Trajectory Generation and Control for Precise Aggressive Maneuvers with Quadrotors , 2010, ISER.

[22]  Claire J. Tomlin,et al.  Quadrotor Helicopter Flight Dynamics and Control: Theory and Experiment , 2007 .

[23]  Yinan Cui,et al.  Multiple Air Robotics Indoor Testbed , 2012, 2012 24th Chinese Control and Decision Conference (CCDC).

[24]  Vijay Kumar,et al.  Recent advances in quadrotor capabilities , 2011, 2011 IEEE International Conference on Robotics and Automation.

[25]  J. V. R. Prasad,et al.  3D Minimum Fuel Route Planning and Path Generation for a Fuel Cell Powered UAV , 2014 .

[26]  Clyde F. Martin,et al.  Optimal curve fitting and smoothing using normalized uniform B-splines: a tool for studying complex systems , 2005, Appl. Math. Comput..

[27]  Marc Pollefeys,et al.  Vision-based autonomous mapping and exploration using a quadrotor MAV , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[28]  Stephen J. Wright,et al.  Numerical Optimization (Springer Series in Operations Research and Financial Engineering) , 2000 .

[29]  Fenghui Yao,et al.  Modeling of Ancient-style Chinese Character and Its Application to CCC Robot , 2006, 2006 IEEE International Conference on Networking, Sensing and Control.

[30]  Tong Heng Lee,et al.  Hard Disk Drive Servo Systems (Advances in Industrial Control) , 2006 .

[31]  Isaac Kaminer,et al.  A Computationally Efficient Approach to Trajectory Management for Coordinated Aerial Surveillance , 2013 .

[32]  Yasunari Shidama,et al.  Improved moving properties of an omnidirectional vehicle using stepping motor , 1997, Proceedings of the 36th IEEE Conference on Decision and Control.

[33]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[34]  Tong Heng Lee,et al.  Systematic Design and Implementation of a Micro Unmanned Quadrotor System , 2014 .

[35]  Jianqiang Yi,et al.  Extracting the trajectory of writing brush in Chinese character calligraphy , 2004, Eng. Appl. Artif. Intell..

[36]  Carmel Domshlak,et al.  Integrating Task and Motion Planning for Unmanned Aerial Vehicles , 2014 .

[37]  Qunsheng Peng,et al.  Realistic synthesis of cao shu of Chinese calligraphy , 2005, Comput. Graph..

[38]  Horace Ho-Shing Ip,et al.  Model-based analysis of Chinese calligraphy images , 2005, International Conference on Information Visualisation.

[39]  Marc Pollefeys,et al.  PIXHAWK: A system for autonomous flight using onboard computer vision , 2011, 2011 IEEE International Conference on Robotics and Automation.