Control-oriented modeling of flight demonstrations for quadrotors using higher-order statistics and dynamic movement primitives

In this paper, we present a novel method for parsing demonstrations, and further characterizing the segments as subactions which are easy to implement by low-level motion controllers. Demonstration data's attributes of Gaussianity and linearity are linked to teacher's control manners and intentions, and Hinich's Gaussian and linear tests with higher-order statistics are adopted for segmentation. Wigner spectrum tools are applied to locate the rhythmic phases. Having parsed the demonstration into segments based on the test results, segmental features are parametrically represented in different ways, among which dynamic movement primitives (DMPs) are used to unifiedly model the nonlinear and rhythmic segments. For the multi-dimensional demonstrations, rules of selecting suitable variables for characterization are presented for both linear and nonlinear cases. The adverse effects brought about by inter-axis couplings are discussed and recognized using heuristics. For the case of multiple demonstrations, three-leveled feature consistency problem is also addressed. The proposed techniques are integrated into a whole for learning from flight demonstrations, and evaluated in simulations by modeling a quadrotor's axial roll maneuver. Results show the effectiveness of our method.

[1]  Eleni P. Tsolaki Testing nonstationary time series for Gaussianity and linearity using the evolutionary bispectrum: An application to internet traffic data , 2008, Signal Process..

[2]  M. Hinich Testing for Gaussianity and Linearity of a Stationary Time Series. , 1982 .

[3]  Brett Browning,et al.  A survey of robot learning from demonstration , 2009, Robotics Auton. Syst..

[4]  Claire J. Tomlin,et al.  Precision flight control for a multi-vehicle quadrotor helicopter testbed , 2011 .

[5]  Justin Fackrell,et al.  Bispectral analysis of speech signals , 1997 .

[6]  Christopher G. Atkeson,et al.  Constructive Incremental Learning from Only Local Information , 1998, Neural Computation.

[7]  Michael I. Jordan,et al.  Sharing Features among Dynamical Systems with Beta Processes , 2009, NIPS.

[8]  Nina F. Thornhill,et al.  Diagnosis of poor control-loop performance using higher-order statistics , 2004, Autom..

[9]  Scott Niekum,et al.  Learning and generalization of complex tasks from unstructured demonstrations , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[11]  Alfred Hanssen,et al.  Improved bispectrum based tests for Gaussianity and linearity , 2009, Signal Process..

[12]  Jun Nakanishi,et al.  Learning Attractor Landscapes for Learning Motor Primitives , 2002, NIPS.

[13]  Michael I. Jordan,et al.  Bayesian Nonparametric Methods for Learning Markov Switching Processes , 2010, IEEE Signal Processing Magazine.