Artificial lateral line systems for feedback control of underwater robots

A lateral line system, consisting of arrays of flow-sensing neuromasts, allows fish and amphibians to probe their ambient environment and plays a vital role in their behaviors spanning predator/prey detection, schooling, rheotaxis, courtship and communication. The feats of biological lateral lines have inspired an increasing interest in engineering a similar sensing module for underwater robots and vehicles. Often known as artificial lateral lines, these sensors could potentially enable an underwater robot to detect and identify moving or stationary objects, and exploit ambient flow energy for efficient locomotion. Despite the advances made in this area, realizing a practical artificial lateral line still faces significant challenges in both signal processing and flow sensor fabrication. In this dissertation we describe our effort in developing signal processing methods for hydrodynamic object localization and tracking using an artificial lateral line (ALL). We consider two types of objects, a vibrating sphere and a non-vibrating cylinder, both of which are of interest in underwater applications. A vibrating sphere, known as a dipole source, is widely used in the study of biological lateral lines and it emulates the rhythmic body or fin movement. A non-vibrating cylinder (with unknown cross-section shape), on the other hand, represents a general moving or stationary object underwater with a 2D flow profile. First, a novel bio-inspired artificial lateral line system is proposed for underwater robots and vehicles by exploiting the inherent sensing capability of ionic polymer-metal composites (IPMCs). Analogous to its biological counterpart, the IPMC-based lateral line processes the sensor signals through a neural network, and we demonstrate the performance of this approach in the localization of a dipole source. Second, with an assumption of potential flows, we formulate nonlinear estimation problems for the localization and tracking of a dipole source based on analytical flow models, and propose and compare several algorithms for solving the problem. For the case of a moving cylinder, we use conformal mapping to represent a general cross-section profile, and explore the use of Kalman-filtering-type techniques in the tracking and size/shape estimation of the object. We have conducted extensive experiments to validate the developed algorithms with an artificial lateral line prototype made of millimeter-scale IPMC sensors, with sensor-to-sensor separation of 2 cm, which is determined through an optimization process based on the Cramer-Rao bound (CRB) analysis. Finally, we experimentally explore the use of IPMC sensors for estimating the hydrodynamic parameters involved in a Karman vortex street that is created by a stationary cylinder in a flow. We validate that the vortex shedding frequency, which can be extracted from the sensor signal, shows clear correlation with the flow speed and the obstacle size.

[1]  Jack Chen,et al.  Design and fabrication of artificial lateral line flow sensors , 2002 .

[2]  Yingchen Yang,et al.  Artificial lateral line canal for hydrodynamic detection , 2011 .

[3]  H. J.,et al.  Hydrodynamics , 1924, Nature.

[4]  K. Mohseni,et al.  A model of the lateral line of fish for vortex sensing , 2010, Bioinspiration & biomimetics.

[5]  W. Marsden I and J , 2012 .

[6]  Douglas L. Jones,et al.  Artificial lateral line with biomimetic neuromasts to emulate fish sensing , 2010, Bioinspiration & biomimetics.

[7]  Jeffrey H. Lang,et al.  Lateral-line inspired sensor arrays for navigation and object identification , 2011 .

[8]  J. Liao Neuromuscular control of trout swimming in a vortex street: implications for energy economy during the Kármán gait , 2004, Journal of Experimental Biology.

[9]  Jelle Atema,et al.  The importance of the lateral line in nocturnal predation of piscivorous catfish , 2004, Journal of Experimental Biology.

[10]  Sia Nemat-Nassera,et al.  Electromechanical response of ionic polymer-metal composites , 2000 .

[11]  Sheryl Coombs,et al.  Dipole source localization by mottled sculpin. I. Approach strategies , 1997, Journal of Comparative Physiology A.

[12]  Alvo Aabloo,et al.  Ionic polymer–metal composite mechanoelectrical transduction: review and perspectives , 2010 .

[13]  Lisa Mauck Weiland,et al.  Prediction of the ionic polymer transducer sensing of shear loading , 2011 .

[14]  Kamran Iqbal,et al.  An improved SPSA algorithm for system identification using fuzzy rules for training neural networks , 2011, Int. J. Autom. Comput..

[15]  Xiaobo Tan,et al.  A Control-Oriented and Physics-Based Model for Ionic Polymer--Metal Composite Actuators , 2008, IEEE/ASME Transactions on Mechatronics.

[16]  Douglas L. Jones,et al.  Distant touch hydrodynamic imaging with an artificial lateral line , 2006, Proceedings of the National Academy of Sciences.

[17]  G. Lauder,et al.  Fish Exploiting Vortices Decrease Muscle Activity , 2003, Science.

[18]  G. Batchelor,et al.  An Introduction to Fluid Dynamics , 1968 .

[19]  N Bouaynaya,et al.  Noninvasive breast tumor localization based on ultrawideband microwave backscatter , 2010, 2010 International Conference on Signal Processing and Communications (SPCOM).

[20]  Alvo Aabloo,et al.  Modeling the transduction of IPMC in 3D configurations , 2010, Smart Structures and Materials + Nondestructive Evaluation and Health Monitoring.

[21]  Mohsen Shahinpoor,et al.  Mechanoelectric effects in ionic gels , 2000 .

[22]  J. Leo van Hemmen,et al.  How stimulus shape affects lateral-line perception: analytical approach to analyze natural stimuli characteristics , 2010, Biological Cybernetics.

[23]  H. Bleckmann,et al.  Peripheral and central processing of lateral line information , 2008, Journal of Comparative Physiology A.

[24]  Xiaobo Tan,et al.  Modeling of Biomimetic Robotic Fish Propelled by An Ionic Polymer–Metal Composite Caudal Fin , 2010, IEEE/ASME Transactions on Mechatronics.

[25]  Sheryl Coombs,et al.  Smart Skins: Information Processing by Lateral Line Flow Sensors , 2001, Auton. Robots.

[26]  Maurizio Porfiri,et al.  Free-Locomotion of Underwater Vehicles Actuated by Ionic Polymer Metal Composites , 2010, IEEE/ASME Transactions on Mechatronics.

[27]  Sandhya Samarasinghe,et al.  Neural Networks for Applied Sciences and Engineering: From Fundamentals to Complex Pattern Recognition , 2006 .

[28]  Kamran Iqbal,et al.  A wavelet-based recurrent fuzzy neural network trained with stochastic optimization algorithm , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[29]  Jun S. Liu,et al.  Sequential Imputations and Bayesian Missing Data Problems , 1994 .

[30]  W.J. Li,et al.  Polymer MEMS actuators for underwater micromanipulation , 2004, IEEE/ASME Transactions on Mechatronics.

[31]  Xiaobo Tan,et al.  Underwater Tracking and Size-Estimation of a Moving Object Using an IPMC Artificial Lateral Line , 2012 .

[32]  Xiaobo Tan,et al.  Autonomous robotic fish as mobile sensor platforms: Challenges and potential solutions , 2011 .

[33]  C. Chiang,et al.  A MEMS-based Air Flow Sensor with a Free-standing Micro-cantilever Structure , 2007, Sensors.

[34]  Xiaobo Tan,et al.  Microfabrication of IPMC cilia for bio-inspired flow sensing , 2012, Smart Structures.

[35]  S. Kay Fundamentals of statistical signal processing: estimation theory , 1993 .

[36]  N A Schellart,et al.  Velocity- and acceleration-sensitive units in the trunk lateral line of the trout. , 1992, Journal of neurophysiology.

[37]  P. J. Green,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[38]  T. Pitcher,et al.  A blind fish can school. , 1976, Science.

[39]  L. Rosenhead Theoretical Hydrodynamics , 1960, Nature.

[40]  G. Krijnen,et al.  Dipole-source localization using biomimetic flow-sensor arrays positioned as lateral-line system , 2010 .

[41]  L. Fortuna,et al.  A model of ionic polymer–metal composite actuators in underwater operations , 2008 .

[42]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[43]  S. Coombs,et al.  Modeling and measuring lateral line excitation patterns to changing dipole source locations , 2004, Journal of Comparative Physiology A.

[44]  Xiaobo Tan,et al.  Modeling and Inverse Compensation of Temperature-Dependent Ionic Polymer–Metal Composite Sensor Dynamics , 2011, IEEE/ASME Transactions on Mechatronics.

[45]  Kam K. Leang,et al.  A Twistable Ionic Polymer-Metal Composite Artificial Muscle for Marine Applications , 2011 .

[46]  Maarja Kruusmaa,et al.  Hydrodynamic pressure sensing with an artificial lateral line in steady and unsteady flows , 2012, Bioinspiration & biomimetics.

[47]  Xiaobo Tan,et al.  Artificial lateral line-based localization of a dipole source with unknown vibration amplitude and direction , 2011, 2011 15th International Conference on Advanced Robotics (ICAR).

[48]  Lily D. Chambers,et al.  What information do Kármán streets offer to flow sensing? , 2011, Bioinspiration & biomimetics.

[49]  P. Sharma Mechanics of materials. , 2010, Technology and health care : official journal of the European Society for Engineering and Medicine.

[50]  Donald J. Leo,et al.  Hair cell sensing with encapsulated interface bilayers , 2011, Smart Structures and Materials + Nondestructive Evaluation and Health Monitoring.

[51]  W. Yim,et al.  An artificial muscle actuator for biomimetic underwater propulsors , 2007, Bioinspiration & biomimetics.

[52]  R. Cingolani,et al.  Stress-driven AlN cantilever-based flow sensor for fish lateral line system , 2011 .

[53]  M. Triantafyllou,et al.  Hydrodynamics of Fishlike Swimming , 2000 .

[54]  Iman Borazjani,et al.  On the hydrodynamics of fish schooling , 2013 .

[55]  Xiaobo Tan,et al.  Underwater source localization using an IPMC-based artificial lateral line , 2011, 2011 IEEE International Conference on Robotics and Automation.

[56]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[57]  Yantao Shen,et al.  Integrated sensing for ionic polymer–metal composite actuators using PVDF thin films , 2007 .

[58]  Chang Liu,et al.  Micromachined biomimetic artificial haircell sensors , 2007, Bioinspiration & biomimetics.

[59]  Gabriel Weymouth,et al.  Hydrodynamic object recognition using pressure sensing , 2011, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[60]  Guo-Hua Feng,et al.  Fabrication and characterization of arbitrary shaped μIPMC transducers for accurately controlled biomedical applications , 2008 .

[61]  G. G. Stokes On the Effect of the Internal Friction of Fluids on the Motion of Pendulums , 2009 .

[62]  Xiaobo Tan,et al.  A dynamic model for ionic polymer–metal composite sensors , 2007 .

[63]  E. Jacobsen,et al.  The sliding DFT , 2003, IEEE Signal Process. Mag..

[64]  Xiaobo Tan,et al.  Monolithic fabrication of ionic polymer–metal composite actuators capable of complex deformation , 2010 .

[65]  A. Emery,et al.  Optimal experiment design , 1998 .

[66]  El-S. Hassan Mathematical description of the stimuli to the lateral line system of fish derived from a three-dimensional flow field analysis , 2004, Biological Cybernetics.

[67]  Barbar J. Akle,et al.  High-strain ionomeric–ionic liquid electroactive actuators , 2006 .

[68]  J. Liao,et al.  A review of fish swimming mechanics and behaviour in altered flows , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[69]  Luigi Fortuna,et al.  A model for ionic polymer metal composites as sensors , 2006 .

[70]  Maurizio Porfiri,et al.  Charge dynamics in ionic polymer metal composites , 2008 .

[71]  Kamran Iqbal,et al.  Reduced order modeling using genetic-fuzzy algorithm , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[72]  Zhi-Wei Luo,et al.  An analysis of the increase of bending response in IPMC dynamics given uniform input , 2006, SPIE Smart Structures and Materials + Nondestructive Evaluation and Health Monitoring.

[73]  Khalil Najafi,et al.  Micro-hydraulic structure for high performance bio-mimetic air flow sensor arrays , 2011, 2011 International Electron Devices Meeting.

[74]  Sheryl Coombs,et al.  Information Processing by the Lateral Line System , 2003 .

[75]  Xiaobo Tan,et al.  An artificial lateral line system using IPMC sensor arrays , 2012 .

[76]  El-S. Hassan,et al.  Mathematical analysis of the stimulus for the lateral line organ , 1985, Biological Cybernetics.

[77]  Isao Shimoyama,et al.  An air flow sensor modeled on wind receptor hairs of insects , 2000, Proceedings IEEE Thirteenth Annual International Conference on Micro Electro Mechanical Systems (Cat. No.00CH36308).

[78]  Douglas L. Jones,et al.  Multisensor Processing Algorithms for Underwater Dipole Localization and Tracking Using MEMS Artificial Lateral-Line Sensors , 2006, EURASIP J. Adv. Signal Process..

[79]  M. Porfiri,et al.  Energy harvesting from base excitation of ionic polymer metal composites in fluid environments , 2009 .

[80]  Sietse M van Netten,et al.  Source location encoding in the fish lateral line canal , 2006, Journal of Experimental Biology.

[81]  S. Coombs,et al.  Biologically inspired design of hydrogel-capped hair sensors for enhanced underwater flow detection , 2009 .

[82]  Shane P Windsor,et al.  Swimming kinematics and hydrodynamic imaging in the blind Mexican cave fish (Astyanax fasciatus) , 2008, Journal of Experimental Biology.

[83]  Ad. J. Kalmijn,et al.  Hydrodynamic and Acoustic Field Detection , 1988 .

[84]  A. W. M. van den Enden,et al.  Discrete Time Signal Processing , 1989 .

[85]  El-S. Hassan,et al.  Mathematical description of the stimuli to the lateral line system of fish, derived from a three-dimensional flow field analysis. III. The case of an oscillating sphere near the fish , 1993, Biological Cybernetics.

[86]  Kinji Asaka,et al.  Development of a Rajiform Swimming Robot using Ionic Polymer Artificial Muscles , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[87]  Jelle Atema,et al.  Sharks need the lateral line to locate odor sources: rheotaxis and eddy chemotaxis , 2007, Journal of Experimental Biology.

[88]  Xiaobo Tan,et al.  Localization of source with unknown amplitude using IPMC sensor arrays , 2011, Smart Structures and Materials + Nondestructive Evaluation and Health Monitoring.

[89]  Douglas L. Jones,et al.  Flow Vision for Autonomous Underwater Vehicles via an Artificial Lateral Line , 2011, EURASIP J. Adv. Signal Process..