Set-Point Regulation of Linear Continuous-Time Systems using Neuromorphic Vision Sensors

Recently developed neuromorphic vision sensors have become promising candidates for agile and autonomous robotic applications primarily due to, in particular, their high temporal resolution and low latency. Each pixel of this sensor independently fires an asynchronous stream of "retinal events" once a change in the light field is detected. Existing computer vision algorithms can only process periodic frames and so a new class of algorithms needs to be developed that can efficiently process these events for control tasks. In this paper, we investigate the problem of regulating a continuous-time linear time invariant (LTI) system to a desired point using measurements from a neuromorphic sensor. We present an $H_\infty$ controller that regulates the LTI system to a desired set-point and provide the set of neuromorphic sensor based cameras for the given system that fulfill the regulation task. The effectiveness of our approach is illustrated on an unstable system.

[1]  Daniel Liberzon,et al.  Stabilizing uncertain systems with dynamic quantization , 2008, 2008 47th IEEE Conference on Decision and Control.

[2]  P. Khargonekar,et al.  State-space solutions to standard H/sub 2/ and H/sub infinity / control problems , 1989 .

[3]  Andrea Censi.  Efficient neuromorphic optomotor heading regulation , 2015, 2015 American Control Conference (ACC).

[4]  Russ Tedrake,et al.  Pushbroom stereo for high-speed navigation in cluttered environments , 2014, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[5]  Shih-Chii Liu,et al.  Neuromorphic sensory systems , 2010, Current Opinion in Neurobiology.

[6]  P. Khargonekar,et al.  State-space solutions to standard H2 and H∞ control problems , 1988, 1988 American Control Conference.

[7]  Christian Stöcker,et al.  Event-Based Control , 2014 .

[8]  Tobi Delbruck,et al.  Robotic goalie with 3 ms reaction time at 4% CPU load using event-based dynamic vision sensor , 2013, Front. Neurosci..

[9]  Emilio Frazzoli,et al.  Stabilization of linear continuous-time systems using neuromorphic vision sensors , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[10]  J. Doyle,et al.  Linear, Multivariable Robust Control With a μ Perspective , 1993 .

[11]  T. Delbruck,et al.  > Replace This Line with Your Paper Identification Number (double-click Here to Edit) < 1 , 2022 .

[12]  Tobi Delbrück,et al.  A pencil balancing robot using a pair of AER dynamic vision sensors , 2009, 2009 IEEE International Symposium on Circuits and Systems.

[13]  Kevin Y. Ma,et al.  Controlling free flight of a robotic fly using an onboard vision sensor inspired by insect ocelli , 2014, Journal of The Royal Society Interface.

[14]  R. Sanfelice,et al.  Hybrid dynamical systems , 2009, IEEE Control Systems.

[15]  A. Bicchi,et al.  Hypercubes are minimal controlled invariants for discrete-time linear systems with quantized scalar input , 2008 .

[16]  Lihua Xie,et al.  The sector bound approach to quantized feedback control , 2005, IEEE Transactions on Automatic Control.

[17]  Tobi Delbrück,et al.  A 128$\times$ 128 120 dB 15 $\mu$s Latency Asynchronous Temporal Contrast Vision Sensor , 2008, IEEE Journal of Solid-State Circuits.

[18]  Emilio Frazzoli,et al.  Asymptotically reachable states and related symmetry in systems theory , 2015, 2015 American Control Conference (ACC).

[19]  Nicola Elia,et al.  Stabilization of linear systems with limited information , 2001, IEEE Trans. Autom. Control..