Optical camera communications using dynamic vision sensor: A practical assessment

The "Silicon Retinas" or "Event Cameras" are bio-inspired technologies that revolutionize the acquisition of visual information by mimicking the neural architecture of the eye. These cameras respond asynchronously to changes in scene illumination at the pixel level, providing high-precision time information and low latency in the order of microseconds. In this work, we evaluate the capabilities of the DVS camera for various transmitter and receiver parameters. The results showed that, apart from the refractory period, which is the main limiting parameter in optical camera links, the performance of the optical communication system increases with lower offset irradiance values.

[1]  Bingpeng Zhou,et al.  A Visible Light Positioning System Based on a Particle Filter and Deep Learning , 2024, IEEE Transactions on Aerospace and Electronic Systems.

[2]  T. Delbrück,et al.  Shining light on the DVS pixel: A tutorial and discussion about biasing and optimization , 2023, 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[3]  Song Wang,et al.  Spike-Based Motion Estimation for Object Tracking Through Bio-Inspired Unsupervised Learning , 2022, IEEE Transactions on Image Processing.

[4]  R. Mahony,et al.  Smart Visual Beacons with Asynchronous Optical Communications using Event Cameras , 2022, 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[5]  Mostafa Zaman Chowdhury,et al.  Optical Camera Communication in Vehicular Applications: A Review , 2022, IEEE Transactions on Intelligent Transportation Systems.

[6]  R. Pérez-Jiménez,et al.  Optical Multispectral Camera Communications Using LED Spectral Emission Variations , 2021, IEEE Photonics Technology Letters.

[7]  Fredrik Tufvesson,et al.  6G Wireless Systems: Vision, Requirements, Challenges, Insights, and Opportunities , 2020, Proceedings of the IEEE.

[8]  Huajin Tang,et al.  Event-Based Neuromorphic Vision for Autonomous Driving: A Paradigm Shift for Bio-Inspired Visual Sensing and Perception , 2020, IEEE Signal Processing Magazine.

[9]  Jaime Roberto Ticay-Rivas,et al.  Characterization and Performance of a Thermal Camera Communication System , 2020, Sensors.

[10]  Davide Scaramuzza,et al.  Dynamic obstacle avoidance for quadrotors with event cameras , 2020, Science Robotics.

[11]  Chahat Deep Singh,et al.  EVDodgeNet: Deep Dynamic Obstacle Dodging with Event Cameras , 2019, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[12]  Hassnaa Moustafa,et al.  Optical Wireless Camera Communications using Neuromorphic Vision Sensors , 2019, 2019 IEEE International Conference on Communications Workshops (ICC Workshops).

[13]  Chiara Bartolozzi,et al.  Event-Based Vision: A Survey , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Hubert Konik,et al.  Characterization setup for event-based imagers applied to modulated light signal detection. , 2019, Applied optics.

[15]  Nick Barnes,et al.  Continuous-time Intensity Estimation Using Event Cameras , 2018, ACCV.

[16]  Tobi Delbrück,et al.  A Low Power, Fully Event-Based Gesture Recognition System , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  T. Delbruck,et al.  Temperature and Parasitic Photocurrent Effects in Dynamic Vision Sensors , 2017, IEEE Transactions on Electron Devices.

[18]  Yang Gao,et al.  End-to-End Learning of Driving Models from Large-Scale Video Datasets , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Tobi Delbruck,et al.  A 240 × 180 130 dB 3 µs Latency Global Shutter Spatiotemporal Vision Sensor , 2014, IEEE Journal of Solid-State Circuits.

[20]  Tobi Delbrück,et al.  Low-latency localization by active LED markers tracking using a dynamic vision sensor , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  Daniel Matolin,et al.  Sensitivity and uniformity of a 0.18µm CMOS temporal contrast pixel array , 2011, 2011 IEEE International Symposium of Circuits and Systems (ISCAS).

[22]  Yueyi Zhang,et al.  QISampling: An Effective Sampling Strategy for Event-Based Sign Language Recognition , 2023, IEEE Signal Processing Letters.

[23]  Tobi Delbrück,et al.  Neuromorophic vision sensing and processing , 2016, ESSCIRC.

[24]  C. Mead,et al.  Neuromorphic Robot Vision with Mixed Analog- Digital Architecture , 2005 .