A Review and Perspective on Optical Phased Array for Automotive LiDAR

This paper aims to review the state of the art of Light Detection and Ranging (LiDAR) sensors for automotive applications, and particularly for automated vehicles, focusing on recent advances in the field of integrated LiDAR, and one of its key components: the Optical Phased Array (OPA). LiDAR is still a sensor that divides the automotive community, with several automotive companies investing in it, and some companies stating that LiDAR is a ‘useless appendix’. However, currently there is not a single sensor technology able to robustly and completely support automated navigation. Therefore, LiDAR, with its capability to map in 3 dimensions (3D) the vehicle surroundings, is a strong candidate to support Automated Vehicles (AVs). This manuscript highlights current AV sensor challenges, and it analyses the strengths and weaknesses of the perception sensor currently deployed. Then, the manuscript discusses the main LiDAR technologies emerging in automotive, and focuses on integrated LiDAR, challenges associated with light beam steering on a chip, the use of Optical Phased Arrays, finally discussing current factors hindering the affirmation of silicon photonics OPAs and their future research directions.

[1]  Arthur A. Oliner,et al.  Phased array antennas , 1972 .

[2]  Yongwan Park,et al.  Design and implementation of 3D LIDAR based on pixel-by-pixel scanning and DS-OCDMA , 2017, OPTO.

[3]  M. Watts,et al.  Unidirectional waveguide grating antennas with uniform emission for optical phased arrays. , 2017, Optics letters.

[4]  L. Coldren,et al.  Hybrid III/V silicon photonic source with integrated 1D free-space beam steering. , 2012, Optics letters.

[5]  David Pogue,et al.  Hail, Robo-Taxi. , 2016, Scientific American.

[6]  E. Timurdogan,et al.  Monolithically integrated erbium-doped tunable laser on a CMOS-compatible silicon photonics platform. , 2018, Optics express.

[7]  David B. Cole,et al.  Coherent solid-state LIDAR with silicon photonic optical phased arrays. , 2017, Optics letters.

[8]  D. Kunze,et al.  Large deflection micromechanical scanning mirrors for linear scans and pattern generation , 2000, IEEE Journal of Selected Topics in Quantum Electronics.

[9]  S. J. B. Yoo,et al.  Hybrid 3D photonic integrated circuit for optical phased array beam steering , 2015, 2015 Conference on Lasers and Electro-Optics (CLEO).

[10]  F. Vasey,et al.  Spatial optical beam steerin with an AlGaAs integrated phased array. , 1993, Applied optics.

[11]  Werner Ritter,et al.  A Benchmark for Lidar Sensors in Fog: Is Detection Breaking Down? , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[12]  Ray T. Chen,et al.  1 × 12 Unequally spaced waveguide array for actively tuned optical phased array on a silicon nanomembrane , 2011 .

[13]  Kevin Fu,et al.  Adversarial Sensor Attack on LiDAR-based Perception in Autonomous Driving , 2019, CCS.

[14]  W. Bogaerts,et al.  Two-Dimensional Dispersive Off-Chip Beam Scanner Fabricated on Silicon-On-Insulator , 2011, IEEE Photonics Technology Letters.

[15]  Hao Jiang,et al.  Recent development of automotive LiDAR technology, industry and trends , 2019, International Conference on Digital Image Processing.

[16]  Mial E Warren,et al.  Automotive LIDAR Technology , 2019, 2019 Symposium on VLSI Circuits.

[17]  R. Soref,et al.  The Past, Present, and Future of Silicon Photonics , 2006, IEEE Journal of Selected Topics in Quantum Electronics.

[18]  Edward A. Watson,et al.  Optical phased array technology , 1996, Proc. IEEE.

[19]  Pawel Pawlowski,et al.  Pedestrian detection by video processing in automotive night vision system , 2014, 2014 Signal Processing: Algorithms, Architectures, Arrangements, and Applications (SPA).

[20]  Zygmunt Mierczyk,et al.  Comparison of 905 nm and 1550 nm semiconductor laser rangefinders’ performance deterioration due to adverse environmental conditions , 2014 .

[21]  Lukas Chrostowski,et al.  Study of waveguide crosstalk in silicon photonics integrated circuits , 2013, Other Conferences.

[22]  Daniel D. Lee,et al.  Little Ben: The Ben Franklin Racing Team's entry in the 2007 DARPA Urban Challenge , 2008, J. Field Robotics.

[23]  R. Soref.  Mid-infrared photonics in silicon and germanium , 2010 .

[24]  Alan Naughton,et al.  Photonic Integrated Circuit-Based FMCW Coherent LiDAR , 2018, Journal of Lightwave Technology.

[25]  Douglas B. Leviton,et al.  Temperature-dependent refractive index of silicon and germanium , 2006, SPIE Astronomical Telescopes + Instrumentation.

[26]  Wim Bogaerts.  Design challenges in large-scale silicon photonics , 2013, 2013 13th International Conference on Numerical Simulation of Optoelectronic Devices (NUSOD).

[27]  M. Heck.  Highly integrated optical phased arrays: photonic integrated circuits for optical beam shaping and beam steering , 2017 .

[28]  Ray T. Chen,et al.  On-chip silicon optical phased array for two-dimensional beam steering. , 2014, Optics letters.

[29]  Yang Wang,et al.  2×2 silicon integrated optical phased array for beam steering applications , 2015, 2015 International Topical Meeting on Microwave Photonics (MWP).

[30]  M. Skolnik,et al.  Introduction to Radar Systems , 2021, Advances in Adaptive Radar Detection and Range Estimation.

[31]  Liam Kilmartin,et al.  Intra-Vehicle Networks: A Review , 2015, IEEE Transactions on Intelligent Transportation Systems.

[32]  Hans-Joachim Wünsche,et al.  Heterogeneous multi-sensor fusion for extended objects in automotive scenarios using Gaussian processes and a GMPHD-filter , 2017, 2017 Sensor Data Fusion: Trends, Solutions, Applications (SDF).

[33]  Luc van Dijk,et al.  Functional Safety for Automotive Ethernet Networks , 2018 .

[34]  Ana M. Sánchez,et al.  Silicon Nitride Photonic Integration Platforms for Visible, Near-Infrared and Mid-Infrared Applications , 2017, Sensors.

[35]  Hossein Hashemi,et al.  A Monolithically Integrated Large-Scale Optical Phased Array in Silicon-on-Insulator CMOS , 2018, IEEE Journal of Solid-State Circuits.

[36]  Matti Kutila,et al.  Testing and Validation of Automotive Point-Cloud Sensors in Adverse Weather Conditions , 2019, Applied Sciences.

[37]  José Azaña,et al.  Optical signal processing based on silicon photonics waveguide Bragg gratings: review , 2018, Frontiers of Optoelectronics.

[38]  Ali Hajimiri,et al.  A Nonuniform Sparse 2-D Large-FOV Optical Phased Array With a Low-Power PWM Drive , 2019, IEEE Journal of Solid-State Circuits.

[39]  Chao Li,et al.  Review of Silicon Photonics Foundry Efforts , 2014, IEEE Journal of Selected Topics in Quantum Electronics.

[40]  Lei Qiao,et al.  32 × 32 silicon electro-optic switch with built-in monitors and balanced-status units , 2017, Scientific Reports.

[41]  Werner Ritter,et al.  DENSE: Environment Perception in Bad Weather—First Results , 2019, Electronic Components and Systems for Automotive Applications.

[42]  M. Watts,et al.  Integrated phased array for wide-angle beam steering. , 2014, Optics letters.

[43]  Hermann Winner,et al.  Handbook of Driver Assistance Systems: Basic Information, Components and Systems for Active Safety and Comfort , 2015 .

[44]  Guo-Qiang Lo,et al.  High efficiency silicon nitride grating coupler with DBR , 2014, OFC 2014.

[45]  J. Bowers,et al.  A Widely-Tunable High-SMSR Narrow-Linewidth Laser Heterogeneously Integrated on Silicon , 2018, 2018 Conference on Lasers and Electro-Optics (CLEO).

[46]  M. Lipson.  Guiding, modulating, and emitting light on Silicon-challenges and opportunities , 2005, Journal of Lightwave Technology.

[47]  Zhijuan Hu,et al.  High speed and low side lobe optical phased array steering by phase correction technique , 2013, Optics & Photonics - Optical Engineering + Applications.

[48]  Luiz Velho,et al.  Kinect and RGBD Images: Challenges and Applications , 2012, 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images Tutorials.

[49]  L. Coldren,et al.  Two-dimensional free-space beam steering with an optical phased array on silicon-on-insulator. , 2011, Optics express.

[50]  Vivek Agarwal,et al.  A Cost-Effective Ultrasonic Sensor-Based Driver-Assistance System for Congested Traffic Conditions , 2009, IEEE Transactions on Intelligent Transportation Systems.

[51]  V. Winkler,et al.  Range Doppler detection for automotive FMCW radars , 2007, 2007 European Radar Conference.

[52]  L. Coldren,et al.  Fully integrated hybrid silicon two dimensional beam scanner. , 2015, Optics express.

[53]  Holger H. Meinel,et al.  Evolving automotive radar — From the very beginnings into the future , 2014, The 8th European Conference on Antennas and Propagation (EuCAP 2014).

[54]  Philip Koopman,et al.  Safety Argument Considerations for Public Road Testing of Autonomous Vehicles , 2019, SAE Technical Paper Series.

[55]  Hossein Hashemi,et al.  Monolithic optical phased-array transceiver in a standard SOI CMOS process. , 2015, Optics express.

[56]  Jonathan David Weinberg,et al.  Applications and Field Testing of a Flash LIDAR System for Future Planetary Missions , 2009 .

[57]  Jong-Hun Lee,et al.  A meothod for multi-target range and velocity detection in automotive FMCW radar , 2009, 2009 12th International IEEE Conference on Intelligent Transportation Systems.

[58]  Ali Hajimiri,et al.  Nanophotonic projection system. , 2015, Optics express.

[59]  S. J. Ben Yoo,et al.  Sub-Wavelength-Pitch Silicon-Phatonic Optical Phased Array for Large Field-AF-Regard Coherent Optical Beam Steering , 2018, ECOC.

[60]  Wenfu Zhang,et al.  Si Photonics for Practical LiDAR Solutions , 2019, Applied Sciences.

[61]  Linjie Zhou,et al.  Aliasing-free optical phased array beam-steering with a plateau envelope. , 2019, Optics express.

[62]  Patrick Held,et al.  Automotive Radar Multipath Propagation in Uncertain Environments , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[63]  J. Hecht.  Lidar for Self-Driving Cars , 2018 .

[64]  J. Bowers,et al.  III‐V/silicon photonics for on‐chip and intra‐chip optical interconnects , 2010 .

[65]  Patrik Kamencay,et al.  Improved Depth Map Estimation from Stereo Images based on Hybrid Method , 2012 .

[66]  Georg Schitter,et al.  MEMS-based lidar for autonomous driving , 2018, Elektrotech. Informationstechnik.

[67]  Matti Kutila,et al.  Automotive LiDAR performance verification in fog and rain , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[68]  L. Chrostowski,et al.  Silicon Photonics Design: From Devices to Systems , 2015 .

[69]  David H Sliney,et al.  Maximum permissible exposures for ocular safety (ANSI 2000), with emphasis on ophthalmic devices. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[70]  Caglar Ataman,et al.  A dual-axis pointing mirror with moving-magnet actuation , 2013 .

[71]  Nidhi Kalra,et al.  Driving to Safety , 2016 .

[72]  Timo Aalto,et al.  Open-Access Silicon Photonics Platforms in Europe , 2019, IEEE Journal of Selected Topics in Quantum Electronics.

[73]  F. Bernardin,et al.  Light Transmission in Fog: The Influence of Wavelength on the Extinction Coefficient , 2019, Applied Sciences.

[74]  Antoni Rogalski,et al.  Infrared devices and techniques , 2017 .

[75]  Yu Zhang,et al.  High-Density Wafer-Scale 3-D Silicon-Photonic Integrated Circuits , 2018, IEEE Journal of Selected Topics in Quantum Electronics.

[76]  Michael R. Watts,et al.  CMOS-Compatible Optical Phased Array Powered by a Monolithically-Integrated Erbium Laser , 2019, Journal of Lightwave Technology.

[77]  Corneliu I. Rablau,et al.  Lidar: a new self-driving vehicle for introducing optics to broader engineering and non-engineering audiences , 2019, Fifteenth Conference on Education and Training in Optics and Photonics: ETOP 2019.

[78]  Priya Hosur,et al.  Environmental awareness around vehicle using ultrasonic sensors , 2016, 2016 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[79]  Tin Komljenovic,et al.  Sparse aperiodic arrays for optical beam forming and LIDAR. , 2017, Optics express.

[80]  Steven A. Miller,et al.  512-Element Actively Steered Silicon Phased Array for Low-Power LIDAR , 2018, 2018 Conference on Lasers and Electro-Optics (CLEO).

[81]  Hugues Talbot,et al.  Bayer bilateral denoising on TriMedia3270 , 2009, Electronic Imaging.

[82]  Jeremy Witzens,et al.  High-Speed Silicon Photonics Modulators , 2018, Proceedings of the IEEE.

[83]  Erwin Biebl,et al.  A machine learning joint lidar and radar classification system in urban automotive scenarios , 2019 .

[84]  David N. Whiteman,et al.  Use of rotational Raman measurements in multiwavelength aerosol lidar for evaluation of particle backscattering and extinction , 2015 .

[85]  Peter J. Roberts,et al.  Accessed from , 2022 .

[86]  Ranjeet Kumar,et al.  High-resolution aliasing-free optical beam steering , 2016 .

[87]  Taehwan Kim,et al.  Fully Integrated Coherent LiDAR in 3D-Integrated Silicon Photonics/65nm CMOS , 2019, 2019 Symposium on VLSI Circuits.

[88]  Geert Morthier,et al.  Novel Light Source Integration Approaches for Silicon Photonics , 2017 .

[89]  Christopher Vincent Poulton,et al.  Integrated LIDAR with optical phased arrays in silicon photonics , 2016 .

[90]  L. A. Coldren,et al.  Two-Dimensional Optical Beam Steering With InP-Based Photonic Integrated Circuits , 2013, IEEE Journal of Selected Topics in Quantum Electronics.

[91]  W. Bogaerts,et al.  One-Dimensional Off-Chip Beam Steering and Shaping Using Optical Phased Arrays on Silicon-on-Insulator , 2011, Journal of Lightwave Technology.

[93]  Michal Lipson,et al.  Silicon Optical Phased Array with High-Efficiency Beam Formation over 180 Degree Field of View , 2018 .

[94]  Michael R. Watts,et al.  A Single-Chip Optical Phased Array in a Wafer-Scale Silicon Photonics/CMOS 3D-Integration Platform , 2019, IEEE Journal of Solid-State Circuits.

[95]  Michael Hochberg,et al.  Towards fabless silicon photonics , 2010 .

[96]  Xian Xiao,et al.  Uniform emission, constant wavevector silicon grating surface emitter for beam steering with ultra-sharp instantaneous field-of-view. , 2017, Optics Express.

[97]  John R. Spletzer,et al.  Little Ben: The Ben Franklin Racing Team's entry in the 2007 DARPA Urban Challenge , 2008 .

[98]  Jie Sun,et al.  Two-dimensional apodized silicon photonic phased arrays. , 2014, Optics letters.

[99]  Jong-Hun Lee,et al.  A Pedestrian Detection Scheme Using a Coherent Phase Difference Method Based on 2D Range-Doppler FMCW Radar , 2016, Sensors.

[100]  R. Baets,et al.  Off-chip beam steering with a one-dimensional optical phased array on silicon-on-insulator. , 2009, Optics letters.

[101]  Matthew J. Byrd,et al.  Large-scale silicon nitride nanophotonic phased arrays at infrared and visible wavelengths. , 2017, Optics letters.

[102]  Y. Urino,et al.  Photonics-Electronics Convergence System for High Density Inter-Chip Interconnects by Using Silicon Photonics , 2012, 2012 IEEE Compound Semiconductor Integrated Circuit Symposium (CSICS).

[103]  Michael R. Watts,et al.  High-Performance Integrated Optical Phased Arrays for Chip-Scale Beam Steering and LiDAR , 2018, CLEO 2018.

[104]  Bertrand Szelag,et al.  SiN integrated optical phased arrays for two-dimensional beam steering at a single near-infrared wavelength. , 2019, Optics express.

[105]  J. Tarel,et al.  All-Weather Vision for Automotive Safety: Which Spectral Band? , 2016, Advanced Microsystems for Automotive Applications 2018.

[106]  S. T. Fard,et al.  Silicon-on-insulator sensors using integrated resonance-enhanced defect-mediated photodetectors. , 2014, Optics express.

[107]  Lukas Chrostowski,et al.  Design and fabrication of SOI micro-ring resonators based on sub-wavelength grating waveguides. , 2015, Optics express.

[108]  Pak Hung Chan,et al.  A Framework to Analyze Noise Factors of Automotive Perception Sensors , 2020, IEEE Sensors Letters.

[109]  Zheng You,et al.  5 V Compatible Two-Axis PZT Driven MEMS Scanning Mirror with Mechanical Leverage Structure for Miniature LiDAR Application , 2017, Sensors.

[110]  Santiago Royo,et al.  An Overview of Lidar Imaging Systems for Autonomous Vehicles , 2019, Applied Sciences.

[111]  Matthew J. Byrd,et al.  Long-Range LiDAR and Free-Space Data Communication With High-Performance Optical Phased Arrays , 2019, IEEE Journal of Selected Topics in Quantum Electronics.

[112]  Коэцу Саито.  The ultrasonic sensor , 2007 .

[113]  Thomas H. Bradley,et al.  Advanced Driver-Assistance Systems: A Path Toward Autonomous Vehicles , 2018, IEEE Consumer Electronics Magazine.

[114]  Michael R. Watts,et al.  Large-scale nanophotonic phased array , 2013, Nature.

[115]  Hung-Pang Lin,et al.  Nighttime vehicle detection and tracking base on spatiotemporal analysis using RCCC sensor , 2017, 2017IEEE 9th International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment and Management (HNICEM).

[116]  Angelos Amditis,et al.  Sensor Fusion for Predicting Vehicles' Path for Collision Avoidance Systems , 2007, IEEE Transactions on Intelligent Transportation Systems.

[117]  Valentina Donzella,et al.  Advances in Silicon Photonic Sensors Using Sub-Wavelength Gratings , 2019, 2019 24th OptoElectronics and Communications Conference (OECC) and 2019 International Conference on Photonics in Switching and Computing (PSC).

[118]  Richard Jones,et al.  Heterogeneously Integrated InP\/Silicon Photonics: Fabricating Fully Functional Transceivers , 2019, IEEE Nanotechnology Magazine.