Gamma-Induced Image Degradation Analysis of Robot Vision Sensor for Autonomous Inspection of Nuclear Sites

There is an increasing desire to conduct autonomous inspection of nuclear sites using robots. However, the presence of gamma radiation in nuclear sites induces degradation in vision sensors. In this paper, the effects of gamma radiation on a robot vision sensor (CMOS camera) used for radiological inspection is examined. The analyses have been carried out for two types of images at different dose rates: a) dark images b) illuminated images. In this work, dark images and chessboard images under illumination are analysed using various evaluation metrics to evaluate the effect of gamma radiation on CMOS Integrated Circuit (IC) and electronic circuitry of the sensor. Experimental results manifest significant changes in electrical properties like the generation of radiation-induced photo signal in sensing circuitry and radiation-induced noise affecting the visual odometry of the robot. System-level degradation for gamma dose rates upto 3 Gy/min intensifies, making data from the imaging sensor unreliable for the visual odometry. However, images captured for gamma dose rate upto 3 Gy/min can be used for surveillance purpose.

[1]  Lixuan Lu,et al.  Fault Tree Analysis for an Inspection Robot in a Nuclear Power Plant , 2017 .

[2]  Kazuya Yoshida,et al.  Emergency response to the nuclear accident at the Fukushima Daiichi Nuclear Power Plants using mobile rescue robots , 2013, J. Field Robotics.

[3]  D. Fleetwood.  Total Ionizing Dose Effects in MOS and Low-Dose-Rate-Sensitive Linear-Bipolar Devices , 2013, IEEE Transactions on Nuclear Science.

[4]  Johan Fagerström.  Ionizing Radiation Effects on Image Sensors: Method on Evaluation from an Image Quality Perspective , 2016 .

[5]  Friedrich Fraundorfer,et al.  Visual Odometry Part I: The First 30 Years and Fundamentals , 2022 .

[6]  J.K.C. Leung,et al.  Application of shielding factors for protection against gamma radiations during a nuclear accident , 1992 .

[7]  H. Hughes,et al.  Radiation effects and hardening of MOS technology: devices and circuits , 2003 .

[8]  Lei Wang,et al.  Research Progress of Nuclear Emergency Response Robot , 2018 .

[9]  Dai-xian Zhu.  Binocular Vision-SLAM Using Improved SIFT Algorithm , 2010, 2010 2nd International Workshop on Intelligent Systems and Applications.

[10]  Shinji Kawatsuma,et al.  Emergency response by robots to Fukushima-Daiichi accident: summary and lessons learned , 2012, Ind. Robot.

[11]  Gabor Karsai,et al.  Range-Finding Sensor Degradation in Gamma Radiation Environments , 2015, IEEE Sensors Journal.

[12]  Olivier Marcelot,et al.  Radiation Hardening of Digital Color CMOS Camera-on-a-Chip Building Blocks for Multi-MGy Total Ionizing Dose Environments , 2017, IEEE Transactions on Nuclear Science.

[13]  Wei Chen,et al.  Fixed Pattern Noise and Temporal Noise Degradation Induced by Radiation Effects in Pinned Photodiode CMOS Image Sensors , 2018, IEEE Transactions on Nuclear Science.

[14]  R. Stolkin,et al.  Gamma-induced Degradation Analysis of Commercial off-the-shelf Camera Sensors , 2019, 2019 IEEE SENSORS.

[15]  M. Gaillardin,et al.  Radiation Effects in Pinned Photodiode CMOS Image Sensors: Pixel Performance Degradation Due to Total Ionizing Dose , 2012, IEEE Transactions on Nuclear Science.

[16]  Georg F. Mauer,et al.  Vision-based autonomous robot control for pick and place operations , 2009, 2009 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[17]  Chunming Gao,et al.  Nuclear Radiation Degradation Study on HD Camera Based on CMOS Image Sensor at Different Dose Rates , 2018, Sensors.

[18]  Shaojie Shen,et al.  SLAM-based localization of 3D gaze using a mobile eye tracker , 2018, ETRA.

[19]  Martin Zavala,et al.  Autonomous detection and characterization of nuclear materials using co-robots , 2016 .

[20]  A. Holland,et al.  Proton and Gamma Radiation Effects on a Fully Depleted Pinned Photodiode CMOS Image Sensor , 2020, IEEE Transactions on Nuclear Science.

[21]  Young Soo Choi,et al.  Monitoring Performance of the Cameras under the High Dose-Rate Gamma Ray Environments , 2014, Health physics.

[22]  P. C. Bennett,et al.  RHOBOT: Radiation hardened robotics , 1997 .

[23]  J. J. Blostein,et al.  Particle detection and classification using commercial off the shelf CMOS image sensors , 2016 .

[24]  Grigoriy Medvedev,et al.  JPRS Report, Soviet Union: Economic Affairs ("Chernobyl Notebook" By G. Medvedev, Published in Novy Mir, June 1989) , 1989 .

[25]  Xu Xi.  Total dose effects in MOS devices under different dose rates , 2005 .

[26]  EMVA Standard 1288 Standard for Characterization of Image Sensors and Cameras , 2010 .

[27]  Nuclear Emergency Response Headquarters.  Report of Japanese Government to the IAEA Ministerial Conference on Nuclear Safety : the Accident at TEPCO's Fukushima Nuclear Power Stations , 2011 .

[28]  Marc Pollefeys,et al.  A multiple-camera system calibration toolbox using a feature descriptor-based calibration pattern , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[29]  Akihiro Yamamoto,et al.  Visual Odometry by Multi-frame Feature Integration , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[30]  Vincent Goiffon,et al.  Radiation Effects on CMOS Active Pixel Image Sensors , 2015 .

[31]  Muhammad Latif Anjum,et al.  Adversarial Examples for Handcrafted Features , 2019, BMVC.

[32]  Devesh Kumar Srivastava,et al.  A Review on Pixel-Based Binarization of Gray Images , 2016 .

[33]  Jiri Matas,et al.  Optimal Randomized RANSAC , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Barry Lennox,et al.  A review of ground-based robotic systems for the characterization of nuclear environments , 2019, Progress in Nuclear Energy.

[35]  Benjamin Bird,et al.  A Robot to Monitor Nuclear Facilities: Using Autonomous Radiation-Monitoring Assistance to Reduce Risk and Cost , 2019, IEEE Robotics & Automation Magazine.

[36]  R. Stolkin,et al.  Degradation Measurement of Kinect Sensor Under Fast Neutron Beamline , 2019, 2019 IEEE Radiation Effects Data Workshop.

[37]  Martino Pesaresi,et al.  Multi scale Harris corner detector based on Differential Morphological Decomposition , 2011, Pattern Recognit. Lett..

[38]  K. Holbert,et al.  Response of lead metaniobate acoustic emission sensors to gamma irradiation , 2005, IEEE Transactions on Nuclear Science.

[39]  Zujun Wang,et al.  Characterization of total ionizing dose damage in COTS pinned photodiode CMOS image sensors , 2016 .

[40]  P. Magnan,et al.  Radiation Effects in Pinned Photodiode CMOS Image Sensors: Variation of Epitaxial Layer Thickness , 2017, IEEE Transactions on Nuclear Science.

[41]  Najib Mahjoubi,et al.  RICA: A Tracked Robot for Sampling and Radiological Characterization in the Nuclear Field , 2017, J. Field Robotics.

[42]  G. Hopkinson,et al.  A radiation tolerant video camera for high total dose environments , 2002, IEEE Radiation Effects Data Workshop.