A Novel Luminance-Based Algorithm for Classification of Semi-Dark Images

Image classification of a visual scene based on visibility is significant due to the rise in readily available automated solutions. Currently, there are only two known spectrums of image visibility i.e., dark, and bright. However, normal environments include semi-dark scenarios. Hence, visual extremes that will lead to the accurate extraction of image features should be duly discarded. Fundamentally speaking there are two broad methods to perform visual scene-based image classification, i.e., machine learning (ML) methods and computer vision methods. In ML, the issues of insufficient data, sophisticated hardware and inadequate image classifier training time remain significant problems to be handled. These techniques fail to classify the visual scene-based images with high accuracy. The other alternative is computer vision (CV) methods, which also have major issues. CV methods do provide some basic procedures which may assist in such classification but, to the best of our knowledge, no CV algorithm exists to perform such classification, i.e., these do not account for semi-dark images in the first place. Moreover, these methods do not provide a well-defined protocol to calculate images’ content visibility and thereby classify images. One of the key algorithms for calculation of images’ content visibility is backed by the HSL (hue, saturation, lightness) color model. The HSL color model allows the visibility calculation of a scene by calculating the lightness/luminance of a single pixel. Recognizing the high potential of the HSL color model, we propose a novel framework relying on the simple approach of the statistical manipulation of an entire image’s pixel intensities, represented by HSL color model. The proposed algorithm, namely, Relative Perceived Luminance Classification (RPLC) uses the HSL (hue, saturation, lightness) color model to correctly identify the luminosity values of the entire image. Our findings prove that the proposed method yields high classification accuracy (over 78%) with a small error rate. We show that the computational complexity of RPLC is much less than that of the state-of-the-art ML algorithms.

[1]  A. Asadpour,et al.  Design and application of industrial machine vision systems , 2007 .

[2]  Subhransu Maji,et al.  Efficient Classification for Additive Kernel SVMs , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Mobashar Rehman,et al.  Accuracy Performance Degradation in Image Classification Models due to Concept Drift , 2019, International Journal of Advanced Computer Science and Applications.

[4]  S. Honavar Head up, heels down, posture perfect: Ergonomics for an ophthalmologist , 2017, Indian journal of ophthalmology.

[5]  Sergio A. Velastin,et al.  How close are we to solving the problem of automated visual surveillance? , 2008, Machine Vision and Applications.

[6]  Sherri L. Messimer,et al.  Automated visual inspection: a tutorial , 1990 .

[7]  Colin Jacobs,et al.  Surveying the reach and maturity of machine learning and artificial intelligence in astronomy , 2019, WIREs Data Mining Knowl. Discov..

[8]  Taghi M. Khoshgoftaar,et al.  A survey on Image Data Augmentation for Deep Learning , 2019, Journal of Big Data.

[9]  Mubarak Shah,et al.  Automated Visual Surveillance in Realistic Scenarios , 2007, IEEE MultiMedia.

[10]  T. Neumuth,et al.  Surface EMG-based Surgical Instrument Classification for Dynamic Activity Recognition in Surgical Workflows , 2019, Current Directions in Biomedical Engineering.

[11]  Chee Seng Chan,et al.  Getting to Know Low-light Images with The Exclusively Dark Dataset , 2018, Comput. Vis. Image Underst..

[12]  Stephen P. Boyd,et al.  Dirty Pixels: Optimizing Image Classification Architectures for Raw Sensor Data , 2017, ArXiv.

[13]  David R. Bull,et al.  Automatic contrast enhancement of low-light images based on local statistics of wavelet coefficients , 2010, 2010 IEEE International Conference on Image Processing.

[14]  Constantino Carlos Reyes-Aldasoro,et al.  A Novel Focal Phi Loss for Power Line Segmentation with Auxiliary Classifier U-Net , 2021, Sensors.

[15]  Ana Castillo-Martinez,et al.  Smartphones as a Light Measurement Tool: Case of Study , 2017 .

[16]  Hongliang Zhu,et al.  SAR Target Classification Based on Radar Image Luminance Analysis by Deep Learning , 2020, IEEE Sensors Letters.

[17]  Lin Shi,et al.  A New Automatic Visual Scene Segmentation Algorithm for Flash Movie , 2019, Multimedia Tools and Applications.

[18]  Fan Zhang,et al.  A Hyperspectral Image Classification Approach Based on Feature Fusion and Multi-Layered Gradient Boosting Decision Trees , 2020, Entropy.

[19]  Anil K. Jain,et al.  On image classification: city images vs. landscapes , 1998, Pattern Recognit..

[20]  Sergey Bezryadin,et al.  Brightness Calculation in Digital Image Processing , 2007 .

[21]  G. Michael Morris,et al.  Image classification at low light levels , 1986 .

[22]  David Dagan Feng,et al.  An Ensemble of Fine-Tuned Convolutional Neural Networks for Medical Image Classification , 2017, IEEE Journal of Biomedical and Health Informatics.

[23]  Hui Huang,et al.  Multi-Spectral RGB-NIR Image Classification Using Double-Channel CNN , 2019, IEEE Access.

[24]  Jonathan Cepeda-Negrete,et al.  Automatic selection of color constancy algorithms for dark image enhancement by fuzzy rule-based reasoning , 2015, Appl. Soft Comput..

[25]  Manzoor Ahmed Hashmani Syed Sajjad Hussain Rizvi Mehak Maqbool Memon Novel Content Aware Pixel Abstraction for Image Semantic Segmentation , 2020 .

[26]  Joanna Kazzandra Dumagpi,et al.  Evaluating GAN-Based Image Augmentation for Threat Detection in Large-Scale Xray Security Images , 2020, Applied Sciences.

[27]  Raimondo Schettini,et al.  Improving Color Constancy Using Indoor–Outdoor Image Classification , 2008, IEEE Transactions on Image Processing.

[28]  Yu Li,et al.  LIME: Low-Light Image Enhancement via Illumination Map Estimation , 2017, IEEE Transactions on Image Processing.

[29]  Jennifer A. Veitch,et al.  Perceived room brightness: Pilot study on the effect of luminance distribution , 1995 .

[30]  Massimo Panella,et al.  A Smartphone-Based Application Using Machine Learning for Gesture Recognition: Using Feature Extraction and Template Matching via Hu Image Moments to Recognize Gestures , 2019, IEEE Consumer Electronics Magazine.

[31]  Stanley H. Chan,et al.  Image Classification in the Dark using Quanta Image Sensors , 2020, ECCV.

[32]  Khawar Khurshid,et al.  Segmentation-based image defogging using modified dark channel prior , 2020, EURASIP J. Image Video Process..

[33]  Fangfang Liu,et al.  Semantic Segmentation of Underwater Images Based on Improved Deeplab , 2020, Journal of Marine Science and Engineering.

[34]  Yu Oishi,et al.  Animal Detection Using Thermal Images and Its Required Observation Conditions , 2018, Remote. Sens..

[35]  Fan Zhang,et al.  A New Identification Method for Surface Cracks from UAV Images Based on Machine Learning in Coal Mining Areas , 2020, Remote. Sens..