A Convolutional Neural Network for Ghost Image Recognition and Waveform Design of Electrophoretic Displays

With the advantages of low power consumption, flexibility, and high readability against bright ambiance, electrophoretic displays (EPDs) have wide application prospects in the fields of education, smart supermarkets, Internet of Things, smart homes, wearable devices, etc. EPDs suffer from a severe history dependence during grayscale switching, which results in annoying ghost images. However, currently, it is difficult to distinguish diverse types of ghost images automatically; thus, lookup-tables (LUTs) for multi-grayscale waveform design cannot be effectively generated but require cumbersome manual adjustment. In this article, we proposed to adopt a convolutional neural network (CNN) to automatically recognize ghost images, based on which, LUTs that could suppress ghost images and achieve accurate grayscales were automatically generated for waveform design. Moreover, the workforce for manual adjustment was significantly saved. The results suggest that the CNN is a powerful tool for EPDs to achieve better image quality, as well as less manual cost.

[1]  Wen-Chung Kao,et al.  Driving Method of Three-Particle Electrophoretic Displays , 2018, IEEE Transactions on Electron Devices.

[2]  Peter Corcoran,et al.  Convolutional Neural Network Implementation for Eye-Gaze Estimation on Low-Quality Consumer Imaging Systems , 2019, IEEE Transactions on Consumer Electronics.

[3]  谢曜任,et al.  Light-enhancing structure for electrophoretic display , 2013 .

[4]  Stephen J. Telfer,et al.  42-4: Invited Paper: A Full-Color Electrophoretic Display , 2016 .

[5]  Wen-Chung Kao,et al.  Image quality improvement for electrophoretic displays by combining contrast enhancement and halftoning techniques , 2009, 2009 Digest of Technical Papers International Conference on Consumer Electronics.

[6]  Dongsuk Yook,et al.  Multitask Learning of Deep Neural Network-Based Keyword Spotting for IoT Devices , 2019, IEEE Transactions on Consumer Electronics.

[7]  Carlos R. del-Blanco,et al.  Tiny hand gesture recognition without localization via a deep convolutional network , 2017, IEEE Transactions on Consumer Electronics.

[8]  HongMei Zang,et al.  59.1: Invited Paper: Electrophoretic Display Platform Comprising B, W, R Particles , 2014 .

[9]  I. Ota,et al.  Electrophoretic image display (EPID) panel , 1973 .

[10]  Mauro Olivieri,et al.  A Reconfigurable, Low Power, Temperature Compensated IC for 8-segment Gamma Correction Curve in TFT, OLED and PDP Displays , 2007, IEEE Transactions on Consumer Electronics.

[11]  Yung-Fang Chen,et al.  Programmed driving waveforms for quick-response liquid powder displays , 2010, IEEE Transactions on Consumer Electronics.

[12]  Su Jing,et al.  Transfer printing for fabrication of flexible RGB color e‐paper , 2017 .

[13]  Zongfu Yu,et al.  A Bidirectional Deep Neural Network for Accurate Silicon Color Design , 2019, Advanced materials.

[14]  Yi-Pai Huang,et al.  Ambient‐light‐adaptive image quality enhancement for full‐color e‐paper displays using a saturation‐based tone‐mapping method , 2018 .

[15]  Xiao Zhang,et al.  Review of Paper-Like Display Technologies , 2014 .

[16]  Kwangjoon Kim,et al.  Multilevel driving waveform for electrophoretic displays to improve grey levels and response characteristics , 2014 .

[17]  Andrew Zisserman,et al.  Reading Text in the Wild with Convolutional Neural Networks , 2014, International Journal of Computer Vision.

[18]  Oh-Kyong Kwon,et al.  A local dimming algorithm for low power LCD TVs using edge-type LED backlight , 2010, IEEE Transactions on Consumer Electronics.

[19]  Qiming Zhang,et al.  Artificial neural networks enabled by nanophotonics , 2019, Light: Science & Applications.

[20]  Wen-Chung Kao,et al.  Configurable timing controller design for active matrix electrophoretic display , 2009, IEEE Transactions on Consumer Electronics.

[21]  Wen-Chung Kao,et al.  Signal processing for playing videos on electrophoretic displays , 2012, 2012 IEEE 55th International Midwest Symposium on Circuits and Systems (MWSCAS).

[22]  Wen-Chung Kao,et al.  Driving Waveform Design Based on Response Latency Analysis of Electrophoretic Displays , 2012, Journal of Display Technology.

[23]  Duncan Graham-Rowe,et al.  Electronic paper rewrites the rulebook for displays , 2007 .

[24]  许骏 Driving method of electrophoretic display , 2010 .

[25]  Karl R. Amundson,et al.  68.1: Invited Paper: Achieving Graytone Images in a Microencapsulated Electrophoretic Display , 2006 .

[26]  Hiroya Kodama,et al.  56.2: Computational Modeling of Pigment Dispersions in an Electrophoretic Display , 2005 .

[27]  Oh-Kyong Kwon,et al.  A luminance adjusting algorithm for high resolution and high image quality AMOLED displays of mobile phone applications , 2010, IEEE Transactions on Consumer Electronics.

[28]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[29]  Wen-Chung Kao,et al.  Towards Video Display on Electronic Papers , 2016, Journal of Display Technology.

[30]  Herbert De Smet,et al.  Complete electrical and optical simulation of electronic paper , 2006, Displays.

[31]  Herbert De Smet,et al.  The microscopic physics of electronic paper revealed , 2003 .

[32]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[33]  Yi-Hua Liu,et al.  A novel sequential-color RGB-LED backlight driving system with local dimming control and dynamic bus voltage regulation , 2010, IEEE Transactions on Consumer Electronics.

[34]  Alex Henzen,et al.  High‐quality images on electrophoretic displays , 2006 .

[35]  Jin-Woo Jeong,et al.  Watch & Do: A Smart IoT Interaction System with Object Detection and Gaze Estimation , 2019, IEEE Transactions on Consumer Electronics.