Three-Dimensional Object Recognition With Multiview Photon-Counting Sensing and Imaging

We present a method for photon-counting sensing with three-dimensional (3-D) integral imaging for object recognition using independent component analysis (ICA). A lenslet array is used to capture multiple perspective images of a 3-D scene projected onto an image sensor. Photon-counting images of the captured elemental images are generated using a Poisson distribution. A kurtosis-maximization-based algorithm is used as a non-Gaussian maximization method to extract independent features from the photon-counting training data set. The photon-counting image data are preprocessed using principal component analysis to reduce the number of dimensions, increase the speed of the ICA step, and improve the classification performance. A photon-counting image of unknown input scene is classified using k-nearest neighbor and cosine angle metrics. Experimental results are presented, and the probability of classification errors is measured.

[1]  Bahram Javidi,et al.  Physics of Automatic Target Recognition , 2007 .

[2]  Erkki Oja,et al.  Independent Component Analysis , 2001 .

[3]  Bahram Javidi,et al.  Distortion-tolerant 3D recognition of occluded objects using computational integral imaging. , 2006, Optics express.

[4]  Osamu Matoba,et al.  Three-dimensional object recognition and visualization using integral imaging , 2001, Optics + Photonics.

[5]  Marian Stewart Bartlett,et al.  Independent component representations for face recognition , 1998, Electronic Imaging.

[6]  H. Murata,et al.  3-D Display System Using a Computer Generated Integral Photograph , 1978 .

[7]  Philippe Réfrégier.  Noise Theory and Application to Physics , 2011 .

[8]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[9]  Herbert E. Ives,et al.  Optical Properties of a Lippmann Lenticulated Sheet , 1931 .

[10]  B. Javidi,et al.  Enhanced depth of field integral imaging with sensor resolution constraints. , 2004, Optics express.

[11]  J. Walkup,et al.  Statistical optics , 1986, IEEE Journal of Quantum Electronics.

[12]  Bahram Javidi,et al.  Three-Dimensional Television, Video and Display Technology , 2002 .

[13]  Bahram Javidi,et al.  Three-dimensional distortion-tolerant object recognition using integral imaging. , 2004, Optics express.

[14]  F Dubois.  Automatic spatial frequency selection algorithm for pattern recognition by correlation. , 1993, Applied optics.

[15]  B. Javidi,et al.  Integral imaging with large depth of field using an asymmetric phase mask. , 2007, Optics express.

[16]  Marian Stewart Bartlett,et al.  Face recognition by independent component analysis , 2002, IEEE Trans. Neural Networks.

[17]  Bahram Javidi,et al.  Three-dimensional object-distortion-tolerant recognition for integral imaging using independent component analysis. , 2009, Journal of the Optical Society of America. A, Optics, image science, and vision.

[18]  Bahram Javidi,et al.  Three-dimensional recognition of photon-starved events using computational integral imaging and statistical sampling. , 2009, Optics letters.

[19]  B. V. K. Vijaya Kumar,et al.  Efficient Calculation of Primary Images from a Set of Images , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Bahram Javidi,et al.  Digital three-dimensional image correlation by use of computer-reconstructed integral imaging. , 2002, Applied optics.

[21]  Bahram Javidi,et al.  Image Recognition and Classification: Algorithms, Systems, and Applications , 2002 .

[22]  A. Mahalanobis,et al.  Design and application of quadratic correlation filters for target detection , 2004, IEEE Transactions on Aerospace and Electronic Systems.

[23]  Osamu Matoba,et al.  Three-dimensional polarimetric integral imaging. , 2004, Optics letters.

[24]  Shigeo Abe DrEng.  Pattern Classification , 2001, Springer London.

[25]  Anil K. Jain.  Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[26]  Jung-Young Son,et al.  Parameters for designing autostereoscopic imaging systems based on lenticular, parallax barrier, and integral photography plates , 2003 .

[27]  Bahram Javidi,et al.  Photon counting passive 3D image sensing for automatic target recognition. , 2005, Optics express.

[28]  David C. Hemmy,et al.  Three-Dimensional Imaging Techniques , 1990 .

[29]  Philippe Réfrégier,et al.  Comparison of the performance of linear and nonlinear filters in the presence of nonergodic noise , 1997 .

[30]  B. Javidi,et al.  Integral imaging with improved depth of field by use of amplitude-modulated microlens arrays. , 2004, Applied optics.

[31]  J Arai,et al.  Real-time pickup method for a three-dimensional image based on integral photography. , 1997, Applied optics.

[32]  Abhijit Mahalanobis,et al.  Review of correlation filters and their application for scene matching , 1996, Optics + Photonics.

[33]  David G. Stork,et al.  Pattern Classification , 1973 .