Sound recovery via intensity variations of speckle pattern pixels selected with variance-based method

Abstract. In general, the sound waves can cause the vibration of the objects that are encountered in the traveling path. If we make a laser beam illuminate the rough surface of an object, it will be scattered into a speckle pattern that vibrates with these sound waves. Here, an efficient variance-based method is proposed to recover the sound information from speckle patterns captured by a high-speed camera. This method allows us to select the proper pixels that have large variances of the gray-value variations over time, from a small region of the speckle patterns. The gray-value variations of these pixels are summed together according to a simple model to recover the sound with a high signal-to-noise ratio. Meanwhile, our method will significantly simplify the computation compared with the traditional digital-image-correlation technique. The effectiveness of the proposed method has been verified by applying a variety of objects. The experimental results illustrate that the proposed method is robust to the quality of the speckle patterns and costs more than one-order less time to perform the same number of the speckle patterns. In our experiment, a sound signal of time duration 1.876 s is recovered from various objects with time consumption of 5.38 s only.

[1]  Tao Wang,et al.  Vibration Characteristics of Various Surfaces Using an LDV for Long-Range Voice Acquisition , 2011, IEEE Sensors Journal.

[2]  Tae Hee Han,et al.  Fast Normalized Cross-Correlation , 2009, Circuits Syst. Signal Process..

[3]  Qingshan Kong,et al.  Analysis of backscattering characteristics of objects for remote laser voice acquisition. , 2014, Applied optics.

[4]  Chloé Clavel,et al.  Events Detection for an Audio-Based Surveillance System , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[5]  Frédo Durand,et al.  The visual microphone , 2014, ACM Trans. Graph..

[6]  Alessio Brutti,et al.  Acoustic Based Surveillance System for Intrusion Detection , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[7]  B. Pan Recent Progress in Digital Image Correlation , 2011 .

[8]  Hugo Sol,et al.  Analysis of speckle patterns for deformation measurements by digital image correlation , 2006, Speckle: International Conference on Speckle Metrology.

[9]  Elsa Garmire,et al.  Low-power optical vibration detection by photoconductance monitoring with a laser speckle pattern. , 2005, Optics letters.

[10]  Xiujun Lei,et al.  Note: Sound recovery from video using SVD-based information extraction. , 2016, The Review of scientific instruments.

[11]  Huaguo Zang,et al.  Laser Doppler vibrometer for real-time speech-signal acquirement , 2009 .

[12]  Hieu Nguyen,et al.  Audio extraction from silent high-speed video using an optical technique , 2014 .

[13]  Zeev Zalevsky,et al.  Simultaneous remote extraction of multiple speech sources and heart beats from secondary speckles pattern. , 2009, Optics express.

[14]  K. Qian,et al.  Study on subset size selection in digital image correlation for speckle patterns. , 2008, Optics express.

[15]  Tao Wang,et al.  Vision-Aided Laser Doppler Vibrometry for Remote Automatic Voice Detection , 2011, IEEE/ASME Transactions on Mechatronics.

[16]  Silvio Bianchi,et al.  Vibration detection by observation of speckle patterns. , 2014, Applied optics.

[17]  Benjamin Göhler,et al.  Comparison of high speed imaging technique to laser vibrometry for detection of vibration information from objects , 2015, SPIE Security + Defence.

[18]  Photoconductive arrays for monitoring motion of spatial optical intensity patterns. , 2007, Applied optics.

[19]  Hanyun Wang,et al.  Audio signal reconstruction based on adaptively selected seed points from laser speckle images , 2014 .

[20]  Cheng Guo,et al.  Photogrammetry-based two-dimensional digital image correlation with nonperpendicular camera alignment , 2012 .

[21]  Tao Wang,et al.  Long range audio and audio-visual event detection using a laser Doppler vibrometer , 2010, Defense + Commercial Sensing.

[22]  Yasuhiro Oikawa,et al.  Extract voice information using high-speed camera , 2013 .

[23]  Lin Li,et al.  Vibration measurement by means of digital speckle correlation , 2016, 2016 International Siberian Conference on Control and Communications (SIBCON).

[24]  E. Garmire,et al.  Optical vibration detection with a photoconductance monitoring array , 2004 .

[25]  Rui Li,et al.  Performance comparison of an all-fiber-based laser Doppler vibrometer for remote acoustical signal detection using short and long coherence length lasers. , 2012, Applied optics.

[26]  Dashan Zhang,et al.  Efficient subtle motion detection from high-speed video for sound recovery and vibration analysis using singular value decomposition-based approach , 2017 .

[27]  V. Seregin,et al.  Laser vibrometry based on analysis of the speckle pattern from a remote object , 2011 .

[28]  Zhaoyang Wang,et al.  Equivalence of digital image correlation criteria for pattern matching. , 2010, Applied optics.

[29]  Dipl-phys R. Höfling,et al.  Speckle pattern correlation by digital image processing , 1987 .