3D reconstruction of tongue surface based on photometric stereo

In the objective research field of traditional Chinese medicine (TCM) tongue diagnosis, 2D tongue image is regarded as the research object for feature extraction and analysis in most current methods. However, 2D tongue image always can not visually express detail information of tongue 3D surface, such as lingual papilla, prick and fissure of tongue. It brings certain limitations to perceive real tongue surface. It is limited for the doctor to give accurate diagnosis. To solve this problem, a method to reconstruct the 3D surface of tongue based on photometric stereo is proposed. First, the surface normals and texture reflectance are obtained using photometric stereo technology in this paper, then calculate the depth values of tongue surface, and generate 3D depth map. It has been proved that the method is viable through lots of experiments and doctors may observe the 3D information of tongue surface from multiple perspectives. Detail information of tongue surface also may be expressed quantitatively and visually.

[1]  Steven M. Seitz,et al.  Shape and spatially-varying BRDFs from photometric stereo , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[2]  Yasuyuki Matsushita,et al.  Self-calibrating photometric stereo , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Jason Lawrence,et al.  A photometric approach for estimating normals and tangents , 2008, ACM Trans. Graph..

[4]  Steven M. Seitz,et al.  Example-based photometric stereo: shape reconstruction with general, varying BRDFs , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Qionghai Dai,et al.  Dynamic Shape Capture via Periodical-Illumination Optical Flow Estimation and Multi-view Photometric Stereo , 2011, 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission.

[6]  Ira Kemelmacher-Shlizerman,et al.  Photometric Stereo with General, Unknown Lighting , 2006, International Journal of Computer Vision.

[7]  Steven M. Seitz,et al.  Shape and Spatially-Varying BRDFs from Photometric Stereo , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Thomas Malzbender,et al.  Surface enhancement using real-time photometric stereo and reflectance transformation , 2006, EGSR '06.

[9]  Robert J. Woodham,et al.  Photometric method for determining surface orientation from multiple images , 1980 .