X-Ray and 3D Data Fusion for 3D Reconstruction of Closed Receptacle Contents

Closed receptacle contents can be reconstructed without invasive approaches by coupling X-ray and 3D data acquisitions. We present a solution to the reconstruction problem that exploits 3D data acquisitions of the environment to initialize the X-ray projection calibration and to align the final reconstruction to a global frame. In particular we show that the problem can be solved, without employing calibration patterns, by precisely locating the X-ray emitters and receiver plates w.r.t. a global reference frame. We then exploit matching contours extracted from the X-ray images to calibrate the projection system and to perform the reconstruction of parametric objects. We provide experimental results to measure the reconstruction precision of the overall system using both synthetic data and real experiments.

[1]  Jake K. Aggarwal,et al.  TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE , 2008 .

[2]  Mauro R. Ruggeri,et al.  Robust surface registration using N-points approximate congruent sets , 2011, EURASIP J. Adv. Signal Process..

[3]  Roberto Cipolla,et al.  Motion from the frontier of curved surfaces , 1995, Proceedings of IEEE International Conference on Computer Vision.

[4]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[6]  Andrea Bottino,et al.  Introducing a New Problem: Shape-from-Silhouette when the Relative Positions of the Viewpoints is Unknown , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  J H Siewerdsen,et al.  Geometric calibration of a mobile C-arm for intraoperative cone-beam CT. , 2008, Medical physics.

[8]  Edmond Boyer On Using Silhouettes for Camera Calibration , 2006, ACCV.

[9]  Y. Trousset,et al.  Geometrical calibration of X-ray imaging chains for three-dimensional reconstruction. , 1993, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[10]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[11]  Narendra Ahuja,et al.  Structure and Motion Estimation from Dynamic Silhouettes under Perspective Projection , 1995, Proceedings of IEEE International Conference on Computer Vision.

[12]  Joaquim Salvi,et al.  Range image registration for industrial inspection , 2005, IS&T/SPIE Electronic Imaging.