3D color object reconstruction from 2D image sequences

We have developed an automatic system for 3D color reconstruction of real objects from 2D image sequences captured with a calibrated camera. The surface model is carved in an octree structure by using a shape from silhouette approach. The resulting 3D triangle mesh is obtained by a marching cube technique followed by a mesh decimation. The color related tasks of the whole system, such as object extraction and texture mapping, are addressed in the paper. We present a texture mapping strategy based on surface particles, It improves the texture quality by proper selection of the original color images yielding smooth color texture transitions both at triangle boundaries and within triangles. A particular care has been taken for the highlight removal problem. Reconstruction results demonstrate the attained quality.