Tangible interaction + graphical interpretation: a new approach to 3D modeling

Construction toys are a superb medium for geometric models. We argue that such toys, suitably instrumented or sensed, could be the inspiration for a new generation of easy-to-use, tangible modeling systems—especially if the tangible modeling is combined with graphical-interpretation techniques for enhancing nascent models automatically. The three key technologies needed to realize this idea are embedded computation, vision-based acquisition, and graphical interpretation. We sample these technologies in the context of two novel modeling systems: physical building blocks that self-describe, interpret, and decorate the structures into which they are assembled; and a system for scanning, interpreting, and animating clay figures.

[1]  George Cybenko,et al.  Pattern Recognition of 3D CAD Objects: Towards an Electronic Yellow Pages of Mechanical Parts , 1996 .

[2]  John H. Frazer,et al.  An Evolutionary Architecture , 1995 .

[3]  Maggie Orth,et al.  Triangles: design of a physical/digital construction kit , 1997, DIS '97.

[4]  J. H. Frazer,et al.  THE USE OF SIMPLIFIED THREE-DIMENSIONAL COMPUTER INPUT DEVICES TO ENCOURAGE PUBLIC PARTICIPATION IN DESIGN , 1982 .

[5]  Chris Esposito,et al.  Of mice and monkeys: a specialized input device for virtual body animation , 1995, I3D '95.

[6]  Bruce G. Baumgart,et al.  Geometric modeling for computer vision. , 1974 .

[7]  Ruzena Bajcsy,et al.  Recovery of Parametric Models from Range Images: The Case for Superquadrics with Global Deformations , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  S. Pizer,et al.  The Image Processing Handbook , 1994 .

[9]  Hiroshi Ishii,et al.  Triangles: tangible interface for manipulation and exploration of digital information topography , 1998, CHI.

[10]  Anthony T. Patera,et al.  Geometry-defining processors for partial differential equations , 1988 .

[11]  Patrick Henry Winston,et al.  Learning structural descriptions from examples , 1970 .

[12]  Marc H. Raibert,et al.  Legged Robots That Balance , 1986, IEEE Expert.

[13]  Azriel Rosenfeld,et al.  From volumes to views: An approach to 3-D object recognition , 1992, CVGIP Image Underst..

[14]  Randy F. Pausch,et al.  Navigation and locomotion in virtual worlds via flight into hand-held miniatures , 1995, SIGGRAPH.

[15]  Jessica K. Hodgins,et al.  Adapting simulated behaviors for new characters , 1997, SIGGRAPH.

[16]  Andrew W. Fitzgibbon,et al.  Automatic 3D Model Construction for Turn-Table Sequences , 1998, SMILE.

[17]  Deepak R. Kenchammana-Hosekote,et al.  Volume animation using the skeleton tree , 1998, IEEE Symposium on Volume Visualization (Cat. No.989EX300).

[18]  Robert Aish.  3D input for CAAD systems , 1979 .

[19]  Robert Aish,et al.  Architecture without numbers — CAAD based on a 3D modelling system , 1984 .

[20]  Satoshi Matsuoka,et al.  Teddy: A Sketching Interface for 3D Freeform Design , 1999, SIGGRAPH Courses.

[21]  Sing Bing Kang.  Quasi-Euclidean Recovery from Unknown but Complete Orbital Motion , 2002 .

[22]  William H. Press,et al.  Numerical recipes in C , 2002 .