Tangibleness interaction system and method

PURPOSE: A tangible interaction system and a method thereof are provided to control a virtual object by utilizing a physical object of a realistic space. CONSTITUTION: A physical object(10) generates interaction information, and a display unit(20) generates screen touch position information of the physical object. A photographing unit(30) photographs a screen portion of the display unit. A server unit(40) creates a virtual object corresponding to the recognized physical object. According to the position and motion of the physical object, the server unit changes the position and motion of the virtual object.