Interface apparatus and its control method using by virtual multi touch screen

An interface apparatus using a virtual multi touch screen are provided to recognize a control operation corresponding to an image inputted through a virtual multi-touch point screen and execute a control command corresponding to the control operation. A display processing device(100) provides a virtual multi-touch point screen. When an operation event occurs through the virtual multi-touch point screen, an image interface processing device(200) segments the inputted image into the portions for the virtual multi-touch point screen and the body portions. The image interface processing device recognizes a control operation corresponding to the segmented body portions. A control command recognizing device(300) classifies the recognized control operation and converts the control operation data into a correspondent control command.