Implementation of Real Time Micro VR Camera

In this paper, a real time virtual reality camera system for the micro environments has been developed with a dynamic focusing lens and a smart vision sensor using the "depth from focus" criteria.In the operation with a microscope, such as the micro-surgery, DNA operation and etc., the small depth of a focus makes bad controllability to actuate 3D micro objects with actuators. For example, if the focus is on the object, the actuator could not be seen in the microscope. On the other hand, if the focus is on the actuator, the object could not be observed. In this sense, the "all-in-focus image" is useful for the actuation in micro environments. However, one drawback on the all-in-focus image is that there is no information about the depth of objects. It is also important to reconstruct the micro 3D environments in real time to actuate the object with the micro virtual environments.This paper discusses the criteria of "depth from focus" to achieve the all-in-focus image and micro 3D reconstruction, simultaneously. Then, a micro VR camera system has been developed to achieve the micro VR environments with the "depth from focus" criteria, i.e. the combination of the all-in-focus image and the micro 3D reconstruction. This system is constructed by a dynamic focusing lens, which can change the focus in high frequency, and a smart vision system, which is capable in capturing and processing the image data in high speed with SIMD architecuture.