3D motion sensing of any object without prior knowledge

We propose a novel three-dimensional motion sensing method using lasers. Recently, object motion information is being used in various applications, and the types of targets that can be sensed continue to diversify. Nevertheless, conventional motion sensing systems have low universality because they require some devices to be mounted on the target, such as accelerometers and gyro sensors, or because they are based on cameras, which limits the types of targets that can be detected. Our method solves this problem and enables noncontact, high-speed, deterministic measurement of the velocity of a moving target without any prior knowledge about the target shape and texture, and can be applied to any unconstrained, unspecified target. These distinctive features are achieved by using a system consisting of a laser range finder, a laser Doppler velocimeter, and a beam controller, in addition to a robust 3D motion calculation method. The motion of the target is recovered from fragmentary physical information, such as the distance and speed of the target at the laser irradiation points. From the acquired laser information, our method can provide a numerically stable solution based on the generalized weighted Tikhonov regularization. Using this technique and a prototype system that we developed, we also demonstrated a number of applications, including motion capture, video game control, and 3D shape integration with everyday objects.

[1]  Xavier Pennec,et al.  Multi-scale EM-ICP: A Fast and Robust Approach for Surface Registration , 2002, ECCV.

[2]  Steve Rothberg,et al.  Laser vibrometry: Pseudo-vibrations , 1989 .

[3]  Yaser Sheikh,et al.  Motion capture from body-mounted cameras , 2011, ACM Trans. Graph..

[4]  Wojciech Matusik,et al.  Practical motion capture in everyday surroundings , 2007, ACM Trans. Graph..

[5]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[6]  Alvaro Cassinelli Invoked computing Spatial audio and video AR invoked through miming , 2011 .

[7]  Yonghuai Liu,et al.  Automatic registration of overlapping 3D point clouds using closest points , 2006, Image Vis. Comput..

[8]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[9]  Vincent Lepetit,et al.  BRIEF: Binary Robust Independent Elementary Features , 2010, ECCV.

[10]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[11]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[12]  Masatoshi Ishikawa,et al.  High-resolution surface reconstruction based on multi-level implicit surface from multiple range images , 2013, 2013 IEEE International Conference on Image Processing.

[13]  Wolfram Burgard,et al.  Real-time 3D visual SLAM with a hand-held camera , 2011 .

[14]  Mathieu Le Goc,et al.  A low-cost transparent electric field sensor for 3d interaction on mobile devices , 2014, CHI.

[15]  Hamed Ketabdar,et al.  MagiTact: interaction with mobile devices based on compass (magnetic) sensor , 2010, IUI '10.

[16]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[17]  Masatoshi Ishikawa,et al.  High-resolution shape reconstruction from multiple range images based on simultaneous estimation of surface and motion , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[18]  Chris Harrison,et al.  Abracadabra: wireless, high-precision, and unpowered finger input for very small mobile devices , 2009, UIST '09.

[19]  Adrien Bartoli,et al.  Fast Explicit Diffusion for Accelerated Features in Nonlinear Scale Spaces , 2013, BMVC.

[20]  WatanabeYoshihiro,et al.  3D motion sensing of any object without prior knowledge , 2015 .

[21]  Toby Sharp,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR.

[22]  Masatoshi Ishikawa,et al.  High-resolution Surface Reconstruction based on Multi-level Implicit Surface from Multiple Range Images , 2013, IPSJ Trans. Comput. Vis. Appl..

[23]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[24]  Luc Van Gool,et al.  Markerless tracking of complex human motions from multiple views , 2006, Comput. Vis. Image Underst..

[25]  V. Lepetit,et al.  EPnP: An Accurate O(n) Solution to the PnP Problem , 2009, International Journal of Computer Vision.

[26]  Takeshi Miura,et al.  Development of a motion capture system for a hand using a magnetic three dimensional position sensor , 2006, SIGGRAPH '06.

[27]  Masatoshi Ishikawa,et al.  955-fps Real-time Shape Measurement of a Moving/Deforming Object using High-speed Vision for Numerous-point Analysis , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[28]  Andrew W. Fitzgibbon,et al.  KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera , 2011, UIST.

[29]  Y. Nishida,et al.  Omnidirectional ultrasonic location sensor , 2005, IEEE Sensors, 2005..

[30]  Yanfei Wang,et al.  Computational Methods for Applied Inverse Problems , 2012 .

[31]  Ramesh Raskar,et al.  Prakash: lighting aware motion capture using photosensing markers and multiplexed illuminators , 2007, ACM Trans. Graph..