Ballumiere: Real-Time Tracking and Spherical Projection for High-Speed Moving Balls

Projections on moving objects have a problem in that the projection may slip because of the delay between tracking and projection. Here, we propose a new prediction method combining a Kalman filter and a three-frame feedback model that switches between these models according to the ball's state of motion. We developed a real-time tracking and projection system named "Ballumiere", which uses motion capture cameras for tracking and multiple projectors for spherical projection. We conducted a comparative experiment with an existing prediction model and showed that our method minimizes slipping and increases the accuracy of the projection.

[1]  Anselmo Lastra,et al.  Minimizing latency for augmented reality displays: Frames considered harmful , 2014, 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[2]  Hideki Koike,et al.  LumoSpheres: real-time tracking of flying objects and image projection for a volumetric display , 2015, AH.

[3]  Blair MacIntyre,et al.  RoomAlive: magical experiences enabled by scalable, adaptive projector-camera units , 2014, UIST.

[4]  Hideki Koike,et al.  Ballumiere: real-time tracking and projection system for high-speed flying balls , 2015, SIGGRAPH Asia Emerging Technologies.

[5]  Greg Welch,et al.  Shader Lamps: Animating Real Objects With Image-Based Illumination , 2001, Rendering Techniques.

[6]  Christopher S. Madden,et al.  Direct Rotational , 2004 .

[7]  Anselmo Lastra,et al.  From Motion to Photons in 80 Microseconds: Towards Minimal Latency for Virtual and Augmented Reality , 2016, IEEE Transactions on Visualization and Computer Graphics.

[8]  Eyal Ofek,et al.  IllumiRoom: peripheral projected illusions for interactive experiences , 2013, SIGGRAPH '13.

[9]  Masatoshi Ishikawa,et al.  Lumipen: Projection-Based Mixed Reality for Dynamic Objects , 2012, 2012 IEEE International Conference on Multimedia and Expo.

[10]  Greg Welch,et al.  Animating Real Objects With Image-Based Illumination , 2001 .

[11]  Hrvoje Benko,et al.  Juggling the Effects of Latency: Software Approaches to Minimizing Latency in Dynamic Projector-Camera Systems , 2015, UIST.