Improved Interaction for Mid-Air Projection Screen Technology

Mid-air, walk-through fogscreens are frequently used in trade shows, theme parks, museums, concerts, etc. They enhance many kinds of entertainment experiences and are captivating for the audience. Currently, they are usually employed only as non-responsive, passive screens for “immaterial” walk-through special effects. Suitable sensors can turn fogscreens into interactive touch screens or walk-through virtual reality screens. Several interactive systems have been implemented. However, the cost and other features of 2D and 3D tracking sensors have been prohibitive for wider commercial adoption. This chapter presents a Microsoft Kinect-based 2D and 3D tracking for mid-air projection screens. Kinect cannot track through the fogscreen due to disturbances caused by fog. In addition to robust tracking and lower cost, the custom Kinect tracking also brings along other advantages such as possibilities for projector’s hotspot removal, ballistic tracking, multi-user, multi-touch, and virtual reality setups, and novel user interfaces.

[1]  Ismo Rakkolainen,et al.  Mixed reality with multimodal head-mounted pico projector , 2013, VRIC.

[2]  Ismo Rakkolainen,et al.  Laser scanning for the interactive walk-through fogScreen , 2005, VRST '05.

[3]  Karthik Ramani,et al.  Extended multitouch: recovering touch posture and differentiating users using a depth camera , 2012, UIST.

[4]  Ismo Rakkolainen,et al.  A Survey of 3DTV Displays: Techniques and Technologies , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Tobias Höllerer,et al.  Implementation and Evaluation of a 3D Multi Modal Learning Environment , 2006 .

[6]  Henry Fuchs,et al.  Reducing interference between multiple structured light depth sensors using motion , 2012, 2012 IEEE Virtual Reality Workshops (VRW).

[7]  Hiroyuki Shinoda,et al.  Adding tactile reaction to hologram , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[8]  Stephen DiVerdi,et al.  Mid-air display experiments to create novel user interfaces , 2009, Multimedia Tools and Applications.

[9]  David Kim,et al.  Shake'n'sense: reducing interference for overlapping structured light depth cameras , 2012, CHI.

[10]  Osamu Oshiro,et al.  360-degree fog projection interactive display , 2011, SA '11.

[11]  Chris Harrison,et al.  OmniTouch: wearable multitouch interaction everywhere , 2011, UIST.

[12]  Stephen DiVerdi,et al.  A novel walk-through 3D display , 2006, Electronic Imaging.

[13]  Ismo Rakkolainen.  Feasible mid-air virtual reality with the immaterial projection screen technology , 2010, 2010 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video.