JOLED: A Mid-air Display based on Electrostatic Rotation of Levitated Janus Objects

We present JOLED, a mid-air display for interactive physical visualization using Janus objects as physical voxels. The Janus objects have special surfaces that have two or more asymmetric physical properties at different areas. In JOLED, they are levitated in mid-air and controllably rotated to reveal their different physical properties. We made voxels by coating the hemispheres of expanded polystyrene beads with different materials, and applied a thin patch of titanium dioxide to induce electrostatic charge on them. Transparent indium tin oxide electrodes are used around the levitation volume to create a tailored electric field to control the orientation of the voxels. We propose a novel method to control the angular position of individual voxels in a grid using electrostatic rotation and their 3D position using acoustic levitation. We present a display in which voxels can be flipped independently, and two mid-air physical games with a voxel as the playable character that moves in 3D across other physical structures and rotates to reflect its status in the games. We demonstrate a voxel update speed of 37.8 ms/flip, which is video-rate.

[1]  Jun Rekimoto,et al.  Fairy lights in femtoseconds: aerial and volumetric graphics rendered by focused femtosecond laser combined with computational holographic fields , 2015, SIGGRAPH Emerging Technologies.

[2]  Michitaka Hirose,et al.  R2D2 w/ AIRR: real time & real space double-layered display with aerial imaging by retro-reflection , 2015, SIGGRAPH Asia Emerging Technologies.

[3]  K. Yoshihisa.  Calculation of the Absorption of Sound by the Atmosphere , 1997 .

[4]  Jorge Nocedal,et al.  A Numerical Study of the Limited Memory BFGS Method and the Truncated-Newton Method for Large Scale Optimization , 1991, SIAM J. Optim..

[5]  Tovi Grossman,et al.  Going Deeper: a Taxonomy of 3D on the Tabletop , 2007, Tabletop.

[6]  Sriram Subramanian,et al.  MisTable: reach-through personal screens for tabletops , 2014, CHI.

[7]  Yumin Xiang,et al.  The electrostatic capacitance of an inclined plate capacitor , 2006 .

[8]  Stephen DiVerdi,et al.  Depth-Fused 3D Imagery on an Immaterial Display , 2009, IEEE Transactions on Visualization and Computer Graphics.

[9]  Ismo Rakkolainen.  How Feasible Are Star Wars Mid-air Displays , 2007, 2007 11th International Conference Information Visualization (IV '07).

[10]  Yumin Xiang,et al.  Further study on electrostatic capacitance of an inclined plate capacitor , 2008 .

[11]  Takeo Kanade,et al.  A multi-layered display with water drops , 2010, ACM Trans. Graph..

[12]  Jun Rekimoto,et al.  Poppable display: A display that enables popping, breaking, and tearing interactions with people , 2013, 2013 IEEE 2nd Global Conference on Consumer Electronics (GCCE).

[13]  Jun Rekimoto,et al.  Pixie dust: graphics generated by levitated and animated objects in computational acoustic-potential field , 2014, SIGGRAPH '14.

[14]  Junichi Hoshino,et al.  Mounting and application of bubble display system: bubble cosmos , 2006, ACE '06.

[15]  Hiroshi Ishii,et al.  ZeroN: mid-air tangible interaction enabled by computer controlled magnetic levitation , 2011, UIST.

[16]  Simon Richir,et al.  Proceedings of the 2016 Virtual Reality International Conference , 2012, VRIC.

[17]  P. Renaud,et al.  Characterization and optimization of liquid electrodes for lateral dielectrophoresis. , 2007, Lab on a chip.

[18]  Sriram Subramanian,et al.  Holographic acoustic elements for manipulation of levitated objects , 2015, Nature Communications.

[19]  Tomohiro Tanikawa,et al.  Display Composed of Water Drops for Filling Space with Materialized Virtual Three-dimensional Objects , 2006, IEEE Virtual Reality Conference (VR 2006).

[20]  Osamu Oshiro,et al.  360-degree fog projection interactive display , 2011, SA '11.

[21]  R. R. Whymark,et al.  Acoustic field positioning for containerless processing , 1975 .

[22]  Sriram Subramanian,et al.  SensaBubble: a chrono-sensory mid-air display of sight and smell , 2014, CHI.

[23]  B. W. Lawton.  Damage to human hearing by airborne sound of very high frequency or ultrasonic frequency , 2001 .

[24]  Dimos Poulikakos,et al.  Acoustophoretic contactless transport and handling of matter in air , 2013, Proceedings of the National Academy of Sciences.

[25]  Elden F. Ray,et al.  Applications of Attenuations and Reflections in ISO 9613-2, Acoustics – Attenuation of Sound During Propagation Outdoors – Part 2: General Method of Calculation , 2004 .

[26]  Jongin Hong,et al.  AC frequency characteristics of coplanar impedance sensors as design parameters. , 2005, Lab on a chip.

[27]  David Kim,et al.  HoloDesk: direct 3d interactions with a situated see-through display , 2012, CHI.

[28]  Sriram Subramanian,et al.  Control of Non-Solid Diffusers by Electrostatic Charging , 2015, CHI.

[29]  Sriram Subramanian,et al.  Floating charts: Data plotting using free-floating acoustically levitated representations , 2016, 2016 IEEE Symposium on 3D User Interfaces (3DUI).

[30]  Sriram Subramanian,et al.  Rendering volumetric haptic shapes in mid-air using ultrasound , 2014, ACM Trans. Graph..

[31]  R. Sprague,et al.  Gyricon electric paper , 1998 .

[32]  Issei Fujishiro,et al.  True 3D display , 2011, SIGGRAPH '11.

[33]  Takeshi Naemura,et al.  Laser-plasma scanning 3D display for putting digital contents in free space , 2008, Electronic Imaging.

[34]  Pierre Dragicevic,et al.  Opportunities and Challenges for Data Physicalization , 2015, CHI.

[35]  Sriram Subramanian,et al.  LeviPath: Modular Acoustic Levitation for 3D Path Visualisations , 2015, CHI.

[36]  SubramanianSriram,et al.  Rendering volumetric haptic shapes in mid-air using ultrasound , 2014 .