Pixie dust: graphics generated by levitated and animated objects in computational acoustic-potential field

In this study, we demonstrate real-world-oriented computer graphics by using and expanding 3D acoustic manipulation [Ochiai et al. 2014]. An acoustic potential field (APF) is generated and controlled in order to levitate and manipulate small objects (Fig. 2 (a)). Compared to magnetic levitation, air jets, and other noncontact levitation technologies, our technology has the following advantages: a wide variety of materials are available; it provides a satisfactory refresh rate; and it has a sufficient spatial resolution. It would contributes to the computer graphics community by making the levitated objects usable in graphic metaphors such as the pixels of raster graphics, moving points of vector graphics, and animation (Fig. 1). We believe that it will open a new field of computer graphics if fabricated models can be actuated by APF.

[1]  Takayuki Hoshi,et al.  Compact Ultrasound Device for Noncontact Interaction , 2012, Advances in Computer Entertainment.

[2]  Hiroshi Ishii,et al.  ZeroN: mid-air tangible interaction enabled by computer controlled magnetic levitation , 2011, UIST.

[3]  W. McCarthy.  Programmable matter , 2000, Nature.

[4]  Hideshi Yamada,et al.  Rendering for an Interactive 360 ◦ Light Field Display , 2007 .

[5]  Teruyuki Kozuka,et al.  Noncontact Acoustic Manipulation in Air , 2007 .

[6]  Hiroyuki Shinoda,et al.  Noncontact Tactile Display Based on Radiation Pressure of Airborne Ultrasound , 2010, IEEE Transactions on Haptics.

[7]  Junichi Hoshino,et al.  Mounting and application of bubble display system: bubble cosmos , 2006, ACE '06.

[8]  E. Brandt.  Levitation in Physics , 1989, Science.

[9]  Wesley L. Nyborg,et al.  Radiation Pressure on a Small Rigid Sphere , 1967 .

[10]  Issei Fujishiro,et al.  True 3D display , 2011, SIGGRAPH '11.

[11]  Chris J. Benmore,et al.  Acoustic levitation: recent developments and emerging opportunities in biomaterials research , 2011, European Biophysics Journal.

[12]  R. R. Whymark,et al.  Acoustic field positioning for containerless processing , 1975 .

[13]  Jun Rekimoto,et al.  Lumen: interactive visual and shape display for calm computing , 2004, SIGGRAPH '04.

[14]  Toshiro Noritsugu,et al.  Contactless manipulation of an object on a plane surface using multiple air jets , 2011, 2011 IEEE International Conference on Robotics and Automation.

[15]  Sriram Subramanian,et al.  Ultra-tangibles: creating movable tangible objects on interactive tables , 2012, CHI.

[16]  N. Stanietsky,et al.  The interaction of TIGIT with PVR and PVRL2 inhibits human NK cell cytotoxicity , 2009, Proceedings of the National Academy of Sciences.

[17]  Jun Rekimoto,et al.  Pixie dust: graphics generated by levitated and animated objects in computational acoustic-potential field , 2014, SIGGRAPH Emerging Technologies.

[18]  Dimos Poulikakos,et al.  Acoustophoretic contactless transport and handling of matter in air , 2013, Proceedings of the National Academy of Sciences.

[19]  Mark Chavez,et al.  SIGGRAPH Asia 2013 Art Gallery , 2013, SIGGRAPH 2013.

[20]  Ali Israr,et al.  AIREAL: interactive tactile experiences in free air , 2013, ACM Trans. Graph..

[21]  Gregg E. Favalora,et al.  Occlusion-capable multiview volumetric three-dimensional display. , 2007, Applied optics.

[22]  Anton Nijholt,et al.  Smart material interfaces: "a material step to the future" , 2012, SMI '12.

[23]  Ivan Poupyrev,et al.  Actuation and tangible user interfaces: the Vaucanson duck, robots, and shape displays , 2007, TEI.

[24]  Hiroo Iwata,et al.  Project FEELEX: adding haptic surface to graphics , 2001, SIGGRAPH.

[25]  Jun Rekimoto,et al.  Three-Dimensional Mid-Air Acoustic Manipulation by Ultrasonic Phased Arrays , 2013, PloS one.

[26]  Hideshi Yamada,et al.  Rendering for an interactive 360° light field display , 2007, ACM Trans. Graph..

[27]  Sriram Subramanian,et al.  UltraHaptics: multi-point mid-air haptic feedback for touch surfaces , 2013, UIST.

[28]  Stephen DiVerdi,et al.  Depth-Fused 3D Imagery on an Immaterial Display , 2009, IEEE Transactions on Visualization and Computer Graphics.

[29]  Hiroshi Ishii,et al.  inFORM: dynamic physical affordances and constraints through shape and object actuation , 2013, UIST.

[30]  L. Gor’kov,et al.  On the forces acting on a small particle in an acoustical field in an ideal fluid , 1962 .

[31]  W. J. Xie,et al.  Acoustic method for levitation of small living animals , 2006 .

[32]  Scott E. Hudson,et al.  The information percolator: ambient information display in a decorative object , 1999, UIST '99.

[33]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[34]  Takeo Kanade,et al.  A multi-layered display with water drops , 2010, ACM Trans. Graph..

[35]  Hiroshi Ishii,et al.  Radical atoms: beyond tangible bits, toward transformable materials , 2012, INTR.

[36]  Jun Rekimoto,et al.  Poppable display: A display that enables popping, breaking, and tearing interactions with people , 2013, 2013 IEEE 2nd Global Conference on Consumer Electronics (GCCE).

[37]  Stephen DiVerdi,et al.  The interactive FogScreen , 2005, SIGGRAPH '05.

[38]  Gordon Wetzstein,et al.  Layered 3D: tomographic image synthesis for attenuation-based light field and high dynamic range displays , 2011, ACM Trans. Graph..