Increasing Realism of Displayed Vibrating AR Objects through Edge Blurring

Many standard AR devices, such as the HoloLens 2, have limitations in displaying fast motions, like the ones required to visualize moving or vibrating objects. One reason for this is the low computing power compared to other technologies, resulting in frame rate drops. Further, established visualization enhancement methods, such as anti-aliasing, cannot be applied because of their high computational demands. Therefore, we have looked at possible alternatives on the HoloLens 2 for displaying vibrations more realistically as long as these technical limitations exist. We have chosen to examine vibrations as they are widely used for different use cases, like creating feedback, communicating the success of interactions, and generating a better scene understanding. In a user study, three different effects were evaluated against a baseline method, which was the representation of a vibration using a sinus function to calculate the displacement of the object. We found that an effect where the edges of the AR object are blurred (continuously with changing intensity) is perceived as significantly more realistic than other effects and the baseline method.

[1]  A. Lascarides,et al.  Learning the Effects of Physical Actions in a Multi-modal Environment , 2023, FINDINGS.

[2]  Lili Wang,et al.  Foveated rendering: A state-of-the-art survey , 2022, Computational Visual Media.

[3]  O. Staadt,et al.  An integrative view of foveated rendering , 2021, Comput. Graph..

[4]  Ann McNamara,et al.  Holo-Box: Level-of-Detail Glanceable Interfaces for Augmented Reality , 2021, SIGGRAPH Posters.

[5]  Young June Sah,et al.  Effects of visual and auditory cues on haptic illusions for active and passive touches in mixed reality , 2021, Int. J. Hum. Comput. Stud..

[6]  Stefania Serafin,et al.  Knock on Wood: Combining Redirected Touching and Physical Props for Tool-Based Interaction in Virtual Reality , 2020, CHI.

[7]  R A Syaputra,et al.  Implementation of the level of detail method on augmented reality android-based applications , 2020, Journal of Physics: Conference Series.

[8]  Aske Mottelson,et al.  Resized Grasping in VR: Estimating Thresholds for Object Discrimination , 2019, UIST.

[9]  Enrico Rukzio,et al.  Virtual Muscle Force: Communicating Kinesthetic Forces Through Pseudo-Haptic Feedback and Muscle Input , 2019, UIST.

[10]  Joohwan Kim,et al.  Foveated AR , 2019, ACM Trans. Graph..

[11]  Elia Gatti,et al.  Pseudo-Haptic Weight: Changing the Perceived Weight of Virtual Objects By Manipulating Control-Display Ratio , 2019, CHI.

[12]  Diego Gutierrez,et al.  Motion parallax for 360° RGBD video , 2019, IEEE Transactions on Visualization and Computer Graphics.

[13]  E. B. Magrab,et al.  Vibrations , 2018 .

[14]  Julian Frommel,et al.  Conveying the Perception of Kinesthetic Feedback in Virtual Reality using State-of-the-Art Hardware , 2018, CHI.

[15]  Maud Marchal,et al.  Visual Vibrations to Simulate Taps on Different Materials , 2015, AsiaHaptics.

[16]  Katrin Wolf,et al.  Illusion of Surface Changes Induced by Tactile and Visual Touch Feedback , 2015, CHI Extended Abstracts.

[17]  Takuji Narumi,et al.  Modifying an identified position of edged shapes using pseudo-haptic effects , 2012, VRST '12.

[18]  Vincent Lepetit,et al.  Handling Motion-Blur in 3D Tracking and Rendering for Augmented Reality , 2012, IEEE Transactions on Visualization and Computer Graphics.

[19]  João Marcelo X. N. Teixeira,et al.  Understanding the Efficiency of kD-tree Ray-Traversal Techniques over a GPGPU Architecture , 2012, International Journal of Parallel Programming.

[20]  Veronica Teichrieb,et al.  Real Time Ray Tracing for Augmented Reality , 2012, 2012 14th Symposium on Virtual and Augmented Reality.

[21]  Maud Marchal,et al.  The King-Kong Effects: Improving sensation of walking in VR with visual and tactile vibrations at each step , 2012, 2012 IEEE Symposium on 3D User Interfaces (3DUI).

[22]  Maud Marchal,et al.  Pseudo-haptic feedback augmented with visual and tactile vibrations , 2011, 2011 IEEE International Symposium on VR Innovation.

[23]  Francisco J. Serón,et al.  Motion Blur Rendering: State of the Art , 2011, Comput. Graph. Forum.

[24]  Kenny Mitchell,et al.  Split second motion blur , 2010, SIGGRAPH '10.

[25]  David E. Johnson,et al.  Expressive haptic rendering with cartoon-inspired effects , 2010, 2010 IEEE Haptics Symposium.

[26]  Timo Aila,et al.  Understanding the efficiency of ray traversal on GPUs , 2009, High Performance Graphics.

[27]  Dinesh Manocha,et al.  Real-Time Massive Model Rendering , 2008, Real-Time Massive Model Rendering.

[28]  Daut Daman,et al.  A review on level of detail , 2004, Proceedings. International Conference on Computer Graphics, Imaging and Visualization, 2004. CGIV 2004..

[29]  Kunio Kondo,et al.  Cartoon blur: nonphotorealistic motion blur , 2003, Proceedings Computer Graphics International 2003.

[30]  A. Strauss,et al.  Grounded Theory in Practice , 1997 .

[31]  Matthias M. Wloka,et al.  Resolving occlusion in augmented reality , 1995, I3D '95.

[32]  Robert L. Cook,et al.  Distributed ray tracing , 1984, SIGGRAPH.

[33]  B Rogers,et al.  Motion Parallax as an Independent Cue for Depth Perception , 1979, Perception.

[34]  Gordon H. Spencer,et al.  General ray-tracing procedure , 1962 .

[35]  J. Gibson,et al.  Motion parallax as a determinant of perceived depth. , 1959, Journal of experimental psychology.

[36]  J. V. Bradley.  Complete Counterbalancing of Immediate Sequential Effects in a Latin Square Design , 1958 .

[37]  Rachel A. Albert,et al.  Foveated AR: Dynamically-Foveated Augmented Reality Display , 2019 .

[38]  T. Seno,et al.  Stimulus meanings alter illusory self-motion (vection)--experimental examination of the train illusion. , 2012, Seeing and perceiving.

[39]  Nutter,et al.  Weber-Fechner Law , 2010 .

[40]  Roman Kuchkuda,et al.  An introduction to ray tracing , 1993, Comput. Graph..

[41]  S. S. Stevens.  The Psychophysics of Sensory Function. , 1960 .

[42]  Dipl.-Ing,et al.  Real-time Rendering , 2022 .