Generation and Rendering of Interactive Ground Vegetation for Real-Time Testing and Validation of Computer Vision Algorithms

During the development process of new algorithms for computer vision applications, testing and evaluation in real outdoor environments is time-consuming and often difficult to realize. Thus, the use of artificial testing environments is a flexible and cost-efficient alternative. As a result, the development of new techniques for simulating natural, dynamic environments is essential for real-time virtual reality applications, which are commonly known as Virtual Testbeds. Since the first basic usage of Virtual Testbeds several years ago, the image quality of virtual environments has almost reached a level close to photorealism even in real-time due to new rendering approaches and increasing processing power of current graphics hardware. Because of that, Virtual Testbeds can recently be applied in application areas like computer vision, that strongly rely on realistic scene representations. The realistic rendering of natural outdoor scenes has become increasingly important in many application areas, but computer simulated scenes often differ considerably from real-world environments, especially regarding interactive ground vegetation. In this article, we introduce a novel ground vegetation rendering approach, that is capable of generating large scenes with realistic appearance and excellent performance. Our approach features wind animation, as well as object-to-grass interaction and delivers realistically appearing grass and shrubs at all distances and from all viewing angles. This greatly improves immersion, as well as acceptance, especially in virtual training applications. Nevertheless, the rendered results also fulfill important requirements for the computer vision aspect, like plausible geometry representation of the vegetation, as well as its consistence during the entire simulation. Feature detection and matching algorithms are applied to our approach in localization scenarios of mobile robots in natural outdoor environments. We will show how the quality of computer vision algorithms is influenced by highly detailed, dynamic environments, like observed in unstructured, real-world outdoor scenes with wind and object-to-vegetation interaction.

[1]  T. Vaudrey,et al.  Differences between stereo and motion behaviour on synthetic and real-world stereo sequences , 2008, 2008 23rd International Conference Image and Vision Computing New Zealand.

[2]  Ralf Waspe,et al.  Geometric Interpretation and Optimization of Large Semantic Data Sets in Real-Time VR Applications , 2012 .

[3]  Sumanta N. Pattanaik,et al.  Rendering Grass in Real Time with Dynamic Lighting , 2009, IEEE Computer Graphics and Applications.

[4]  Chengfang Song,et al.  Dynamic modeling and rendering of grass wagging in wind , 2005, Comput. Animat. Virtual Worlds.

[5]  Juergen Rossmann,et al.  Efficient Real-Time Generation and Rendering of Interactive Grass and Shrubs for Large Sceneries , 2012 .

[6]  Philippe Decaudin,et al.  Rendering Forest Scenes in Real-Time , 2010 .

[7]  Andreas Kolb,et al.  Responsive Grass , 2009, J. WSCG.

[8]  Martin Hoppen,et al.  GIS-Based Virtual Testbeds and Their Application to Forestry and City Simulation , 2010 .

[9]  Juergen Rossmann,et al.  Advanced Sensor Simulation In Virtual Testbeds: A Cost-Efficient Way to Develop and Verify Space Applications , 2011 .

[10]  Wilhelm Burger,et al.  Virtual Reality for Enhanced Computer Vision , 1995 .

[11]  Oliver Deussen,et al.  Realistic real‐time rendering of landscapes using billboard clouds , 2005, Comput. Graph. Forum.

[12]  Adam Finkelstein,et al.  Real-time fur over arbitrary surfaces , 2001, I3D '01.

[13]  Wolfgang Heidrich,et al.  Real-Time Animated Grass , 2002, Eurographics.

[14]  Wolfgang Ponweiser,et al.  T ask and Context aware Performance Evaluation of Computer Vision Algorithms , 2007 .

[15]  Marie-Paule Cani,et al.  A procedural approach to animate interactive natural sceneries , 2003, Proceedings 11th IEEE International Workshop on Program Comprehension.

[16]  J. Roßmann,et al.  VALIDATING THE CAMERA AND LIGHT SIMULATION OF A VIRTUAL SPACE ROBOTICS TESTBED BY MEANS OF PHYSICAL MOCKUP DATA , 2012 .

[17]  Markus Emde,et al.  VIRTUAL TESTBEDS FOR PLANETARY EXPLORATION : THE SELF-LOCALIZATION ASPECT , 2011 .

[18]  Jürgen Roßmann,et al.  Advanced Mobile Robot Engineering with Virtual Testbeds , 2012, ROBOTIK.