Velt: A Framework for Multi RGB-D Camera Systems

We present Velt, a flexible framework for multi RGB-D camera systems. Velt supports modular real-time streaming and processing of multiple RGB, depth and skeleton streams in a camera network. RGB-D data from multiple devices can be combined into 3D data like point clouds. Furthermore, we present an integrated GUI, which enables viewing and controlling all streams, as well as debugging and profiling performance. The node-based GUI provides access to everything from high level parameters like frame rate to low level properties of each individual device. Velt supports modular preprocessing operations like downsampling and cropping of streaming data. Furthermore, streams can be recorded and played back. This paper presents the architecture and implementation of Velt.

[1]  Dieter Schmalstieg,et al.  OpenTracker-an open software architecture for reconfigurable tracking based on XML , 2001, Proceedings IEEE Virtual Reality 2001.

[2]  Marek Kowalski,et al.  Livescan3D: A Fast and Inexpensive 3D Data Acquisition System for Multiple Kinect v2 Sensors , 2015, 2015 International Conference on 3D Vision.

[3]  Ramesh Raskar,et al.  Modern approaches to augmented reality: introduction to current approaches , 2006, SIGGRAPH Courses.

[4]  David Lindlbauer,et al.  HeatSpace: Automatic Placement of Displays by Empirical Analysis of User Behavior , 2017, UIST.

[5]  Paloma Díaz,et al.  ECCE Toolkit: Prototyping Sensor-Based Interaction , 2017, Sensors.

[6]  Mark T. Bolas,et al.  Unobtrusive measurement of subtle nonverbal behaviors with the Microsoft Kinect , 2012, VR.

[7]  Robert W. Lindeman,et al.  HomeOS: Context-Aware Home Connectivity , 2004, International Conference on Wireless Networks.

[8]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[9]  Nicolai Marquardt,et al.  The proximity toolkit: prototyping proxemic interactions in ubiquitous computing ecologies , 2011, UIST.

[10]  Martin Wagner,et al.  Herding Sheep: Live System Development for Distributed Augmented Reality , 2003 .

[11]  Daniel Mendes,et al.  Creepy Tracker Toolkit for Context-aware Interfaces , 2017, ISS.

[12]  Albrecht Schmidt,et al.  Implicit human computer interaction through context , 2000, Personal Technologies.

[13]  Andrew D. Wilson.  Fast Lossless Depth Image Compression , 2017, ISS.

[14]  Marc Alexa,et al.  OptiSpace: Automated Placement of Interactive 3D Projection Mapping Content , 2018, CHI.

[15]  Douglas C. Schmidt,et al.  Producing and delivering a coursera MOOC on pattern-oriented software architecture for concurrent and networked software , 2013, SPLASH.

[16]  Eyal Ofek,et al.  Room2Room: Enabling Life-Size Telepresence in a Projected Augmented Reality Environment , 2016, CSCW.

[17]  Carl Gutwin,et al.  The ASPECTA toolkit: affordable full coverage displays , 2016, PerDis.

[18]  Douglas C. Schmidt,et al.  Pattern-Oriented Software Architecture, Patterns for Concurrent and Networked Objects , 2013 .

[19]  Terry Caelli,et al.  Multi-kinect skeleton fusion for physical rehabilitation monitoring , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[20]  Chin-Boon Chng,et al.  In situ spatial AR surgical planning using projector-Kinect system , 2013, SoICT.

[21]  Blair MacIntyre,et al.  RoomAlive: magical experiences enabled by scalable, adaptive projector-camera units , 2014, UIST.

[22]  Hrvoje Benko,et al.  Projected Augmented Reality with the RoomAlive Toolkit , 2016, ISS.

[23]  David Lindlbauer,et al.  Remixed Reality: Manipulating Space and Time in Augmented Reality , 2018, CHI.

[24]  Takeo Kanade,et al.  Panoptic Studio: A Massively Multiview System for Social Motion Capture , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[25]  Joris De Schutter,et al.  Multi RGB-D camera setup for generating large 3D point clouds , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  Ruzena Bajcsy,et al.  Tele-MFAsT: Kinect-Based Tele-Medicine Tool for Remote Motion and Function Assessment , 2014, MMVR.

[27]  Henry Medeiros,et al.  A Light-Weight Event-Driven Protocol for Sensor Clustering in Wireless Camera Networks , 2007, 2007 First ACM/IEEE International Conference on Distributed Smart Cameras.

[28]  Nigel Davies,et al.  Ubi Displays: A Toolkit for the Rapid Creation of Interactive Projected Displays , 2013 .