Dual reality : an emerging medium

The commoditization of low-power radios, a rich set of sensors, longer-lasting batteries, and feature-rich microcontrollers has prompted significant research efforts to imbue physical environments with the responsiveness and awareness afforded by ubiquitous, unobtrusive, low-maintenance sensor networks. However, despite these technical advances, there has been relatively little progress toward finding compelling applications enabled by such sensor networks. What few applications have been demonstrated generally use sensor networks to passively monitor environments either inaccessible or uninteresting to people, such as remote wilderness, factory floors, and health care scenarios. Yet, by definition, any “killer application” of sensor networks must be both popular and widespread. At the same time, online virtual worlds promising complete freedom of creation and interaction are quickly becoming economically, socially, and technically feasible and are making inroads into the mass media market. Yet, despite their popularity, or maybe even because of it, today’s online virtual worlds are marred by a stagnation and emptiness inherent in environments so disconnected from the physical world. Furthermore, the demand for richer modes of self-expression in virtual worlds remains unmet. This dissertation proposes the convergence of sensor networks and virtual worlds not only as a possible solution to their respective limitations, but also as the beginning of a new creative medium. In the “dual reality” resulting from this convergence, both the real and virtual worlds are complete unto themselves, but also enhanced by the ability to mutually reflect, influence, and merge into each other by means of sensor/actuator networks deeply embedded in everyday environments. As a medium, dual reality has the potential to elevate mass creation of media to the same heights television elevated the mass consumption of media and the Internet elevated the mass communication of media. This dissertation describes a full implementation of a dual reality system using a popular online virtual world and a human-centric sensor network designed around a common electrical power strip. Example applications, interaction techniques, and design strategies for the dual reality domain are demonstrated and discussed. Thesis Supervisor: Joseph A. Paradiso Title: Associate Professor of Media Arts and Sciences, Program in Media Arts and Sciences