Reactive environments and augmented media spaces

With the proliferation of computers and the relentless demand for powerful new systems, our society is quickly reaching a point in which we are overwhelmed by the complexity of the technology around us. The problem is that while computer functionality continues to grow, our mental capacities remain relatively unchanged. As a result, attempts to incorporate computers into our lives often leave us frustrated by our inability to interact with them. To cope with this problem, an alternative paradigm is required, one in which the task, rather than the operation of tools to accomplish it, is central in human-computer interaction. The paradigm we propose is that of Reactive Environments. Rather than require explicit human communication with the computer, the technology makes use of input from a number of sensors to determine what the user is trying to accomplish. Based on the task and the associated context, the environment carries out useful background processing in order to assist the user. This concept marks a dramatic departure from the primarily foreground, machine-oriented human-computer interaction of the present. Instead, with Reactive Environments, we are offered an opportunity to interact with our surroundings while ignoring the computer. To develop this concept further and determine what important issues were involved, we designed and constructed a prototype Reactive Environment in a videoconference room setting, ensuring that users could operate all of the equipment without explicitly interacting with a computer. Once this was accomplished, our next step was to make the room electronically accessible, and augment the environment further so that its potential could be exploited by users who were not physically present. These efforts led to the emergence of several diverse technologies, including a Smart Light Switch, a laser pointer as a remote control, and an Audio/Video Server Attendant, in addition to the Reactive Environment itself. As a result of this research, we have also been able to realize a number of substantial improvements to the sense of engagement available to users of videoconferencing systems.