Philosophies and technologies for ambient aware devices in wearable computing grids

In this paper we treat design philosophies and enabling technologies for ambient awareness within grids of future mobile computing/communication devices. We extensively describe the possible context sensors, their required accuracies, their use in mobile services-possibly leading to background interactions of user devices-as well as a draft of their integration into an ambient aware device. We elaborate on position sensing as one of the main aspects of context aware systems. We first describe a maximum accuracy setup for a mobile user that has the ability of Augmented Reality for indoor and outdoor applications. We then focus on a set-up for pose sensing of a mobile user, based on the fusion of several inertia sensors and DGPS. We describe the anchoring of the position of the user by using visual tracking, using a camera and image processing. We describe our experimental set-up with a background process that, once initiated by the DGPS system, continuously looks in the image for visual clues and-when found-tries to track them, to continuously adjust the inertial sensor system. We present some results of our combined inertia tracking and visual tracking system; we are able to track device rotation and position with an update rate of 10 ms with an accuracy for the rotation of about two degrees, whereas head position accuracy is in the order of a few cm at a visual clue distance of less than 3 m.

[1]  Jinkang Zhu,et al.  Signal-strength-based cellular location using dynamic window-width and double-averaging algorithm , 2000, Vehicular Technology Conference Fall 2000. IEEE VTS Fall VTC2000. 52nd Vehicular Technology Conference (Cat. No.00CH37152).

[2]  Ellen Kayata Wesel.  Wireless Multimedia Communications , 1997 .

[3]  J. Farrell,et al.  The global positioning system and inertial navigation , 1999 .

[4]  Daniele Nardi,et al.  Self-Localization in the RoboCup Environment , 1999, RoboCup.

[5]  Pedro U. Lima,et al.  A Localization Method for a Soccer Robot Using a Vision-Based Omni-Directional Sensor , 2000, RoboCup.

[6]  Alex Pentland,et al.  Unsupervised clustering of ambulatory audio and video , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[7]  J. R. Huddle.  Trends in inertial systems technology for high accuracy AUV navigation , 1998, Proceedings of the 1998 Workshop on Autonomous Underwater Vehicles (Cat. No.98CH36290).

[8]  Keith Cheverst,et al.  Using and Determining Location in a Context-Sensitive Tour Guide , 2001, Computer.

[9]  James Church,et al.  Wearable sensor badge and sensor jacket for context awareness , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[10]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[11]  Alex Pentland,et al.  Visual contextual awareness in wearable computing , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[12]  R. Dorobantu,et al.  Field evaluation of a low-cost strapdown IMU by means GPS , 1999 .

[13]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Yoshiaki Shirai,et al.  Three-Dimensional Computer Vision , 1987, Symbolic Computation.

[15]  Ellen Kayata Wesel,et al.  Wireless Multimedia Communications: Networking Video, Voice and Data , 1997 .

[16]  C. Randell,et al.  Context awareness by analysing accelerometer data , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[17]  Jason Pascoe,et al.  Adding generic contextual capabilities to wearable computers , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[18]  M. Carter.  Computer graphics: Principles and practice , 1997 .

[19]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[20]  John Weston,et al.  Strapdown Inertial Navigation Technology , 1997 .

[21]  Gaetano Borriello,et al.  Location Systems for Ubiquitous Computing , 2001, Computer.

[22]  David Bull,et al.  Insights into mobile multimedia communications , 1998 .

[23]  Alex Pentland,et al.  Realtime personal positioning system for a wearable computer , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[24]  Ronald Azuma,et al.  A motion-stabilized outdoor augmented reality system , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[25]  Bernhard Nebel,et al.  Fast, Accurate, and Robust Self-Localization in the RoboCup Environment , 1999, RoboCup.

[26]  O. Faugeras.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[27]  Emanuele Trucco,et al.  Computer and Robot Vision , 1995 .

[28]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[29]  James C. Miller,et al.  Computer graphics principles and practice, second edition , 1992, Comput. Graph..

[30]  Thorsten Schmitt,et al.  Fast Image Segmentation, Object Recognition and Localization in a RoboCup Scenario , 1999, RoboCup.