Self adaptive augmented reality systems on FPGA

Augmented reality (AR) systems emerged and become a very gifted 3D embedded multimedia application. AR consists on adding specific 3D's animations on a video flow. The design and the implementation of such systems on FPGA are complex and difficult. To reduce computational resources that must be carefully used to execute complex application. This execution can be often done in unpredictable environments: it is the major problem to solve. The system architecture must be efficient and flexible enough to adapt system resources to the application requirements and the environment architectures and mobile's constraints. In this paper, we describe our concept of flexible architecture: we have developed IPs to obtain self-adaptive augmented reality systems to implement on FPGA.

[1]  Mahadev Satyanarayanan,et al.  PowerScope: a tool for profiling the energy usage of mobile applications , 1999, Proceedings WMCSA'99. Second IEEE Workshop on Mobile Computing Systems and Applications.

[2]  Tom Drummond,et al.  Going out: robust model-based tracking for outdoor augmented reality , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[3]  Rudy Lauwereins,et al.  QOS Aware HW/SW Partitioning on Run-time Reconfigurable Multimedia Platforms , 2004, ERSA.

[4]  Gauthier Lafruit,et al.  Scalable 3D graphics processing in consumer terminals , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[5]  David Zeltzer,et al.  A survey of glove-based input , 1994, IEEE Computer Graphics and Applications.

[6]  Yoshio Turner,et al.  Reduced energy decoding of MPEG streams , 2003, Multimedia Systems.

[7]  Mike Houston,et al.  Beyond programmable shading: in action , 2008, SIGGRAPH '08.

[8]  ZeltzerDavid,et al.  A Survey of Glove-based Input , 1994 .

[9]  Douglas L. Jones,et al.  Design and evaluation of a cross-layer adaptation framework for mobile multimedia systems , 2003, IS&T/SPIE Electronic Imaging.

[10]  Bruce H. Thomas,et al.  ARQuake: an outdoor/indoor augmented reality first person application , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[11]  Douglas L. Jones,et al.  GRACE-2: integrating fine-grained application adaptation with global adaptation for saving energy , 2009, Int. J. Embed. Syst..

[12]  Scott A. Brandt,et al.  BEST scheduler for integrated processing of best-effort and soft real-time processes , 2001, IS&T/SPIE Electronic Imaging.

[13]  John D. Owens,et al.  Graphics Processing UnitsVpowerful, programmable, and highly parallelVare increasingly targeting general-purpose computing applications. , 2008 .