Efficient data management on lightweight computing devices

Lightweight computing devices are becoming ubiquitous and an increasing number of applications are being developed for these devices. Many of these applications deal with significant amounts of data and involve complex joins and aggregate operations, which necessitate a local database management system on the device. This is a challenge as these devices are constrained by limited stable storage and main memory. Hence new storage models that reduce storage costs are needed and a storage scheme should be selected based on data characteristics, nature of queries, and updates. Also, query execution plan should be chosen depending on the amount of available memory and the underlying storage scheme; memory should be optimally allocated among the database operators involved in the query. To achieve these goals, we utilize a novel storage model, ID based storage, which reduces storage costs considerably. We present an exact algorithm for allocating memory among the database operators. Because of its high complexity, we also propose a heuristic solution based on the benefit of an operator per unit memory allocation.

[1]  Luc Bouganim,et al.  PicoDBMS: Scaling down database techniques for the smartcard , 2001, The VLDB Journal.

[2]  Forouzan Golshani,et al.  Proceedings of the Eighth International Conference on Data Engineering , 1992 .

[3]  S. Poyser,et al.  The masters dissertation , 2006 .

[4]  Michael Stonebraker,et al.  Implementation techniques for main memory database systems , 1984, SIGMOD '84.

[5]  Goetz Graefe,et al.  Query evaluation techniques for large databases , 1993, CSUR.

[6]  Luc Bouganim,et al.  Memory Requirements for Query Execution in Highly Constrained Devices , 2003, VLDB.

[7]  Kenneth A. Ross,et al.  Cache Conscious Indexing for Decision-Support in Main Memory , 1999, VLDB.

[8]  Wei Hong,et al.  Proceedings of the 5th Symposium on Operating Systems Design and Implementation Tag: a Tiny Aggregation Service for Ad-hoc Sensor Networks , 2022 .

[9]  Debra E. VanderMeer,et al.  Applying Parallel Processing Techniques in Data Warehousing , 1998 .

[10]  Gerhard Weikum,et al.  A Database Striptease or How to Manage Your Personal Databases , 2003, VLDB.

[11]  Praveen Seshadri,et al.  SQLServer for Windows CE-a database engine for mobile and embedded platforms , 2000, Proceedings of 16th International Conference on Data Engineering (Cat. No.00CB37073).

[12]  T. Y. Cliff Leung,et al.  IBM DB2 Everyplace: a small footprint relational database system , 2001, Proceedings 17th International Conference on Data Engineering.

[13]  Ravi Krishnamurthy,et al.  Design of a Memory Resident DBMS , 1985, IEEE Computer Society International Conference.

[14]  Patricia G. Selinger,et al.  Access path selection in a relational database management system , 1979, SIGMOD '79.