An evaluation framework for cross‐platform mobile application development tools

The mobile application market is becoming increasingly fragmented with the availability of multiple mobile platforms that differ in development procedures. Developers are forced to choose to support only some platforms and specific devices because of limited development resources. To address these challenges, numerous tools have been created to aid developers in building cross‐platform applications; however, there is no metric to evaluate the quality of these tools or the applications produced by them. This paper introduces a framework for evaluating the features, performance, and development experience of existing and future cross‐platform development tools. The framework is implemented by benchmarking several tools, and the results identify a disparity in the features and performance of applications built using different development tools. Copyright © 2014 John Wiley & Sons, Ltd.

[1]  Damith C. Rajapakse Techniques for De-fragmenting Mobile Applications: A Taxonomy , 2008, SEKE.

[2]  Bobby Siegfried Enhanced student technology support with cross-platform mobile apps , 2011, SIGUCCS '11.

[3]  Kevin Skadron,et al.  A characterization of the Rodinia benchmark suite with comparison to contemporary CMP workloads , 2010, IEEE International Symposium on Workload Characterization (IISWC'10).

[4]  Fadi N. Sibai Evaluating the performance of single and multiple core processors with PCMARK®05 and benchmark analysis , 2008, PERV.

[5]  Arno Puder Cross-compiling Android applications to the iPhone , 2010, PPPJ.

[6]  Volker Turau,et al.  Cross-Platform Development Tools for Smartphone Applications , 2012, Computer.

[7]  Kevin Skadron,et al.  Rodinia: A benchmark suite for heterogeneous computing , 2009, 2009 IEEE International Symposium on Workload Characterization (IISWC).

[8]  Lutz Prechelt,et al.  An Empirical Comparison of Seven Programming Languages , 2000, Computer.

[9]  Andre Charland,et al.  Mobile application development , 2011, Commun. ACM.

[10]  Isaac D. Scherson,et al.  A Framework for Computer Performance Evaluation Using Benchmark Sets , 2000, IEEE Trans. Computers.

[11]  Lieven Eeckhout,et al.  Performance prediction based on inherent program similarity , 2006, 2006 International Conference on Parallel Architectures and Compilation Techniques (PACT).

[12]  Fabio Ricciato,et al.  Cross-Platform Access Control for Mobile Web Applications , 2012, 2012 IEEE International Symposium on Policies for Distributed Systems and Networks.

[13]  Antonio Cicchetti,et al.  Comparison of cross-platform mobile development tools , 2012, 2012 16th International Conference on Intelligence in Next Generation Networks.

[14]  Franz Wotawa,et al.  Java's alternatives and the limitations of Java when writing cross-platform applications for mobile devices in the medical domain , 2009, Proceedings of the ITI 2009 31st International Conference on Information Technology Interfaces.

[15]  Victor Lee,et al.  The RAW benchmark suite: computation structures for general purpose computing , 1997, Proceedings. The 5th Annual IEEE Symposium on Field-Programmable Custom Computing Machines Cat. No.97TB100186).

[16]  J. Mark Bull,et al.  Benchmarking Java against C and Fortran for scientific applications , 2001, JGI '01.

[17]  Kaisa Väänänen,et al.  Developing an expert evaluation method for user eXperience of cross-platform web services , 2009, MindTrek '09.

[18]  Gongzhu Hu,et al.  Compiling C++ programs to Java bytecode , 2005, Sixth International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing and First ACIS International Workshop on Self-Assembling Wireless Network.

[19]  Paul E. Dickson Cabana: a cross-platform mobile development system , 2012, SIGCSE '12.

[20]  Richard Fox,et al.  Testing the Computational Capabilities of Mobile Device Processors: Some Interesting Benchmark Results , 2010, 2010 IEEE/ACIS 9th International Conference on Computer and Information Science.

[21]  Linda Dailey Paulson Materials Breakthrough Could Eliminate Bootups , 2009, Computer.

[22]  Sougata Mukherjea,et al.  MobiVine: a middleware layer to handle fragmentation of platform interfaces for mobile applications , 2009, Middleware.

[23]  Petr Čečil,et al.  Cross-platform Mobile Development , 2016 .

[24]  P. Smutny,et al.  Mobile development tools and cross-platform solutions , 2012, Proceedings of the 13th International Carpathian Control Conference (ICCC).

[25]  R. M. Samant,et al.  Overview of smartphone application development using cross-platform framework , 2011, ICWET.

[26]  Marcelo Milrad,et al.  A Cross-Platform Software System to Create and Deploy Mobile Mashups , 2010, ICWE.

[27]  Philip J. Fleming,et al.  How not to lie with statistics: the correct way to summarize benchmark results , 1986, CACM.

[28]  G. P. Nikishkov,et al.  Comparison of C and Java performance in finite element computations , 2003 .

[29]  JoAnne Holliday,et al.  TMAPP – Typical Mobile Applications Benchmark , 2011 .

[30]  Anthony I. Wasserman,et al.  Software engineering issues for mobile application development , 2010, FoSER '10.

[31]  Arno Puder,et al.  Smartphone Cross-Compilation Framework for Multiplayer Online Games , 2010, 2010 Second International Conference on Mobile, Hybrid, and On-Line Learning.

[32]  Chia Feng Lin,et al.  A Cross-Platform Runtime Environment for Mobile Widget-Based Application , 2011, 2011 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery.

[33]  Rick Rogers Developing portable mobile web applications , 2010 .