BEAT: An Open-Source Web-Based Open-Science Platform

With the increased interest in computational sciences, machine learning (ML), pattern recognition (PR) and big data, governmental agencies, academia and manufacturers are overwhelmed by the constant influx of new algorithms and techniques promising improved performance, generalization and robustness. Sadly, result reproducibility is often an overlooked feature accompanying original research publications, competitions and benchmark evaluations. The main reasons behind such a gap arise from natural complications in research and development in this area: the distribution of data may be a sensitive issue; software frameworks are difficult to install and maintain; Test protocols may involve a potentially large set of intricate steps which are difficult to handle. Given the raising complexity of research challenges and the constant increase in data volume, the conditions for achieving reproducible research in the domain are also increasingly difficult to meet. To bridge this gap, we built an open platform for research in computational sciences related to pattern recognition and machine learning, to help on the development, reproducibility and certification of results obtained in the field. By making use of such a system, academic, governmental or industrial organizations enable users to easily and socially develop processing toolchains, re-use data, algorithms, workflows and compare results from distinct algorithms and/or parameterizations with minimal effort. This article presents such a platform and discusses some of its key features, uses and limitations. We overview a currently operational prototype and provide design insights.

[1]  Sébastien Marcel,et al.  Periocular biometrics in mobile environment , 2015, 2015 IEEE 7th International Conference on Biometrics Theory, Applications and Systems (BTAS).

[2]  B. Jasny,et al.  Again, and Again, and Again … , 2011 .

[3]  Patrick Vandewalle,et al.  Code Sharing Is Associated with Research Impact in Image Processing , 2012, Computing in Science & Engineering.

[4]  Mohak Shah,et al.  Comparative Study of Caffe, Neon, Theano, and Torch for Deep Learning , 2015, ArXiv.

[5]  Korshunov Pavel,et al.  Joint operation of voice biometrics and presentation attack detection , 2016 .

[6]  Jugurta R. Montalvão Filho,et al.  KBOC: Keystroke biometrics OnGoing competition , 2016, 2016 IEEE 8th International Conference on Biometrics Theory, Applications and Systems (BTAS).

[7]  Keith Price,et al.  Anything you can do, I can do better (No you can't) , 1986, Comput. Vis. Graph. Image Process..

[8]  Răzvan Viorescu 2018 REFORM OF EU DATA PROTECTION RULES , 2017 .

[9]  M. Baker 1,500 scientists lift the lid on reproducibility , 2016, Nature.