论文信息 - A Service-Oriented Infrastructure for Teaching Big Data Technologies

A Service-Oriented Infrastructure for Teaching Big Data Technologies

The paper presents an experience in incorporating Big Data technologies into introductory parallel and distributed computing courses and building a service-oriented infrastructure to support practical exercises involving these technologies. The presented approach helped to provide a smooth practical experience for students with different technical background by enabling them to run and test their MapReduce and Spark programs on a provided Hadoop cluster via convenient web interfaces. This approach also enabled automation of routine actions related to submission of programs to a cluster and evaluation of programming assignments.

Oleg Sukhoroslov

[1] Valentina Kustikova,et al. Internet-Oriented Educational Course “Introduction to Parallel Computing”: A Simple Way to Start , 2016 .

[2] Oleg Sukhoroslov,et al. A Web-Based Platform for Publication and Distributed Execution of Computing Applications , 2015, 2015 14th International Symposium on Parallel and Distributed Computing.

[3] Marek Nowicki,et al. On-line Service for Teaching Parallel Programming , 2015, Euro-Par Workshops.

[4] Juan Touriño,et al. A grid portal for an undergraduate parallel programming course , 2005, IEEE Transactions on Education.

[5] Riccardo Sisto,et al. A Grid-Powered Framework to Support Courses on Distributed Programming , 2007, IEEE Transactions on Education.

[6] Tom White,et al. Hadoop: The Definitive Guide , 2009 .

[7] Bertil Schmidt,et al. SAUCE: A Web-Based Automated Assessment Tool for Teaching Parallel Programming , 2015, Euro-Par Workshops.

[8] Sanjay Ghemawat,et al. MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[9] Richard A. Brown,et al. WebMapReduce: an accessible and adaptable tool for teaching map-reduce computing , 2011, SIGCSE '11.

[10] Scott Shenker,et al. Spark: Cluster Computing with Working Sets , 2010, HotCloud.

[11] Kivanc Dincer,et al. Design issues in building Web-based parallel programming environments , 1997, Proceedings. The Sixth IEEE International Symposium on High Performance Distributed Computing (Cat. No.97TB100183).