The Formation of an E-portfolio Indicator for Malaysia Skills Certificate: A Modified Delphi Survey

Abstract The use of e-Portfolios over paper-based portfolio which provide a more effective means of information storage has become very popular nowadays. However, assessment indicators for e-Portfolios can vary according to a particular educational system. This also implies for the field of Technical Vocational Education Training (TVET). For TVET in Malaysia, students would undergo a technical competence certification called the Malaysian Skills Certification Malaysia (MSCM), established by the National Occupational Skill Standard (NOSS). This certification ensures that TVET students achieve certain competency standards in their area of specification upon graduation. These students are acquired to create paper-based portfolios to demonstrate their knowledge and competence level. The problem is that current studies show that paper-based portfolios are problematic and e-Portfolios have the potential to address this problem. Nevertheless, recent studies show that there is a lack of an e-Portfolio indicator for TVET. In an attempt to address this problem, the study aims to investigate the factors and indicators of e-Portfolio in accordance to the standards of MSCM. A modified Delphi study was conducted with a panel of 11 experts who are competent and experienced in the use of portfolio and ICT in TVET. The study consisted of three Delphi rounds. In the first round, 17 indicators of a TVET e-Portfolio were identified via the literature. These elements were categorized into four main groups: (i) the recognition of prior achievements, (ii) virtual learning space, (iii) competency assessment, and (iv) operating system. In the second and third rounds, the elements from each previous round were assessed by the expert panel until a consensus was achieved. These findings were then analyzed using mean analysis and inter quartile range. The analysis indicated that the 17 indicators identified were important in assessment of TVET graduates. The new indicator for MSCM could be used to measure whether TVET students have achieved the level of knowledge and competency required by NOSS in order to be competent for the workplace.

[1]  Marilyn Cochran-Smith,et al.  Teaching and Teacher Education , 2016 .

[2]  Helen C. Barrett,et al.  Balancing the Two Faces of ePortfolios , 2010 .

[3]  Asnul Dahar Minghat.  Pembinaan Indikator Dan Model pengukuran Kelestarian Mata Pelajaran Vokasional (MPV) Sekolah Menengah Harian , 2012 .

[4]  Peter Caputi,et al.  Introduction to Quantitative Research Methods: An Investigative Approach , 2001 .

[5]  David Gibson,et al.  Directions in Electronic Portfolio Development , 2003 .

[6]  Robin Mason,et al.  The Educational Potential of e-Portfolios: Supporting Personal Development and Reflective Learning , 2007 .

[7]  Nicole A. Buzzetto-More,et al.  A Comparative Analysis of Common E-Portfolio Features and Available Platforms , 2007 .

[8]  Terry Neal.  Open and Flexible TVET in Commonwealth Pacific Countries. , 2011 .

[9]  Juri Pill,et al.  The Delphi method: Substance, context, a critique and an annotated bibliography , 1971 .

[10]  Adolfo Guzmán-Arenas,et al.  The Eva Teleteaching Project - The Concept and the FTurcsányiirst Experience in the Development of Virtual Learning Spaces , 1998, Teleteaching.

[11]  Floyd Urbach,et al.  Developing a Teaching Portfolio , 1992 .

[12]  David H. Gustafson,et al.  Group Techniques for Program Planning: A Guide to Nominal Group and Delphi Processes , 1976 .

[13]  Peter Caputi,et al.  Introduction to quantitative research methods , 2001 .

[14]  Wahid Razzaly,et al.  PORTFOLIO FRAMEWORK FOR RECOGNITION PRIOR LEARNING FOR TECHNICAL PROGRAMMES IN MALAYSIA , 2010 .

[15]  David T Ku,et al.  uFolio: A conceptual design framework for a learning platform and assessment system , 2011, The 7th International Conference on Networked Computing and Advanced Information Management.

[16]  M. Bhattacharya,et al.  E-portfolio assessment in higher education , 2007, 2007 37th Annual Frontiers In Education Conference - Global Engineering: Knowledge Without Borders, Opportunities Without Passports.

[17]  Kenneth M. Zeichner,et al.  The teaching portfolio in US teacher education programs: what we know and what we need to know , 2001 .

[18]  Enrique Mu,et al.  Meta-model of EPortfolio Usage in Different Environments , 2011, Int. J. Emerg. Technol. Learn..

[19]  Lynn M. McAllister,et al.  The ePortfolio approach: Supporting authentic assessment for student learning , 2011 .

[20]  L. Cohen,et al.  Research Methods in Education , 1980 .

[21]  W. Paul Vogt,et al.  Quantitative research methods for professionals , 2006 .

[22]  Yves Punie,et al.  Learning Spaces: an ICT‐enabled model of future learning in the Knowledge‐based Society , 2007 .

[23]  J. Devore,et al.  Statistics: The Exploration and Analysis of Data , 1986 .

[24]  John DiMarco.  Web portfolio design and applications , 2006 .