Proposing a practical training assessment technique to adopt simulators into marine engineering education

In marine engineering programmes, simulators are the key infrastructures to support learning outcomes comply with the designated minimum competencies within the International Convention on Standards of Training, Certification and Watchkeeping for Seafarers (STCW). The practical training concept in full mission engine room simulators (FM-ERSs) includes the key aspects such as competency selection, scenario description, task identification, observation procedure, data gathering, initial condition preparation, briefing, conducting exercises, assessment and debriefing. At this insight, the learning outcomes are highly depending upon assessment system aligning with the knowledge, understanding and proficiency to consistently prove whether the competencies are achieved or not. To achieve a comprehensive competency analysis, this paper offers a methodological approach based on Technique for Order Preference by Similarity to Ideal Solution (TOPSIS) method. The proposed assessment system is demonstrated with different scenarios (i.e. test, start and prepare D/G-II for standby) applied to 16 marine engineering students in a team context. The demonstration study yields the individual performance and team achievements through the given tasks. Consequently, the suggested assessment system contributes to marine engineering competencies in term of enhancing learning outcomes, instructor capability, course and infrastructure development. Furthermore, the assessment approach can be extended to practical studies in other disciplines.

[1]  Bjørn-Morten Batalden,et al.  Maritime safety and the ISM code: a study of investigated casualties and incidents , 2014 .

[2]  P. Vasilakis,et al.  A Methodological Framework for Evaluating Maritime Simulation , 2012 .

[3]  Ross J. Scalese,et al.  Simulation Technology for Skills Training and Competency Assessment in Medical Education , 2007, Journal of General Internal Medicine.

[4]  Development and validation of a checklist for assessing recorded performance of laparoscopic inguinal hernia repair. , 2016, American journal of surgery.

[5]  Mohammad Noman,et al.  The role of goal orientations in students’ perceptions of classroom assessment in higher education , 2018 .

[6]  Ching-Lai Hwang,et al.  Multiple Attribute Decision Making: Methods and Applications - A State-of-the-Art Survey , 1981, Lecture Notes in Economics and Mathematical Systems.

[7]  M. Jurian,et al.  Work in progress: E-Learning Impact on Romanian Maritime Education , 2006, Proceedings. Frontiers in Education. 36th Annual Conference.

[8]  G. Dimitrios Engine control simulator as a tool for preventive maintenance , 2012 .

[9]  G. Miller The assessment of clinical skills/competence/performance , 1990, Academic medicine : journal of the Association of American Medical Colleges.

[10]  Takashi Miwa,et al.  Using physiological signals to measure operator’s mental workload in shipping – an engine room simulator study , 2017 .

[11]  F. Lateef Simulation-based learning: Just like the real thing , 2010, Journal of emergencies, trauma, and shock.

[12]  L. Vos Simulation games in business and marketing education: How educators assess student learning from simulations , 2015 .

[13]  Jian Bo Sun,et al.  Marine Engine Simulation System for Crew Operation Examination Based on Virtual Reality , 2013 .

[14]  Rabiul Islam,et al.  Development of a monograph for human error likelihood assessment in marine operations , 2017 .

[15]  Nick Sevdalis,et al.  Implementation results of a novel comprehensive mental skills curriculum during simulator training. , 2017, American journal of surgery.

[16]  Asghar Ali,et al.  SIMULATOR INSTRUCTOR - STCW REQUIREMENTS AND REALITY , 2006 .

[17]  Ching-Lai Hwang,et al.  Fuzzy Multiple Attribute Decision Making - Methods and Applications , 1992, Lecture Notes in Economics and Mathematical Systems.

[18]  Susan J. Deeley Using technology to facilitate effective assessment for learning and feedback in higher education , 2018 .

[19]  Stefan Kluj Usability criteria for simulators applied in the maritime engineering education , 2003 .

[20]  Charlott Sellberg,et al.  Simulators in bridge operations training and assessment: a systematic review and qualitative synthesis , 2017 .

[21]  Hideo Yabuki The 2010 Manila amendments to the STCW convention and code and changes in maritime education and training , 2011 .

[22]  Wes Martz,et al.  Validating an evaluation checklist using a mixed method design. , 2010, Evaluation and program planning.

[23]  Shelly J. Reed Designing a Simulation for Student Evaluation Using Scriven's Key Evaluation Checklist , 2010 .

[24]  María Teresa Lamata,et al.  On rank reversal and TOPSIS method , 2012, Math. Comput. Model..

[25]  S. Farid Mousavi,et al.  TQM consultant selection in SMEs with TOPSIS under fuzzy environment , 2009, Expert Syst. Appl..

[26]  Dimitrios Papachristos,et al.  Marine engineers’ training: Educational assessment for an engine room simulator , 2008 .

[27]  A Checklist Intervention to Assess Resident Diagnostic Knee and Shoulder Arthroscopic Efficiency. , 2017, Journal of surgical education.

[28]  S. Vinodh,et al.  Integrated Fuzzy AHP–TOPSIS for selecting the best plastic recycling method: A case study , 2014 .

[29]  Metin Celik,et al.  Utilisation of Cognitive Map in Modelling Human Error in Marine Accident Analysis and Prevention , 2014 .

[30]  R Alimen Engine Room Simulator (ERS) Training Course: Practicability and Essentiality Onboard Ship , 2013 .

[31]  Suvranu De,et al.  A hierarchical task analysis of cricothyroidotomy procedure for a virtual airway skills trainer simulator. , 2016, American journal of surgery.

[32]  John E. Ziewacz,et al.  Crisis checklists for the operating room: development and pilot testing. , 2011, Journal of the American College of Surgeons.

[33]  Bram E. Vaessen,et al.  Students’ perception of frequent assessments and its relation to motivation and grades in a statistics course: a pilot study , 2017 .

[34]  Jing Feng,et al.  Development Research of Marine Engine Room Simulator for Offshore Supply Vessel Based On Virtual Reality Technology , 2016, MUE 2016.

[35]  Janice Palaganas,et al.  Authoring Simulations for High-Stakes Student Evaluation , 2014 .