Evaluation of the interactive multimedia business simulation SPACE (Simulating Project Auditing and Controlling Excellence)

This report presents the evaluation of the computer-based simulation SPACE – Simulating Project Auditing & Controlling Excellence – which is an interactive multiedia business simulation developed in partnership by Andersen Consulting and Siemens AG. The aims of SPACE are fostering self-directed learning and the acquisition of applicable knowledge in the economic domain regarding construction and solution projects of US GAAP. The evaluation was conducted in cooperation with the Institute of Educational Psychology at the Ludwig-Maximilians-University in Munich. The aim of the evaluation was to compare the effectiveness of SPACE with a traditional classroom instruction. Therefore, a problem-based transfer task was designed which assessed learning gains with respect to applicable knowledge in the following areas: (1) strategic knowledge and problem-solving skills, that means selection of appropriate information and strategies to solve a realistic business problem, (2) basic skills to calculate POC and (3) conceptual knowledge, i.e. an understanding of principles and interconnections of concepts in the domain. 38 students of business administration participated in the evaluation. 19 students learned eight hours with SPACE, the other 19 students received a traditional classroom instruction lasting also eight hours in the same subject area of US GAAP. Results show that SPACE was significantly better with regard to strategic knowledge and applying problem solving skills. In other words, the study showed that SPACE is superior to classroom instruction in this area of knowledge acquisition and application. In the other areas of basic skills to calculate POC and conceptional knowledge, differences were not significant between the classroom instruction and SPACE. When SPACE is employed under realistic conditions, i.e. in business, it can be assumed that SPACE is even more superior to classroom instruction.