Expanding Bloom's Two-Sigma Tutoring Theory Using Intelligent Agents: Application to Management Education

Thisarticledescribeshowmanagementeducationisengagedinsignificantprogrammaticreforms inresponsetothebusinesscommunity’scallforweb-savvy,problem-solvinggraduates.Web-based intelligent tutors provide a readily accessible vehicle for enhancing business students’ learning performanceaswellaspreparethemfortherigorsoftheglobalmarketplace.Aprimarygoalofthese AI-basedsystemsistoapproachBloom’stwo-sigmalearningperformancestandard.Bloomfound thataveragestudentstutoredone-to-onewithmasterylearningtechniquesperformedtwostandard deviationsbetterthanstudentswholearnedviaconventionalteachingmethods.Intelligenttutorscan alsobeusedtoidentifystudentsatrisk,toformulateappropriateinterventionplans,andtosupport teamlearning.Thepurposeofthisarticleistohighlightthegrowingpotentialforusingintelligent tutorstoenhancestudentandteamlearningopportunitiesandoutcomesandtooutlinestrategiesfor implementingthisrevolutionaryprocessthroughoutthemanagementeducationcommunityofpractice. KEywORdS Bloom Two-Sigma Performance, Implementation Strategies, Intelligent Tutors, Leaning Outcomes, Management Education

[1]  Christopher Ré,et al.  Elementary: Large-Scale Knowledge-Base Construction via Machine Learning and Statistical Inference , 2012, Int. J. Semantic Web Inf. Syst..

[2]  Huaiqing Wang,et al.  Enhancing e-learning effectiveness using an intelligent agent-supported personalized virtual learning environment: An empirical investigation , 2014, Inf. Manag..

[3]  T. Guskey.  Closing Achievement Gaps: Revisiting Benjamin S. Bloom's “Learning for Mastery” , 2007 .

[4]  H. Thomas,et al.  Business schools in transition? Issues of impact, legitimacy, capabilities and re‐invention , 2012 .

[5]  Sandra Waddock,et al.  Developing More Holistic Management Education: Lessons Learned From Two Programs , 2013 .

[6]  Ismail Sahin,et al.  Using Rogers’ Theory to Interpret Instructional Computer Use by COE Faculty , 2006 .

[7]  David Bevan,et al.  Experiential learning and management education , 2012 .

[8]  Ilana Stonebraker,et al.  Student See Versus Student Do: A Comparative Study of Two Online Tutorials , 2016 .

[9]  Vincent Aleven,et al.  Authoring Tools for Collaborative Intelligent Tutoring System Environments , 2014, Intelligent Tutoring Systems.

[10]  Kai Erenli,et al.  Collaborative and Social Learning using Virtual Worlds: Preparing Students for Virtually Anything , 2011, Int. J. Adv. Corp. Learn..

[11]  B. Bloom.  The 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as One-to-One Tutoring , 1984 .

[12]  Robby Soetanto,et al.  Global Multidisciplinary Learning in Construction Education: Lessons from Virtual Collaboration of Building Design Teams , 2012 .

[13]  Matthew D. Pistilli,et al.  Course signals at Purdue: using learning analytics to increase student success , 2012, LAK.

[14]  James Harland,et al.  MAINTENANCE GOALS IN INTELLIGENT AGENTS , 2014, Comput. Intell..

[15]  A. Brew,et al.  Achieving sustainability in learning and teaching initiatives , 2014 .

[16]  Adetokunbo A. A. Adenowo,et al.  A Metamodel for Designing an Intelligent Tutoring Systems Authoring Tool , 2014, Comput. Inf. Sci..

[17]  Wahidah Husain,et al.  A Review on Predicting Student's Performance Using Data Mining Techniques , 2015 .

[18]  Antonija Mitrovic,et al.  Learning with intelligent tutors and worked examples: selecting learning activities adaptively leads to better learning outcomes than a fixed curriculum , 2016, User Modeling and User-Adapted Interaction.

[19]  William Hahn,et al.  Online Homework Managers and Intelligent Tutoring Systems: A Study of Their Impact on Student Learning in the Introductory Financial Accounting Classroom , 2013 .

[20]  Justin G. Gardner,et al.  Best practices for using conditional release in online classes , 2011 .

[21]  Carol Springer Sargent,et al.  Find It, Fix It, and Thrive: The Impact of Insisting on Proficiency in Prerequisite Knowledge in Intermediate Accounting , 2013 .

[22]  Robert D. Costigan,et al.  Another perspective on MBA program alignment: An investigation of learning goals , 2014 .

[23]  Shih-Ching Yeh,et al.  Interactive Learning , 2022 .

[24]  Robert A. Sottilare,et al.  Challenges and Emerging Concepts in the Development of Adaptive, Computer-based Tutoring Systems for Team Training , 2011 .

[25]  Robert A. Sottilare,et al.  Recommendations for Modern Tools to Author Tutoring Systems , 2012 .

[26]  Angélica de Antonio Jiménez,et al.  Applying a student modeling with non-monotonic diagnosis to Intelligent Virtual Environment for Training/Instruction , 2014, Expert Syst. Appl..

[27]  Justin G. Gardner,et al.  Conditional Release of Course Materials: Assessing Best Practice Recommendations , 2014 .

[28]  Kathleen Spada.  Higher Education in the Digital Age [Book Review] , 2014, IEEE Transactions on Professional Communication.

[29]  M. Buil,et al.  An Explanatory Study of MBA Students with Regards to Sustainability and Ethics Commitment , 2016 .

[30]  Sanjay Mohapatra,et al.  Business school education and technology–a case study , 2013, Education and Information Technologies.

[31]  Thomas T. Hills.  Crowdsourcing content creation in the classroom , 2015, J. Comput. High. Educ..

[32]  Fatos Xhafa,et al.  Software Agents in Large Scale Open E-learning: A Critical Component for the Future of Massive Online Courses (MOOCs) , 2014, 2014 International Conference on Intelligent Networking and Collaborative Systems.

[33]  Baharuddin Aris,et al.  Enhancing Student's Higher Order Thinking Skills (HOTS) through the Socratic Method Approach with Technology , 2016, Int. J. Knowl. Based Organ..

[34]  Leen-Kiat Soh,et al.  Strategic Capability-Learning for Improved Multiagent Collaboration in Ad Hoc Environments , 2012, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[35]  Daniel L. Schwartz,et al.  Preparing students for future learning with Teachable Agents , 2010 .

[36]  Lalita Rajasingham,et al.  Will Mobile Learning Bring a Paradigm Shift in Higher Education , 2011 .

[37]  Fatos Xhafa,et al.  Enhancing Knowledge Management in Online Collaborative Learning , 2010, Int. J. Softw. Eng. Knowl. Eng..

[38]  William G. Bowen,et al.  Higher Education in the Digital Age , 2013, IEEE Trans. Prof. Commun..

[39]  W. Jacob,et al.  Professional development programmes at world-class universities , 2015, Palgrave Communications.

[40]  Fred Phillips,et al.  Online Homework versus Intelligent Tutoring Systems: Pedagogical Support for Transaction Analysis and Recording , 2008 .

[41]  Themis Panayiotopoulos,et al.  A Transparent and Decentralized Model of Perception and Action for Intelligent Virtual Agents , 2014, Int. J. Artif. Intell. Tools.

[42]  Jun Xu,et al.  A problem solving oriented intelligent tutoring system to improve students' acquisition of basic computer skills , 2015, Comput. Educ..

[43]  Wayne Holmes,et al.  Intelligence Unleashed: An argument for AI in Education , 2016 .

[44]  S. Sawilowsky.  New Effect Size Rules of Thumb , 2009 .

[45]  Kenneth R. Koedinger,et al.  Integrating representation learning and skill learning in a human-like intelligent agent , 2015, Artif. Intell..

[46]  W. Lewis Johnson,et al.  Tactical Language and Culture Training Systems: Using AI to Teach Foreign Languages and Cultures , 2009, AI Mag..

[47]  Vasile Rus,et al.  DeepTutor: An Effective, Online Intelligent Tutoring System That Promotes Deep Learning , 2015, AAAI.

[48]  The future of management education in Australia: challenges and innovations , 2013 .

[49]  Hsun-Ming Lee,et al.  E-Mentoring Through a Network of Practice on Facebook , 2015, Int. J. Knowl. Based Organ..

[50]  Lisa Marie Blaschke,et al.  Using social media to engage and develop the online learner in self-determined learning , 2014 .

[51]  K. Koedinger,et al.  Using Intelligent Tutor Technology to Implement Adaptive Support for Student Collaboration , 2010 .

[52]  Albert T. Corbett,et al.  Generalizing automated detection of the robustness of student learning in an intelligent tutor for genetics. , 2013 .

[53]  Olusola O. Adesope,et al.  Intelligent tutoring systems and learning outcomes: A meta-analysis , 2014 .

[54]  C. Hsiung,et al.  The Effectiveness of Cooperative Learning , 2012 .

[55]  Saurabh Pal,et al.  Mining Educational Data to Analyze Students' Performance , 2012, ArXiv.

[56]  Arthur C. Graesser,et al.  DeepTutor: towards macro- and micro-adaptive conversational intelligent tutoring at scale , 2014, L@S.

[57]  Doreen Starke-Meyerring,et al.  Designing globally networked learning environments : visionary partnerships, policies, and pedagogies , 2008 .

[58]  Touhid Bhuiyan,et al.  Measuring learning motivation of students in supply chain management games setting: a case study of Innov8.0 game , 2017 .

[59]  Massoud Rahimpour.  Computer Assisted Language Learning (CALL) , 2011 .

[60]  Shane Dawson,et al.  Mining LMS data to develop an "early warning system" for educators: A proof of concept , 2010, Comput. Educ..

[61]  Xia Mao,et al.  Agent based affective tutoring systems: A pilot study , 2010, Comput. Educ..

[62]  K. VanLehn.  The Relative Effectiveness of Human Tutoring, Intelligent Tutoring Systems, and Other Tutoring Systems , 2011 .

[63]  Dheeraj Raju,et al.  Comparing Data Mining Models in Academic Analytics , 2016, Int. J. Knowl. Based Organ..

[64]  Albert T. Corbett,et al.  The Knowledge-Learning-Instruction Framework: Bridging the Science-Practice Chasm to Enhance Robust Student Learning , 2012, Cogn. Sci..

[65]  Vincent Aleven,et al.  Example-Tracing Tutors: Intelligent Tutor Development for Non-programmers , 2016, International Journal of Artificial Intelligence in Education.

[66]  Erich C. Dierdorff,et al.  Building a Better MBA: From a Decade of Critique Toward a Decennium of Creation , 2013 .

[67]  W. Lewis Johnson,et al.  Animated Agents for Procedural Training in Virtual Reality: Perception, Cognition, and Motor Control , 1999, Appl. Artif. Intell..

[68]  Undergraduate Business Education: It's Time to Think Outside the Box , 2013 .

[69]  Ana González-Marcos,et al.  Student evaluation of a virtual experience for project management learning: An empirical study for learning improvement , 2016, Comput. Educ..

[70]  James A. Kulik,et al.  Effectiveness of Intelligent Tutoring Systems , 2016 .

[71]  Arthur C. Graesser,et al.  Recent Advances in Conversational Intelligent Tutoring Systems , 2013, AI Mag..

[72]  Mehri Mohammad Bagheri.  Intelligent and Adaptive Tutoring Systems: How to Integrate Learners , 2015 .

[73]  Oren Etzioni,et al.  Artificial intelligence and life in 2030: the one hundred year study on artificial intelligence , 2016 .

[74]  H. Cooper,et al.  A meta-analysis of the effectiveness of intelligent tutoring systems on college students' academic learning , 2014 .

[75]  Reyes Juárez-Ramírez,et al.  Evaluation module based on Bayesian networks to Intelligent Tutoring Systems , 2017, Int. J. Inf. Manag..

[76]  Dan V. Caprar,et al.  Virtual Teams and International Business Teaching and Learning: The Case of the Global Enterprise Experience (GEE) , 2014 .

[77]  Luca Mainetti,et al.  A Portal of Educational Resources: Providing Evidence for Matching Pedagogy with Technology. , 2014 .

[78]  Mayukh Dass,et al.  Transforming Marketing Education Of The Future: The Role Of Intelligent Agent Technologies (IATs) In Enhancing Student Learning , 2013 .

[79]  W. James Jacob,et al.  Interdisciplinary Trends in Higher Education , 2015 .

[80]  Fahri Karakaş,et al.  Management Learning at the Speed of Life: Designing Reflective, Creative, and Collaborative Spaces for Millenials , 2015 .

[82]  Muhammad Zahid,et al.  BUSINESS EDUCATION CURRICULUM AND MANAGEMENT SKILLS: A VIEWPOINT OF STUDENTS AND MANAGERS , 2013 .

[83]  Ryan Shaun Joazeiro de Baker,et al.  Stupid Tutoring Systems, Intelligent Humans , 2016, International Journal of Artificial Intelligence in Education.

[84]  Marie Bienkowski,et al.  Enhancing Teaching and Learning Through Educational Data Mining and Learning Analytics: An Issue Brief , 2012 .

[85]  Heather A. Priest,et al.  Current Trends in Adaptive Training With Military Applications: An Introduction , 2012 .

[86]  Janice K. Winch,et al.  Improving Student Performance in a Management Science Course With Supplemental Tutorial Videos , 2015 .