Machine Reading of Hypotheses for Organizational Research Reviews and Pre-trained Models via R Shiny App for Non-Programmers

The volume of scientific publications in organizational research becomes exceedingly overwhelming for human researchers who seek to timely extract and review knowledge. This paper introduces natural language processing (NLP) models to accelerate the discovery, extraction, and organization of theoretical developments (i.e., hypotheses) from social science publications. We illustrate and evaluate NLP models in the context of a systematic review of stakeholder value constructs and hypotheses. Specifically, we develop NLP models to automatically 1) detect sentences in scholarly documents as hypotheses or not (Hypothesis Detection), 2) deconstruct the hypotheses into nodes (constructs) and links (causal/associative relationships) (Relationship Deconstruction ), and 3) classify the features of links in terms causality (versus association) and direction (positive, negative, versus nonlinear) (Feature Classification). Our models have reported high performance metrics for all three tasks. While our models are built in Python, we have made the pre-trained models fully accessible for non-programmers. We have provided instructions on installing and using our pre-trained models via an R Shiny app graphic user interface (GUI). Finally, we suggest the next paths to extend our methodology for computer-assisted knowledge synthesis.

[1]  Kamel Mellahi,et al.  A Study of Management Perceptions of the Impact of Corporate Social Responsibility on Organisational Performance in Emerging Economies: The Case of Dubai , 2009 .

[2]  Nuria E. Hurtado-Torres,et al.  Environmental strategy and performance in small firms: a resource-based perspective. , 2008, Journal of environmental management.

[3]  Long W. Lam,et al.  Human resource orientation and corporate performance , 1998 .

[4]  I. Chow,et al.  The effect of aligning organizational culture and business strategy with HR systems on firm performance in Chinese enterprises , 2009 .

[5]  Christopher Marquis,et al.  Corporate Social Responsibility Reporting in China: Symbol or Substance? , 2011, Organ. Sci..

[6]  B. Brown,et al.  REMOVING THE FINANCIAL PERFORMANCE HALO FROM FORTUNE'S "MOST ADMIRED" COMPANIES , 1994 .

[7]  Yenming J. Chen,et al.  Moderating effect of environmental supply chain collaboration: Evidence from Taiwan , 2015 .

[8]  Albert A. Cannella,et al.  Revisiting the Performance Consequences of CEO Succession : The Impacts of Successor Type , Postsuccession Senior Executive Turnover , and Departing CEO Tenure , 2007 .

[9]  Damodar Suar,et al.  Does Corporate Social Responsibility Influence Firm Performance of Indian Companies? , 2010 .

[10]  D. Siegel,et al.  Assessing the Relationship between Human Capital and Firm Performance: Evidence from Technology–Based New Ventures , 2007 .

[11]  R. Narasimhan,et al.  Managing beyond the factory walls: Effects of four types of strategic integration on manufacturing plant performance , 2007 .

[12]  J. Xun Corporate Social Responsibility in China: a Preferential Stakeholder Model and Effects , 2013 .

[13]  Robert S. Huckman,et al.  Managing the Impact of Employee Turnover on Performance: The Role of Process Conformance , 2008, Organ. Sci..

[14]  Stuart L. Hart,et al.  Do Corporate Global Environmental Standards Create or Destroy Market Value , 2000 .

[15]  Onne Janssen,et al.  Employees' goal orientations, the quality of leader-member exchange, and the outcomes of job performance and job satisfaction , 2004 .

[16]  F. Bellavance,et al.  Causality Between Corporate Social Performance and Financial Performance: Evidence from Canadian Firms , 2009 .

[17]  I. Chow,et al.  Strategic HRM in China: Configurations and competitive advantage. , 2008 .

[18]  Sui-Hua Yu,et al.  An Empirical Investigation on the Economic Consequences of Customer Satisfaction , 2007 .

[19]  Matthew S. Kraatz,et al.  Character, Conformity, or the Bottom Line? How and Why Downsizing Affected Corporate Reputation , 2009 .

[20]  Sabariah Yaakub,et al.  Reverse logistics: Pressure for adoption and the impact on firm’s performance , 2014 .

[21]  S. Zahra,et al.  Sources of capabilities, integration and technology commercialization , 2002 .

[22]  Jeremy D. Meuser,et al.  Servant leadership and serving culture: Influence on individual and unit performance , 2014 .

[23]  James Guthrie,et al.  The impact of diversity and equality management on firm performance: Beyond high performance work systems , 2010 .

[24]  Sean A. Way High Performance Work Systems and Intermediate Indicators of Firm Performance Within the US Small Business Sector , 2002 .

[25]  T. Douglas,et al.  Total Quality Management Implementation and Competitive Advantage: The Role of Structural Control and Exploration , 2001 .

[26]  S M Shortell,et al.  The Performance of Intensive Care Units: Does Good Management Make a Difference? , 1994, Medical care.

[27]  Alexander J. S. Colvin,et al.  An Employment Systems Approach to Turnover: Human Resources Practices, Quits, Dismissals, and Performance , 2011 .

[28]  Suhaiza Hanim Binti Dato Mohamad Zailani,et al.  A study on the impact of environmental management system (EMS) certification towards firms' performance in Malaysia , 2006 .

[29]  Stephen. Pavelin,et al.  Voluntary SOCIAL DISCLOSURES by Large UK Companies , 2004 .

[30]  David L. Deephouse,et al.  Media Reputation as a Strategic Resource: An Integration of Mass Communication and Resource-Based Theories , 1999 .

[31]  T. Douglas,et al.  Performance Implications of Incorporating Natural Environmental Issues into the Strategic Planning Process: An Empirical Assessment , 1998 .

[32]  Lucie K. Ozanne,et al.  The Interactive Effect of Internal and External Factors on a Proactive Environmental Strategy and its Influence on a Firm's Performance , 2010 .

[33]  Corporate Social Responsibility and Stock Market Performance , 2006 .

[34]  Jingjing Li,et al.  TheoryOn: A Design Framework and System for Unlocking Behavioral Knowledge Through Ontology Learning , 2020, MIS Q..

[35]  David J. Flanagan,et al.  The Effect of Layoffs on Firm Reputation , 2005 .

[36]  Michael D. Pfarrer,et al.  A Tale of Two Assets: The Effects of Firm Reputation and Celebrity on Earnings Surprises and Investors' Reactions , 2010 .

[37]  Jonathan L. Johnson,et al.  Turnover, Social Capital Losses, and Performance , 2005 .

[38]  Torsten Oliver Salge,et al.  Computational Literature Reviews: Method, Algorithms, and Roadmap , 2021, Organizational Research Methods.

[39]  W. Stanley Siebert,et al.  SEARCHING FOR THE OPTIMAL LEVEL OF EMPLOYEE TURNOVER: A STUDY OF A LARGE U.K. RETAIL ORGANIZATION , 2009 .

[40]  Jaepil Choi,et al.  Stakeholder relations and the persistence of corporate financial performance , 2009 .

[41]  Danny Miller,et al.  Strategy, Environment and Performance in Two Technological Contexts: Contingency Theory in Korea , 1996 .

[42]  Siddhartha R. Jonnalagadda,et al.  Automating data extraction in systematic reviews: a systematic review , 2015, Systematic Reviews.

[43]  Jeffrey B. Arthur,et al.  Effects of human resource systems on manufacturing performance and turnover , 1994 .

[44]  Bruce C. Skaggs,et al.  STRATEGIC POSITIONING, HUMAN CAPITAL, AND PERFORMANCE IN SERVICE ORGANIZATIONS: A CUSTOMER INTERACTION APPROACH. , 2003 .

[45]  A. Tishler,et al.  Perceived Organizational Reputation and Organizational Performance: An Empirical Investigation of Industrial Enterprises , 2005 .

[46]  Sendil K. Ethiraj,et al.  Where Do Capabilities Come from and How Do They Matter? A Study in the Software Services Industry , 2005 .

[47]  C. Fombrun,et al.  What's in a Name? Reputation Building and Corporate Strategy , 1990 .

[48]  Lucie K. Ozanne,et al.  Challenges of the “green imperative”: a natural resource-based approach to the environmental orientation–business performance relationship , 2005 .

[49]  Danny Miller,et al.  The people make the process: commitment to employees, decision making, and performance , 2001 .

[50]  Michael A. Hitt,et al.  Knowledge Synthesis for Scientific Management: Practical Integration for Complexity Versus Scientific Fragmentation for Simplicity , 2019, Journal of Management Inquiry.

[51]  Jeanine Chang,et al.  Corporate social responsibility and firm performance: The mediating role of marketing competence and the moderating role of market environment , 2015, Asia Pacific Journal of Management.

[52]  Riki Takeuchi,et al.  An Empirical Examination of the Mechanisms Mediating between High-Performance Work Systems and the Performance of Japanese Organizations , 2006, The Journal of applied psychology.

[53]  Stephen. Pavelin,et al.  Corporate Reputation and Social Performance: The Importance of Fit , 2006 .

[54]  Heli Wang,et al.  Corporate Philanthropy and Corporate Financial Performance: The Roles of Stakeholder Response and Political Access , 2011 .

[55]  Byron C. Wallace,et al.  Toward systematic review automation: a practical guide to using machine learning tools in research synthesis , 2019, Systematic Reviews.

[56]  Brooks C. Holtom,et al.  Customer Satisfaction as a Mediator of the Turnover- Performance Relationship , 2011 .

[57]  Peter M. Clarkson,et al.  Revisiting the Relation between Environmental Performance and Environmental Disclosure: An Empirical Analysis , 2006 .

[58]  W. Davidson,et al.  Corporate Environmental Initiatives and Anticipated Firm Performance: The Differential Effects of Process-Driven Versus Product-Driven Greening Initiatives , 2000 .

[59]  John E. Delery,et al.  Alternative Conceptualizations of the Relationship Between Voluntary Turnover and Organizational Performance , 2005 .

[60]  Taiwen Feng,et al.  Environmental management systems and financial performance: The joint effect of switching cost and competitive intensity , 2016 .

[61]  G. M. Castro,et al.  Business and Social Reputation: Exploring the Concept and Main Dimensions of Corporate Reputation , 2006 .

[62]  Michael J. Paul,et al.  Improving Usability of Social and Behavioral Sciences' Evidence: A Call to Action for a National Infrastructure Project for Mining Our Knowledge , 2020, Commun. Assoc. Inf. Syst..

[63]  Illtyd Trethowan Causality , 1938 .

[64]  D. Cormier,et al.  An examination of social and environmental reporting strategies , 2001 .

[65]  Kenneth L. Bernhardt,et al.  A Longitudinal Analysis of Satisfaction and Profitability , 2000 .

[66]  Chi Ming Tam,et al.  How environmental management driving forces affect environmental and economic performance of SMEs: a study in the Northern China district , 2011 .

[67]  Terry C. Blum,et al.  Work-family human resource bundles and perceived organizational performance , 2000 .

[68]  S. Akhtar,et al.  Strategic HRM practices and their impact on company performance in Chinese enterprises , 2008 .

[69]  Kalina Bontcheva,et al.  Getting More Out of Biomedical Documents with GATE's Full Lifecycle Open Source Text Analytics , 2013, PLoS Comput. Biol..

[70]  K. Tuomi,et al.  HRM, Company Performance and Employee Well-being , 2006 .

[71]  M. Sheehan Human resource management and performance: Evidence from small and medium-sized firms , 2014 .

[72]  E. H. Bax,et al.  Is High Employee Turnover Really Harmful? An Empirical Test Using Company Records , 2004 .

[73]  S. Tzafrir A universalistic perspective for explaining the relationship between HRM practices and firm performance at different points in time , 2006 .

[74]  Clayton T. Morrison,et al.  Large-scale automated machine reading discovers new cancer-driving mechanisms , 2018, Database J. Biol. Databases Curation.

[75]  An Yang,et al.  Machine Reading Comprehension: a Literature Review , 2019, ArXiv.

[76]  Mikael Niskala,et al.  Communication via responsibility reporting and its effect on firm value in Finland , 2010 .

[77]  Joseph E. Coombs,et al.  Stakeholder management as a predictor of CEO compensation: main effects and interactions with financial performance , 2005 .

[78]  Daniel B. Turban,et al.  Human resource practices and firm performance of multinational corporations: influences of country origin , 1998 .

[79]  Jacques Liouville,et al.  Human Resource Management and Performances. Proposition and Test of a Causal Model , 1998 .

[80]  S. Teo,et al.  HRM professionals and their perceptions of HRM and firm performance in the Philippines , 2005 .

[81]  Neil Conway,et al.  Human Resource Management and Corporate Performance in the UK , 2003 .

[82]  Niels Westergaard-Nielsen,et al.  Personnel policy and profit , 2004 .

[83]  Ken G. Smith,et al.  Knowledge Exchange and Combination: The Role of Human Resource Practices in the Performance of High-Technology Firms , 2006 .

[84]  Dong-One Kim,et al.  Good Neighbors but Bad Employers: Two Faces of Corporate Social Responsibility Programs , 2016 .

[85]  Keah Choon Tan,et al.  Green supply chain management practices and performance , 2013, Ind. Manag. Data Syst..

[86]  J. Gould-Williams The importance of HR practices and workplace trust in achieving superior performance: A study of public-sector organizations , 2003 .

[87]  Hans-Michael Müller,et al.  Textpresso: An Ontology-Based Information Retrieval and Extraction System for Biological Literature , 2004, PLoS biology.

[88]  M. L. Stein,et al.  How to write plain English , 1975 .

[89]  Alvaro López-Cabrales,et al.  Leveraging the innovative performance of human capital through HRM and social capital in Spanish firms , 2011 .

[90]  H. Liao,et al.  STRATEGIC HUMAN RESOURCE MANAGEMENT IN SERVICE CONTEXT: TAKING CARE OF BUSINESS BY TAKING CARE OF EMPLOYEES AND CUSTOMERS , 2010 .

[91]  Ethan R. Burris,et al.  Managerial modes of influence and counterproductivity in organizations: a longitudinal business-unit-level investigation. , 2007, The Journal of applied psychology.

[92]  Garry A. Gelade,et al.  The Impact of Human Resource Management and Work Climate on Organizational Performance , 2003 .

[93]  Douglas W. Lyon,et al.  Involvement in Knowledge–Acquisition Activities by Venture Team Members and Venture Performance , 2009 .

[94]  Pawan S. Budhwar,et al.  Human resource management systems and organizational performance: a test of a mediating model in the Greek manufacturing context , 2006 .

[95]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[96]  Jeffrey C. Carver,et al.  Automating Systematic Literature Review , 2020, Contemporary Empirical Methods in Software Engineering.

[97]  Chwen Sheu,et al.  The link between eco-innovation and business performance: a Taiwanese industry context , 2014 .

[98]  J. Lawler,et al.  Organizational and HRM Strategies in Korea: Impact on Firm Performance in an Emerging Economy , 2000 .

[99]  V. Magness Strategic posture, financial performance and environmental disclosure: An empirical test of legitimacy theory , 2006 .

[100]  Kamel Mellahi,et al.  Market Orientation, Corporate Social Responsibility, and Business Performance , 2011 .

[101]  Hale Kaynak,et al.  The relationship between total quality management: practices and their effects on firm performance , 2003 .

[102]  Mark A. Huselid The Impact of Human Resource Management Practices on Turnover, Productivity, and Corporate Financial Performance , 1995 .

[103]  Patrick M. Wright,et al.  The role of human resource practices in petro-chemical refinery performance , 1999 .

[104]  James G. Combs,et al.  Explaining interfirm cooperation and performance: toward a reconciliation of predictions from the resource-based view and organizational economics , 1999 .

[105]  Sang M. Lee,et al.  Green supply chain management and organizational performance , 2012, Ind. Manag. Data Syst..

[106]  Timothy M. Gardner,et al.  THE RELATIONSHIP BETWEEN HR PRACTICES AND FIRM PERFORMANCE: EXAMINING CAUSAL ORDER , 2005 .

[107]  Toyah L. Miller,et al.  Demographic Diversity in the Boardroom: Mediators of the Board Diversity - Firm Performance Relationship , 2009 .

[108]  Josep Llach,et al.  Joint impact of quality and environmental practices on firm performance in small service businesses: an empirical study of restaurants , 2013 .

[109]  A. Bird,et al.  Links Between Business Strategy and Human Resource Management Strategy in U.S.-Based Japanese Subsidiaries: An Empirical Investigation , 1995 .

[110]  T. Tagesson,et al.  What explains the extent and content of social disclosures in Swedish municipalities’ annual reports , 2011, Journal of Management & Governance.

[111]  Chongwoo Choe,et al.  Corporate social responsibility and corporate financial performance: Evidence from Korea , 2010 .

[112]  Inmaculada Beltrán-Martín,et al.  Human Resource Flexibility as a Mediating Variable Between High Performance Work Systems and Performance , 2008 .

[113]  A. Leung,et al.  Corporate social responsibility, firm reputation, and firm performance: The role of ethical leadership , 2014 .

[114]  Chi-Shiun Lai,et al.  The Involvement of Supply Chain Partners in New Product Development: The Role of a Third Party , 2012, Int. J. Electron. Bus. Manag..

[115]  Stephen Leider,et al.  Reciprocity in Organizations: Evidence from the UK , 2016 .

[116]  James M. Sinkula,et al.  Environmental marketing strategy and firm performance: Effects on new product performance and market share , 2005 .

[117]  J. Perry,et al.  An empirical assessment of organizational commitment and organizational effectiveness. , 1981 .

[118]  Danielle D. van Jaarsveld,et al.  Compensation Management in Outsourced Service Organizations and its Implications for Quit Rates, Absenteeism and Workforce Performance: Evidence from Canadian Call Centres , 2011 .

[119]  Morris A. Swertz,et al.  Spá: A Web-Based Viewer for Text Mining in Evidence Based Medicine , 2014, ECML/PKDD.

[120]  Stephen. Pavelin,et al.  Corporate Reputation and Women on the Board , 2009 .

[121]  J. Harrison,et al.  On the 2019 Business Roundtable “Statement on the Purpose of a Corporation” , 2020 .

[122]  Andrew King,et al.  Exploring the Locus of Profitable Pollution Reduction , 2002, Manag. Sci..

[123]  L. Hassel,et al.  The value relevance of environmental performance , 2005 .

[124]  D. Gibson,et al.  The Effects of Flexibility in Employee Skills, Employee Behaviors, and Human Resource Practices on Firm Performance , 2005 .

[125]  M. Wiersema,et al.  Top management team turnover as an adaptation mechanism: The role of the environment , 1993 .

[126]  Vladimir Zolotov,et al.  Analysis and Optimization of fastText Linear Text Classifier , 2017, ArXiv.

[127]  Roderick D. Iverson,et al.  High-Involvement Management and Workforce Reduction: Competitive Advantage or Disadvantage? , 2006 .

[128]  S. Brammer,et al.  Corporate Reputation and Philanthropy: An Empirical Analysis , 2005 .

[129]  David L. Deephouse,et al.  An Examination of Differences between Organizational Legitimacy and Organizational Reputation , 2005 .

[130]  K. Tan,et al.  Market demand, green product innovation, and firm performance: evidence from Vietnam motorcycle industry , 2013 .

[131]  R. Monsen,et al.  On the Measurement of Corporate Social Responsibility: Self-Reported Disclosures as a Method of Measuring Corporate Social Involvement , 1979 .

[132]  Robert E. Ployhart,et al.  The Consequences of Human Resource Stocks and Flows: A Longitudinal Examination of Unit Service Orientation and Unit Effectiveness , 2009 .

[133]  Chun Qiu,et al.  Corporate Social Responsibility, Investor Behaviors, and Stock Market Returns: Evidence from a Natural Experiment in China , 2011 .

[134]  Jin Hwan Kim,et al.  Green Supply Chain Management orientation and firm performance: evidence from South Korea , 2011 .

[135]  John E. Delery,et al.  Modes of theorizing in strategic human resource management: Tests of universalistic, contingency, and configurational performance predictions , 1996 .

[136]  Robert J. Elliott,et al.  Globalization, firm-level characteristics and environmental management: A study of Japan , 2006 .

[137]  Martha C. Andrews,et al.  Sure Everyone Can Be Replaced … But At What Cost? Turnover As A Predictor Of Unit-Level Performance , 2006 .

[138]  D. D. Carolis,et al.  Competencies and Imitability in the Pharmaceutical Industry: An Analysis of Their Relationship with Firm Performance , 2003 .

[139]  M. Russo,et al.  A Resource-Based Perspective On Corporate Environmental Performance And Profitability , 1997 .

[140]  José F. Molina-Azorín,et al.  The relationship between managers' environmental perceptions, environmental management and firm performance in Spanish hotels: a whole framework , 2010 .