Predicting Human Discretion to Adjust Algorithmic Prescription: A Large-Scale Field Experiment in Warehouse Operations

Conventional optimization algorithms that prescribe order packing instructions (which items to pack in which sequence in which box) focus on box volume utilization yet tend to overlook human behavioral deviations. We observe that packing workers at the warehouses of Alibaba Group deviate from algorithmic prescriptions for 5.8% of packages, and these deviations increase packing time and reduce operational efficiency. We posit two mechanisms and demonstrate that they result in two types of deviations: (1) information deviations stem from workers having more information and in turn better solutions than the algorithm; and (2) complexity deviations result from workers' aversion, inability or discretion to precisely implement algorithmic prescriptions. We propose a new "human-centric bin packing algorithm" that anticipates and incorporates human deviations to reduce deviations and improve performance. It predicts when workers are more likely to switch to larger boxes using machine learning techniques and then pro-actively adjusts the algorithmic prescriptions of those ``targeted packages.'' We conducted a large-scale randomized field experiment with the Alibaba Group. Orders were randomly assigned to either the new algorithm (treatment group) or Alibaba's original algorithm (control group). Our field experiment results show that our new algorithm lowers the rate of switching to larger boxes from 29.5% to 23.8% for targeted packages and reduces the average packing time of targeted packages by 4.5%. This idea of incorporating human deviations to improve optimization algorithms could also be generalized to other processes in logistics and operations.

[1]  Carri W. Chan,et al.  ICU Admission Control: An Empirical Study of Capacity Allocation and Its Implication for Patient Outcomes , 2015, Manag. Sci..

[2]  Robert J. Batt,et al.  Finding a Needle in a Haystack: The Effects of Searching and Learning on Pick-Worker Performance , 2017, Manag. Sci..

[3]  Zuo-Jun Max Shen,et al.  Data-Driven Order Assignment for Last Mile Delivery , 2018 .

[4]  Elena Katok,et al.  Push, Pull, or Both? A Behavioral Study of How the Allocation of Inventory Risk Affects Channel Efficiency , 2014, Manag. Sci..

[5]  Kamalini Ramdas,et al.  Is Transshipment a Behaviorally-Robust Risk-Pooling Strategy? , 2012 .

[6]  Gary P. Pisano,et al.  Toward a Theory of Behavioral Operations , 2008, Manuf. Serv. Oper. Manag..

[7]  Elliot Bendoly,et al.  Prioritizing and Monitoring Concurrent Project Work: Effects on Switching Behavior , 2014 .

[8]  Ananth Raman,et al.  The Impact of Supplier Inventory Service Level on Retailer Demand , 2016, Manuf. Serv. Oper. Manag..

[9]  Daniele Vigo,et al.  The Three-Dimensional Bin Packing Problem , 2000, Oper. Res..

[10]  Gérard P. Cachon,et al.  Decision Bias in the Newsvendor Problem with a Known Demand Distribution: Experimental Evidence.: Experimental Evidence. , 2000 .

[11]  Daniele Vigo,et al.  Visual attractiveness in routing problems: A review , 2019, Comput. Oper. Res..

[12]  Serguei Netessine,et al.  When Does the Devil Make Work? An Empirical Study of the Impact of Workload on Worker Productivity , 2014, Manag. Sci..

[13]  Wallace J. Hopp,et al.  On the Interface Between Operations and Human Resources Management , 2003, Manuf. Serv. Oper. Manag..

[14]  Berkeley J. Dietvorst,et al.  Algorithm Aversion: People Erroneously Avoid Algorithms after Seeing Them Err , 2014, Journal of experimental psychology. General.

[15]  Elliot Bendoly,et al.  Behavior in operations management: Assessing recent findings and revisiting old assumptions , 2006 .

[16]  Guido Voigt,et al.  Behavioral Contract Design Under Asymmetric Forecast Information , 2019, Decis. Sci..

[17]  Bradley R. Staats,et al.  Motivating Process Compliance through Individual Electronic Monitoring: An Empirical Examination of Hand Hygiene in Healthcare , 2015, Manag. Sci..

[18]  Zuo-Jun Max Shen,et al.  On-Time Last-Mile Delivery: Order Assignment with Travel-Time Predictors , 2020, Manag. Sci..

[19]  Enno Siemsen,et al.  Demand Forecasting Behavior: System Neglect and Change Detection , 2011, Manag. Sci..

[20]  David R. Vinson,et al.  Closing the Productivity Gap: Improving Worker Productivity Through Public Relative Performance Feedback and Validation of Best Practices , 2017, Manag. Sci..

[21]  D. Drake,et al.  Show or Tell? Improving Inventory Support for Agent-Based Businesses at the Base of the Pyramid , 2020, Manuf. Serv. Oper. Manag..

[22]  Jan Fransoo,et al.  Ordering Behavior in Retail Stores and Implications for Automated Replenishment , 2010, Manag. Sci..

[23]  Thom J. Hodgson,et al.  A Combined Approach to the Pallet Loading Problem , 1982 .

[24]  Chin-Sheng Chen,et al.  An analytical model for the container loading problem , 1995 .

[25]  Chia-Jung Tsay,et al.  Creating Reciprocal Value Through Operational Transparency , 2015, Manag. Sci..

[26]  A. Narayanan,et al.  Unraveling Behavioral Ordering: Relative Costs and the Bullwhip Effect , 2020, Manuf. Serv. Oper. Manag..

[27]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[28]  Joseph P. Simmons,et al.  Overcoming Algorithm Aversion: People Will Use Imperfect Algorithms If They Can (Even Slightly) Modify Them , 2016, Manag. Sci..

[29]  Bradley R. Staats,et al.  Discretionary Task Ordering: Queue Management in Radiological Services , 2017, Manag. Sci..

[30]  Yupo Chan,et al.  A three-dimensional bin-packing model: exact multicriteria solution and computational complexity , 2017 .

[31]  Gad Allon,et al.  Information Sharing in Supply Chains: An Empirical and Theoretical Valuation , 2014, Manag. Sci..

[32]  D. Drake,et al.  Show or Tell? Improving Agent Decision Making in a Tanzanian Mobile Money Field Experiment , 2018 .