Single and Multiple Separate LSTM Neural Networks for Multiple Output Feature Purchase Prediction

Data concerning product sales are a popular topic in time series forecasting due to their multidimensionality and wide presence in many businesses. This paper describes the research in predicting the timing and product category of the next purchase based on historical customer transaction data. Given that the dataset was acquired from a vendor of medical drugs and devices, the generic product identifier (GPI) classification system was incorporated in assigning product categories. The models built are based on recurrent neural networks (RNN) and long short-term memory (LSTM) neural networks with different input and output features, and training datasets. Experiments with various datasets were conducted and optimal network structures and types for predicting both product category and next purchase day were identified. The key contribution of this research is the process of data transformation from its original purchase transaction format into a time series of input features for next purchase prediction. With this approach, it is possible to implement a dedicated personalized marketing system for a vendor.

[1]  Daofang Chang,et al.  Research on Apparel Retail Sales Forecasting Based on xDeepFM-LSTM Combined Forecasting Model , 2022, Inf..

[2]  S. H. Amin,et al.  Time-series forecasting of seasonal items sales using machine learning - A comparative analysis , 2022, Int. J. Inf. Manag. Data Insights.

[3]  QingTao Zeng,et al.  Research on sales Forecast based on XGBoost-LSTM algorithm Model , 2021, Journal of Physics: Conference Series.

[4]  Bratislav Predić,et al.  PSEUDO-MULTIVARIATE LSTM NEURAL NETWORK APPROACH FOR PURCHASE DAY PREDICTION IN B2B , 2021 .

[5]  Tae-Woong Yoo,et al.  Time Series Forecasting of Agricultural Products’ Sales Volumes Based on Seasonal Long Short-Term Memory , 2020, Applied Sciences.

[6]  Rahul Bajpai,et al.  Impact of Uncertainty in the Input Variables and Model Parameters on Predictions of a Long Short Term Memory (LSTM) Based Sales Forecasting Model , 2020, Mach. Learn. Knowl. Extr..

[7]  Markus Haltmeier,et al.  A machine learning framework for customer purchase prediction in the non-contractual setting , 2020, Eur. J. Oper. Res..

[8]  Bratislav Predic,et al.  TIME SERIES ANALYSIS: FORECASTING SALES PERIODS IN WHOLESALE SYSTEMS , 2020 .

[9]  Pengfei Wang,et al.  Modeling Temporal Dynamics of Users’ Purchase Behaviors for Next Basket Prediction , 2019, Journal of Computer Science and Technology.

[10]  Markus Helfert,et al.  Towards Preprocessing Guidelines for Neural Network Embedding of Customer Behavior in Digital Retail , 2019, ISCSIC.

[11]  Xuan Zhang,et al.  AT-LSTM: An Attention-based LSTM Model for Financial Time Series Prediction , 2019, IOP Conference Series: Materials Science and Engineering.

[12]  Nitesh V. Chawla,et al.  Online Purchase Prediction via Multi-Scale Modeling of Behavior Dynamics , 2019, KDD.

[13]  Martin Krzywinski,et al.  Points of Significance: Logistic regression , 2016, Nature Methods.

[14]  Dennis Fok,et al.  Model-based Purchase Predictions for Large Assortments , 2016, Mark. Sci..

[15]  Kristina Lerman,et al.  Portrait of an Online Shopper: Understanding and Predicting Consumer Behavior , 2015, WSDM.

[16]  S. F. Witt,et al.  Univariate versus multivariate time series forecasting: an application to international tourism demand , 2003 .

[17]  Ah Chung Tsoi,et al.  Noisy Time Series Prediction using Recurrent Neural Networks and Grammatical Inference , 2001, Machine Learning.

[18]  Jürgen Schmidhuber,et al.  Learning to Forget: Continual Prediction with LSTM , 2000, Neural Computation.

[19]  Sepp Hochreiter,et al.  The Vanishing Gradient Problem During Learning Recurrent Neural Nets and Problem Solutions , 1998, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[20]  S. Hochreiter,et al.  Long Short-Term Memory , 1997, Neural Computation.

[21]  Bohdan M. Pavlyshenko,et al.  Machine-Learning Models for Sales Time Series Forecasting , 2018, Data.

[22]  Grazyna Suchacka,et al.  Application of Neural Network to Predict Purchases in Online Store , 2016, ISAT.

[23]  Francine Chen,et al.  Recurrent Neural Networks for Customer Purchase Prediction on Twitter , 2016, CBRecSys@RecSys.

[24]  Rob J Hyndman,et al.  25 years of time series forecasting , 2006 .