Introduction to Time Series Analysis and Forecasting

1. Introduction to Forecasting. 1.1 The Nature and uses of Forecasts. 1.2 Some Examples of Time Series. 1.3 The Forecasting Process. 1.4 Resources for Forecasting. 2. Statistics Background for Forecasting. 2.1 Introduction. 2.2 Graphical Displays. 2.3 Numerical Description of Time Series Data. 2.4 Use of Data Transformations and Adjustments. 2.5 General Approach to Time Series Analysis and Forecasting. 2.6 Evaluating and Monitoring Forecasting Model Performance. 3. Regression Analysis and Forecasting. 3.1 Introduction. 3.2 Least Squares Estimation in Linear Regression Models. 3.3 Statistical Inference in Linear Regression. 3.4 Prediction of New Observations. 3.5 Model Adequacy Checking. 3.6 Variable Selection Methods in Regression. 3.7 Generalized and Weighted Least Squares. 3.8 Regression Models for General Time Series Data. 4. Exponential Smoothing Methods. 4.1 Introduction. 4.2 First-Order Exponential Smoothing. 4.3 Modeling Time series Data. 4.4 Second-Order Exponential Smoothing. 4.5 Higher-Order Exponential Smoothing. 4.6 Forecasting. 4.7 Exponential Smoothing for Seasonal Data. 4.8 Exponential Smoothers and ARIMA Models. 5. Autoregressive Integrated Moving Average (ARIMA) Models. 5.1 Introduction. 5.2 Linear Models for Stationary Time Series. 5.3 Finite Order Moving Average (MA) Processes. 5.4 Finite Order Autoregressive Processes. 5.5 Mixed Autoregressive-Moving Average (ARMA) Processes. 5.6 Non-stationary Processes. 5.7 Time Series Model Building . 5.8 Forecasting ARIMA Processes . 5.9 Seasonal Processes. 5.10 Final Comments. 6. Transfer Function and Intervention Models. 6.1 Introduction. 6.2 Transfer Function Models. 6.3 Transfer Function-Noise Models. 6.4 Cross Correlation Function. 6.5 Model Specification. 6.6 Forecasting with Transfer Function-Noise Models. 6.7 Intervention Analysis. 7. Survey of Other Forecasting Methods. 7.1 Multivariate Time Series Models and Forecasting. 7.2 State Space Models. 7.3 ARCH and GARCH Models. 7.4 Direct Forecasting of Percentiles. 7.5 Combining Forecasts to Improve Prediction Performance. 7.6 Aggregation and Disaggregation of Forecasts. 7.7 Neural Networks and Forecasting. 7.8 Some Comments on Practical Implementation and use of Statistical Forecasting Techniques. Bibliography. Appendix. Appendix A Statistical Tables. Table A.1 Cumulative Normal Distribution. Table A.2 Percentage Points of the Chi-Square Distribution. Table A.3 Percentage Points of the t Distribution. Table A.4 Percentage Points of the F Distribution. Table A.5 Critical Values of the Durbin-Watson Statistic. Appendix B Data Sets for Exercises. Table B.1 Market Yield on U.S. Treasury Securities at 10-year Constant Maturity. Table B.2 Pharmaceutical Product Sales. Table B.3 Chemical Process Viscosity. Table B.4 U.S Production of Blue and Gorgonzola Cheeses. Table B.5 U.S. Beverage Manufacturer Product Shipments, Unadjusted. Table B.6 Global Mean Surface Air Temperature Anomaly and Global CO22 Concentration. Table B.7 Whole Foods Market Stock Price, Daily Closing Adjusted for Splits. Table B.8 Unemployment Rate - Full-Time Labor Force, Not Seasonally Adjusted. Table B.9 International Sunspot Numbers. Table B.10 United Kingdom Airline Miles Flown. Table B.11 Champagne Sales. Table B.12 Chemical Process Yield, with Operating Temperature (Uncontrolled). Table B.13 U.S. Production of Ice Cream and Frozen Yogurt. Table B.14 Atmospheric CO2 Concentrations at Mauna Loa Observatory. Table B.15 U.S. National Violent Crime Rate. Table B.16 U.S. Gross Domestic Product. Table B.17 U.S. Total Energy Consumption. Table B.18 U.S. Coal Production. Table B.19 Arizona Drowning Rate, Children 1-4 Years Old. Table B.20 U.S. Internal Revenue Tax Refunds. Index.

[1]  Arnold L. Sweet,et al.  Computing the variance of the forecast error for the holt‐winters seasonal models , 1985 .

[2]  E. S. Gardner,et al.  FORECASTING WITH EXPONENTIAL SMOOTHING: SOME GUIDELINES FOR MODEL SELECTION , 1980 .

[3]  Victor Solo,et al.  The Order of Differencing in ARIMA Models , 1984 .

[4]  H. Iemoto.  Modelling the persistence of conditional variances , 1986 .

[5]  M. L. Goodman,et al.  A New Look at Higher-Order Exponential Smoothing for Forecasting , 1974, Oper. Res..

[6]  Peter R. Winters,et al.  Forecasting Sales by Exponentially Weighted Moving Averages , 1960 .

[7]  R. Meyer,et al.  The Fundamental Theorem of Exponential Smoothing , 1961 .

[8]  H. Akaike.  A new look at the statistical model identification , 1974 .

[9]  S. M. Wu,et al.  Exponential Smoothing as a Special Case of a Linear Stochastic System , 1974, Oper. Res..

[10]  G. C. Tiao,et al.  Consistent Estimates of Autoregressive Parameters and Extended Sample Autocorrelation Function for Stationary and Nonstationary ARMA Models , 1984 .

[11]  Dean W. Wichern,et al.  Assessing the Impact of Market Disturbances Using Intervention Analysis , 1977 .

[12]  S. Zabell,et al.  Babies and the blackout: the genesis of a misconception , 1981 .

[13]  R. Cook.  Influential Observations in Linear Regression , 1979 .

[14]  Murat Kulahci,et al.  Quality Quandaries: Studying Input-Output Relationships, Part I , 2006 .

[15]  G. Yule.  On a Method of Investigating Periodicities in Disturbed Series, with Special Reference to Wolfer's Sunspot Numbers , 1927 .

[16]  Marcus O'Connor,et al.  Artificial neural network models for forecasting and decision making , 1994 .

[17]  Douglas C. Montgomery,et al.  Forecasting and Time Series Analysis (2nd ed.). , 1992 .

[18]  W. Fuller,et al.  Distribution of the Estimators for Autoregressive Time Series with a Unit Root , 1979 .

[19]  C. Granger,et al.  Experience with Forecasting Univariate Time Series and the Combination of Forecasts , 1974 .

[20]  M. Bartlett.  On the Theoretical Specification and Sampling Properties of Autocorrelated Time‐Series , 1946 .

[21]  Douglas C. Montgomery.  Adaptive Control of Exponential Smoothing Parameters by Evolutionary Operation , 1970 .

[22]  M. Kendall,et al.  A Study in the Analysis of Stationary Time-Series. , 1955 .

[23]  G. Box,et al.  Distribution of Residual Autocorrelations in Autoregressive-Integrated Moving Average Time Series Models , 1970 .

[24]  Douglas C. Montgomery,et al.  Modeling and Forecasting Time Series Using Transfer Function and Intervention Methods , 1980 .

[25]  C. Chatfield,et al.  Prediction intervals for multiplicative Holt-Winters , 1991 .

[26]  D. Cochrane,et al.  Application of Least Squares Regression to Relationships Containing Auto-Correlated Error Terms , 1949 .

[27]  R. H. Myers.  Classical and modern regression with applications , 1986 .

[28]  Everette S. Gardner,et al.  Exponential smoothing: The state of the art , 1985 .

[29]  Johannes Ledolter,et al.  Statistical methods for forecasting , 1983 .

[30]  P. A. Blight.  The Analysis of Time Series: An Introduction , 1991 .

[31]  R. Clemen.  Combining forecasts: A review and annotated bibliography , 1989 .

[32]  K. French,et al.  Expected stock returns and volatility , 1987 .

[33]  J. Ledolter,et al.  Evaluating the Impact of the 65 mph Maximum Speed Limit on Iowa Rural Interstates , 1996 .

[34]  Orazio Attanasio,et al.  Risk, Time-Varying Second Moments and Market Efficiency , 1991 .

[35]  J. Muth.  Optimal Properties of Exponentially Weighted Forecasts , 1960 .

[36]  Jonathan D. Cryer,et al.  Time Series Analysis , 1986 .

[37]  John W. Tukey,et al.  Exploratory Data Analysis. , 1979 .

[38]  M. L. Shone,et al.  Exponential Smoothing with an Adaptive Response Rate , 1967 .

[39]  G. C. Tiao,et al.  Model Specification in Multivariate Time Series , 1989 .

[40]  G. Reinsel.  Elements of Multivariate Time Series Analysis, 2nd Edition , 1998 .

[41]  Daniel B. Nelson.  CONDITIONAL HETEROSKEDASTICITY IN ASSET RETURNS: A NEW APPROACH , 1991 .

[42]  R. Engle,et al.  Multivariate Simultaneous Generalized ARCH , 1995, Econometric Theory.

[43]  C. Chatfield,et al.  Prediction intervals for the Holt-Winters forecasting procedure , 1990 .

[44]  T. Bollerslev,et al.  Generalized autoregressive conditional heteroskedasticity , 1986 .

[45]  G. C. Tiao,et al.  Modeling Multiple Time Series with Applications , 1981 .

[46]  G. Box,et al.  On a measure of lack of fit in time series models , 1978 .

[47]  E. McKenzie.  General exponential smoothing and the equivalent arma process , 1984 .

[48]  George E. P. Box,et al.  Intervention Analysis with Applications to Economic and Environmental Problems , 1975 .

[49]  D. Cox.  Prediction by Exponentially Weighted Moving Averages and Related Methods , 1961 .

[50]  G. M. Jenkins,et al.  TESTS OF HYPOTHESES IN THE LINEAR AUTOREGRESSIVE MODEL: II. NULL DISTRIBUTIONS FOR HIGHER ORDER SCHEMES: NON-NULL DISTRIBUTIONS , 1956 .

[51]  James N. Bodurtha,et al.  Testing the CAPM with Time-Varying Risks and Returns , 1991 .

[52]  Ronald Eddy C O Eastma Swanson,et al.  Practical experiences with modelling and forecasting time series , 1980 .

[53]  Bovas Abraham,et al.  Some comments on the initialization of exponential smoothing , 1984 .

[54]  M. H. Quenouille.  Approximate Tests of Correlation in Time‐Series , 1949 .

[55]  J. Durbin,et al.  Testing for serial correlation in least squares regression. I. , 1950, Biometrika.

[56]  E. McKenzie,et al.  Error analysis for winters' additive seasonal forecasting system , 1986 .

[57]  Ruey S. Tsay,et al.  IDENTIFYING MULTIVARIATE TIME SERIES MODELS , 1989 .

[58]  R. Engle.  Autoregressive conditional heteroscedasticity with estimates of the variance of United Kingdom inflation , 1982 .

[59]  Murat Kulahci,et al.  Quality Quandaries: Studying Input-Output Relationships, Part II , 2006 .

[60]  Helmut Ltkepohl,et al.  New Introduction to Multiple Time Series Analysis , 2007 .

[61]  M. Stella Atkins.  A Case Study on the Use of Intervention Analysis Applied to Traffic Accidents , 1979 .

[62]  R. Chou,et al.  ARCH modeling in finance: A review of the theory and empirical evidence , 1992 .

[63]  W. Fuller,et al.  Introduction to Statistical Time Series (2nd ed.) , 1997 .

[64]  Jammalamadaka.  Introduction to Linear Regression Analysis (3rd ed.) , 2003 .

[65]  L. Glosten,et al.  On the Relation between the Expected Value and the Volatility of the Nominal Excess Return on Stocks , 1993 .

[66]  William W. S. Wei,et al.  Time series analysis - univariate and multivariate methods , 1989 .

[67]  C. Chatfield,et al.  The M2-competition: A real-time judgmentally based forecasting study , 1993 .

[68]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[69]  Chris Chatfield,et al.  Holt‐Winters Forecasting: Some Practical Issues , 1988 .