ARTICLE
ABSTRACT
The paper presents a Bayes analysis of an autoregressive-moving average model and its components based on exact likelihood and weak priors for the parameters where the priors are defined so that they incorporate stationarity and invertibility restrictions naturally. A Gibbs- Metropolis hybrid scheme is used to draw posterior-based inferences for the models under consideration. The compatibility of the models with the data is examined using the Ljung- Box-Pierce chi-square-based statistic. The paper also compares different compatible models through the posterior predictive loss criterion in order to recommend the most appropriate one. For a numerical illustration of the above, data on the Indian gross domestic product growth rate at constant prices are considered. Differencing the data once prior to conducting the analysis ensured their stationarity. Retrospective short-term predictions of the data are provided based on the final recommended model. The considered methodology is expected to offer an easy and precise method for economic data analysis.
KEYWORDS
ARMA model, exact likelihood, Gibbs sampler, Metropolis algorithm, posterior predictive loss, model compatibility, Ljung-Box-Pierce statistic, GDP growth rate
REFERENCES
Bayarri, M. J., Berger, J. O., (1998). Quantifying Surprise in the Data and Model Verification, In Bayesian Statistics, 6, ed. J.M. Bernardo, J.O. Berger, A.P. Dawid, and A.F.M. Smith, pp. 53–82. London: Oxford University Press.
Box, G. E. P., Jenkins, G. M., (1976). Time Series Analysis: Forecasting and Control. Holden-Day, San Francisco.
Box, G. E. P., Jenkins, G. M., Reinsel, G. C., (2004). Time Series Analysis: Forecasting and Control. Second Indian Reprint, Pearson Education.
Chib, S., Greenberg, E., (1994). Bayes Inference in Regression Models with ARMA(p;q) Errors. Journal of Econometrics, 64, pp. 183–206.
Clement, E. P., (2014). Using Normalized Bayesian Information Criterion (BIC) to Improve Box-Jenkins Model Building. American Journal of Mathematics and Statistics, 4(5), pp. 214–221.
Dickey, D. A., Fuller, W. A., (1979). Distribution of the Estimators for the Autoregressive Time Series with a Unit Root. Journal of the American Statistical Association, 74, pp. 427–431.
Fan, C., Yao. S., (2008). Bayesian Approach for ARMA Process and Its Application. International Business Research, 1(4), pp. 49–55.
Gelfand, A. E., Smith, A. F. M., (1991). Gibbs Sampling for Marginal Posterior Expectations. Communications in Statistics, Theory and Methods, 20(5–6), pp. 1747–1766.
Gelfand, A. E., Ghosh, S. K., (1998). Model Choice: A Minimum Posterior Predictive Loss Approach. Biometrika, 85, pp. 1–11.
Gelman, A., Meng, X. L., Stern, H. S., (1996). Posterior Predictive Assessment of Model Fitness via Realized Discrepancies. Statistica Sinica, 6, pp. 733–807.
Hyndman, R. J., Athanasopoulos, G., (2018). Forecasting: principles and practice. OTexts.
Kleibergen, F., Hoek, H., (2000). Bayesian Analysis of ARMA Models. Tinbergen Institute Discussion Paper Amsterdam, the Netherlands.
Kwiatkowski, D., Phillips, P. C. B., Schmidt, P., Shin, P., (1992). Testing the Null Hypothesis of Stationarity Against the Alternative of a Unit Root. Journal of Econometrics, 54, pp. 159–178.
Ljung, G. M., Box, G. E. P., (1978). On A Measure of Lack of Fit in Time Series Models. Biometrika, 65, 297–303.
Ludlow, J., Enders, W., (2000). Estimating non-linear ARMA models using Fourier coefficients. International Journal of Forecasting, 16(3), pp. 333–347.
Morley, J. C., Nelson, C. R., Zivot, E., (2003). Why are the Beveridge-Nelson and unobserved-components decompositions of GDP so different? Review of Economics and Statistics, 85(2), pp. 235–243.
Marriot, J. M., Smith A. F. M., (1992). Reparameterization Aspects of Numerical Bayesian Methodology for Autoregressive Moving Average Models. Journal of Time Series Analysis, 13(4), pp. 327–343.
Marriot, J. M., Ravishanker, N., Gelfand, A., PAI, J., (1996). Bayesian Analysis of ARMA Processes: Complete Sampling Based Inference Under Exact Likelihoods. In: Berry, D. A., K. M. Chaloner, and J. Geweke (eds.): Bayesian Analysis in Statistics and Econometrics: Essays in Honor of Arnold Zellner John Wiley, New York.
Monahan, J. F., (1983). Fully Bayesian Analysis of ARMA Time Series Models. Journal of Econometrics, 21, pp. 307–331.
Newbold, P., (1974). The Exact Likelihood Function for a Mixed Autoregressive-Moving average Process. Biometrika, 61(3), pp. 423–426.
Okereke, O. E., Iwueze, I. S., Johnson, O., (2015). Necessary Conditions for the Application of Moving Average Process of Order Three. Applied Mathematics, 6(01), pp. 173–181.
Pankratz, A., (1983). Forecasting with Univariate Box-Jenkins Models: Concepts and Cases. John Wiley & Sons, New York.
Reilly, D. P., (1980). Experiences with An Automatic Box-Jenkins Modeling Algorithm. Time Series Analysis, Proceedings of Houston Meeting on Time Series Analysis, North- Holland publishing, Amsterdam.
Reynolds, S. B., Mellichamp, J. M., Smith, R. E., (1995). Box-Jenkins Forecast Model Identification. AI Expert June, pp. 15–28.
Sahu, S. K., Dey D. K., (2000). A Comparison of Frailty and Other Models for Bivariate Survival Data. Lifetime Data Analysis, 6, pp. 207–228.
Shumway, R. H., Stoffer, D. S., (2011). Time Series Analysis and Its Applications, Springer- Verlag, New York.
Smith, A. F. M., Roberts, G. O., (1993). Bayesian Computation via the Gibbs Sampler and Related Markov Chain Monte Carlo Methods. Journal of the Royal Statistical Society, Series B, 55, pp. 3–25.
Tripathi, P. K., Ranjan, R., Pant, R., Upadhyay, S. K., (2017). An approximate Bayes analysis of ARMA model for Indian GDP growth rate data. Journal of Statistics and Management Systems, 20(3), pp. 399–419.
Tripathi, P. K., Mishra, R. K., Upadhyay, S. K., (2018). Bayes and Classical Prediction of Total Fertility Rate of India Using Autoregressive Integrated Moving Average Model. Journal of Statistics Applications & Probability, 7(2), pp. 233–244.
Tsay, R. S., Tiao, G. C., (1984). Consistent Estimates of Autoregressive Parameters and Extended Sample Autocorrelation Function for Stationary and Non-Stationary ARMA Models. Journal of the American Statistical Association, 79, pp. 84–96.
Tsay, R. S., Tiao, G. C., (1985). Use of Canonical Analysis in Time Series Model Identification. Biometrika, 72(2), pp. 299–315.
Upadhyay, S. K., Gupta, A., Dey, D. K., (2012). Bayesian Modeling of Bathtub Shaped Hazard Rate Using Various Weibull Extensions and Related Issues of Model Selection. Sankhya, Series B, 74, pp. 15–43.
Upadhyay, S. K., Mukherjee, B., (2008). Assessing the Value of the Threshold Parameter in the Weibull Distribution Using Bayes Paradigm. IEEE Transactions on Reliability, 57(3), pp. 489–497.
Upadhyay, S. K., Peshwani, M., (2003). Choice Between Weibull and Lognormal Models: A Simulation Based Bayesian Study. Communications in Statistics, Theory and Methods, 32, pp. 381–405.
Upadhyay, S. K., Smith, A. F. M., (1994). Modelling Complexities in Reliability and the Role of Simulation in Bayesian Computation. International Journal of Continuing Engineering Education, 4, pp. 93–104.
Upadhyay, S. K., Vasishta, N., Smith, A .F. M., (2001). Bayes Inference in Life Testing and Reliability via Markov Chain Monte Carlo Simulation. Sankhya, Series A, 63, pp. 15–40.
Zellner, A., (1971). An Introduction to Bayesian Inference in Econometrics. John Wiley & Sons, New York.
