Skip to main content

Model-Free Inference for Markov Processes

  • Chapter
Model-Free Prediction and Regression

Abstract

Given time series data \(Y _{1},\ldots,Y _{n}\), the problem of optimal prediction of Y n+1 has been well-studied. The same is not true, however, as regards the problem of constructing a prediction interval with prespecified coverage probability for Y n+1, i.e., turning the point predictor into an interval predictor. In Pan and Politis (J Stat Plann Inference, 2015, to appear), the case where the time series {Y t } obeys an autoregressive model was addressed in detail with the autoregression allowed to be linear, nonlinear or nonparametric. In the paper at hand, we expand the scope by assuming only that {Y t } is a Markov process of order pā€‰ā‰„ā€‰1 without insisting that any specific autoregressive equation is satisfied. Several different approaches and methods are considered, namely both Forward and Backward approaches to prediction intervals as combined with three resampling methods: the bootstrap based on estimated transition densities, the Local Bootstrap for Markov processes, and the novel Model-Free bootstrap. In simulations, prediction intervals obtained from different methods are compared in terms of their coverage level and length of interval.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.00
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 99.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    The distribution of random vector X p was denoted F in order to be distinguished from the limiting distribution F of the i.i.d.Ā variables \(\epsilon _{1}^{(m)},\ldots,\epsilon _{m}^{(m)}\) in the Model-Free Prediction Principle.

  2. 2.

    If the choice of bandwidth g is not over-smoothed, e.g., if gā€‰=ā€‰h, then the resulting prediction intervals exhibit profound under-coverage; see Pan and PolitisĀ (2015) for discussion.

References

  • Akritas MG, VanKeilegom I (2001) Non-parametric estimation of the residual distribution. Scand J Stat 28(3):549ā€“567

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Alonso AM, PeƱa D, Romo J (2002) Forecasting time series with sieve bootstrap. J Stat Plan Infer 100(1):1ā€“11

    ArticleĀ  MATHĀ  Google ScholarĀ 

  • Altman NS (1992) An introduction to kernel and nearest-neighbor nonparametric regression. Am Stat 46(3):175ā€“185

    MathSciNetĀ  Google ScholarĀ 

  • Andersen TG, Bollerslev T (1998) Answering the sceptics: yes, standard volatility models do provide accurate forecasts. Int Econ Rev 39(4):885ā€“905

    ArticleĀ  MathSciNetĀ  Google ScholarĀ 

  • Andersen TG, Bollerslev T, Christoffersen PF, Diebold FX (2006) Volatility and correlation forecasting. In: Elliott G, Granger CWJ, Timmermann A (eds) Handbook of economic forecasting. North-Holland, Amsterdam, pp 778ā€“878

    Google ScholarĀ 

  • Andersen TG, Bollerslev T, Meddahi N (2004) Analytic evaluation of volatility forecasts. Int Econ Rev 45:1079ā€“1110

    ArticleĀ  MathSciNetĀ  Google ScholarĀ 

  • Atkinson AC (1985)Ā Plots, transformations and regression. Clarendon Press, Oxford

    MATHĀ  Google ScholarĀ 

  • Antoniadis A, Paparoditis E, Sapatinas T (2006) A functional wavelet-kernel approach for time series prediction. J R Stat Soc Ser B 68(5):837ā€“857

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Bachelier L (1900) Theory of speculation. Reprinted in Cootner PH (ed) The random character of stock market prices. MIT Press, Cambridge, MA, pp 17ā€“78, 1964

    Google ScholarĀ 

  • Barndorff-Nielsen OE, Nielsen B, Shephard N, Ysusi C (1996) Measuring and forecasting financial variability using realized variance with and without a model. In: Harvey AC, Koopman SJ, Shephard N (eds) State space and unobserved components models: theory and applications. Cambridge University Press, Cambridge, pp 205ā€“235

    Google ScholarĀ 

  • Bartlett MS (1946) On the theoretical specification of sampling properties of autocorrelated time series. J R Stat Soc Suppl 8:27ā€“41

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Beran R (1990) Calibrating prediction regions. J Am Stat Assoc 85:715ā€“723

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Berkes I, Gombay E, Horvath L, Kokoszka P (2004) Sequential change-point detection in GARCH (p, q) models. Econ Theory 20(6):1140ā€“1167

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Bertail P, ClĆ©mencon S (2006) Regenerative block bootstrap for Markov chains. Bernoulli 12(4):689ā€“712

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Bickel P, Gel YR (2011) Banded regularization of autocovariance matrices in application to parameter estimation and forecasting of time series. J R Stat Soc Ser B 73(5):711ā€“728

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Bickel P, Levina E (2008a) Regularized estimation of large covariance matrices. Ann Stat 36:199ā€“227

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Bickel P, Levina E (2008b) Covariance regularization via thresholding. Ann Stat 36:2577ā€“2604

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Bickel P, Li B (2006) Regularization in statistics. Test 15(2):271ā€“344

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Bollerslev T (1986) Generalized autoregressive conditional heteroscedasticity. J Econ 31:307ā€“327

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Bollerslev T, Chou R, Kroner K (1992) ARCH modelling in finance: a review of theory and empirical evidence. J Econ 52:5ā€“60

    ArticleĀ  MATHĀ  Google ScholarĀ 

  • Bose A (1988) Edgeworth correction by bootstrap in autoregressions. Ann Stat 16:1345ā€“1741

    ArticleĀ  Google ScholarĀ 

  • Bose A, Chatterjee S (2002) Comparison of bootstrap and jackknife variance estimators in linear regression: second order results. Stat Sin 12:575ā€“598

    MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Box GEP (1976) Science and statistics. J Am Stat Assoc 71(356):791ā€“799

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Box GEP, Cox DR (1964) An analysis of transformations. J R Stat Soc Ser B 26:211ā€“252

    MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Box GEP, Draper NR (1987) Empirical model-building and response surfaces. Wiley, New York

    MATHĀ  Google ScholarĀ 

  • Box GEP, Jenkins GM (1976) Time series analysis, control, and forecasting. Holden Day, San Francisco

    Google ScholarĀ 

  • Breidt FJ, Davis RA, Dunsmuir W (1995) Improved bootstrap prediction intervals for autoregressions. J Time Ser Anal 16(2):177ā€“200

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Breiman L (1996) Bagging predictors. Mach Learn 24:123ā€“140

    MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Breiman L, Friedman J (1985) Estimating optimal transformations for multiple regression and correlation. J Am Stat Assoc 80:580ā€“597

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Brockwell PJ, Davis RA (1991) Time series: theory and methods, 2nd edn. Springer, New York

    BookĀ  Google ScholarĀ 

  • Brockwell PJ, Davis RA (1988) Simple consistent estimation of the coefficients of a linear filter. Stoch Process Appl 22:47ā€“59

    ArticleĀ  MathSciNetĀ  Google ScholarĀ 

  • BĆ¼hlmann P, van de Geer S (2011) Statistics for high-dimensional data. Springer, New York

    BookĀ  MATHĀ  Google ScholarĀ 

  • Cai TT, Ren Z, Zhou HH (2013) Optimal rates of convergence for estimating Toeplitz covariance matrices. Probab Theory Relat Fields 156(1ā€“2):101ā€“143

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Cao R, Febrero-Bande M, Gonzalez-Manteiga W, Prada-Sanchez JM, GarcIa-Jurado I (1997) Saving computer time in constructing consistent bootstrap prediction intervals for autoregressive processes. Commun Stat Simul Comput 26(3):961ā€“978

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Carmack PS, Schucany WR, Spence JS, Gunst RF, Lin Q, Haley RW (2009) Far casting cross-validation. J Comput Graph Stat 18(4):879ā€“893

    ArticleĀ  MathSciNetĀ  Google ScholarĀ 

  • Carroll RJ, Ruppert D (1988) Transformations and weighting in regression. Chapman and Hall, New York

    BookĀ  Google ScholarĀ 

  • Caroll RJ, Ruppert D (1991) Prediction and tolerance intervals with transformation and/or weighting. Technometrics 33(2):197ā€“210

    ArticleĀ  MathSciNetĀ  Google ScholarĀ 

  • Chatterjee S, Bose A (2005) Generalized bootstrap for estimating equations. Ann Stat 33:414ā€“436

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Chen X, Xu M, Wu W-B (2013) Covariance and precision matrix estimation for high-dimensional time series. Ann Stat 41(6):2994ā€“3021

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Cheng T-ZF, Ing C-K, Yu S-H (2015) Inverse moment bounds for sample autocovariance matrices based on detrended time series and their applications. Linear Algebra Appl (to appear)

    Google ScholarĀ 

  • Choi B-S (1992) ARMA model identification. Springer, New York

    BookĀ  MATHĀ  Google ScholarĀ 

  • Cox DR (1975) Prediction intervals and empirical Bayes confidence intervals. In: Gani J (eds) Perspectives in probability and statistics. Academic, London, pp 47ā€“55

    Google ScholarĀ 

  • Dahlhaus R (1997) Fitting time series models to nonstationary processes. Ann Stat 25(1):1ā€“37

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Dahlhaus R (2012) Locally stationary processes. In: Handbook of statistics, vol 30. Elsevier, Amsterdam, pp 351ā€“412

    Google ScholarĀ 

  • Dahlhaus R, Subba Rao S (2006) Statistical inference for time-varying ARCH processes. Ann Stat 34(3):1075ā€“1114

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Dai J, Sperlich S (2010) Simple and effective boundary correction for kernel densities and regression with an application to the world income and Engel curve estimation. Comput Stat Data Anal 54(11):2487ā€“2497

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • DasGupta A (2008) Asymptotic theory of statistics and probability. Springer, New York

    MATHĀ  Google ScholarĀ 

  • Davison AC, Hinkley DV (1997) Bootstrap methods and their applications. Cambridge University Press, Cambridge

    BookĀ  Google ScholarĀ 

  • Dawid AP (2004) Probability, causality, and the empirical world: a Bayes-de Finetti-Popper-Borel synthesis. Stat Sci 19(1):44ā€“57

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Devroye L (1981) Laws of the iterated logarithm for order statistics of uniform spacings. Ann Probab 9(6):860ā€“867

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Dowla A, Paparoditis E, Politis DN (2003) Locally stationary processes and the local block bootstrap. In: Akritas MG, Politis DN (eds) Recent advances and trends in nonparametric statistics. Elsevier, Amsterdam, pp 437ā€“444

    ChapterĀ  Google ScholarĀ 

  • Dowla A, Paparoditis E, Politis DN (2013) Local block bootstrap inference for trending time series. Metrika 76(6):733ā€“764

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Draper NR, Smith H (1998) Applied regression analysis, 3rd edn. Wiley, New York

    MATHĀ  Google ScholarĀ 

  • Efron B (1979) Bootstrap methods: another look at the jackknife. Ann Stat 7:1ā€“26

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Efron B (1983) Estimating the error rate of a prediction rule: improvement on cross-validation. J Am Stat Assoc 78:316ā€“331

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Efron B (2014) Estimation and accuracy after model selection. J Am Stat Assoc 109:991ā€“1007

    ArticleĀ  MathSciNetĀ  Google ScholarĀ 

  • Efron B, Tibshirani RJ (1993) An introduction to the bootstrap. Chapman and Hall, New York

    BookĀ  MATHĀ  Google ScholarĀ 

  • Engle R (1982) Autoregressive conditional heteroscedasticity with estimates of the variance of UK inflation. Econometrica 50:987ā€“1008

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Fama EF (1965) The behaviour of stock market prices. J Bus 38:34ā€“105

    ArticleĀ  Google ScholarĀ 

  • Fan J (1993) Local linear regression smoothers and their minimax efficiencies. Ann Stat 21(1):196ā€“216

    ArticleĀ  MATHĀ  Google ScholarĀ 

  • Fan J, Gijbels I (1996) Local polynomial modelling and its applications. Chapman and Hall, New York

    MATHĀ  Google ScholarĀ 

  • Fan J, Yao Q (2003) Nonlinear time series: nonparametric and parametric methods. Springer, New York

    BookĀ  Google ScholarĀ 

  • Ferraty F, Vieu P (2006) Nonparametric functional data analysis. Springer, New York

    MATHĀ  Google ScholarĀ 

  • Francq C, Zakoian JM (2011) GARCH models: structure, statistical inference and financial applications. Wiley, New York

    Google ScholarĀ 

  • Franke J, HƤrdle W (1992) On bootstrapping kernel spectral estimates. Ann Stat 20:121ā€“145

    ArticleĀ  MATHĀ  Google ScholarĀ 

  • Franke J, Kreiss J-P, Mammen E (2002) Bootstrap of kernel smoothing in nonlinear time series. Bernoulli 8(1):1ā€“37

    MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Freedman DA (1981) Bootstrapping regression models. Ann Stat 9:1218ā€“1228

    ArticleĀ  MATHĀ  Google ScholarĀ 

  • Freedman D (1984) On bootstrapping two-stage least-squares estimates in stationary linear models. Ann Stat 12:827ā€“842

    ArticleĀ  MATHĀ  Google ScholarĀ 

  • Fryzlewicz P, Van Bellegem S, Von Sachs R (2003) Forecasting non-stationary time series by wavelet process modelling. Ann Inst Stat Math 55(4):737ā€“764

    ArticleĀ  MATHĀ  Google ScholarĀ 

  • Gangopadhyay AK, Sen PK (1990) Bootstrap confidence intervals for conditional quantile functions. Sankhya Ser A 52(3):346ā€“363

    MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Geisser S (1993) Predictive inference: an introduction. Chapman and Hall, New York

    BookĀ  MATHĀ  Google ScholarĀ 

  • Gijbels I, Pope A, Wand MP (1999) Understanding exponential smoothing via kernel regression. J R Stat Soc Ser B 61:39ā€“50

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Ghysels E, Santa-Clara P, Valkanov R (2006) Predicting volatility: getting the most out of return data sampled at different frequencies. J Econ 131(1ā€“2):59ā€“95

    ArticleĀ  MathSciNetĀ  Google ScholarĀ 

  • GouriĆ©roux C (1997) ARCH models and financial applications. Springer, New York

    BookĀ  MATHĀ  Google ScholarĀ 

  • Gray RM (2005) Toeplitz and circulant matrices: a review. Commun Inf Theory 2(3):155ā€“239

    Google ScholarĀ 

  • Grenander U, Szegƶ G (1958) Toeplitz forms and their applications, vol 321. University of California Press, Berkeley

    MATHĀ  Google ScholarĀ 

  • Hahn J (1995) Bootstrapping quantile regression estimators. Econ Theory 11(1):105ā€“121

    ArticleĀ  Google ScholarĀ 

  • Hall P (1992) The bootstrap and edgeworth expansion. Springer, New York

    BookĀ  Google ScholarĀ 

  • Hall P (1993) On Edgeworth expansion and bootstrap confidence bands in nonparametric curve estimation. J R Stat Soc Ser B 55:291ā€“304

    MATHĀ  Google ScholarĀ 

  • Hall P, Wehrly TE (1991) A geometrical method for removing edge effects from kernel type nonparametric regression estimators. J Am Stat Assoc 86:665ā€“672

    ArticleĀ  MathSciNetĀ  Google ScholarĀ 

  • Hall P, Wolff RCL, Yao Q (1999) Methods for estimating a conditional distribution function. J Am Stat Assoc 94(445):154ā€“163

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Hamilton JD (1994) Time series analysis. Princeton University Press, Princeton, NJ

    MATHĀ  Google ScholarĀ 

  • Hampel FR (1973) Robust estimation, a condensed partial survey. Z Wahrscheinlichkeitstheorie verwandte Gebiete 27:87ā€“104

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Hansen BE (2004) Nonparametric estimation of smooth conditional distributions. Working paper, Department of Economics, University of Wisconsin

    Google ScholarĀ 

  • Hansen PR, Lunde A (2005) A forecast comparison of volatility models: does anything beat a GARCH (1,1)? J Appl Econ 20:873ā€“889

    ArticleĀ  MathSciNetĀ  Google ScholarĀ 

  • Hansen PR, Lunde A (2006) Consistent ranking of volatility models. J Econ 131:97ā€“121

    ArticleĀ  MathSciNetĀ  Google ScholarĀ 

  • Hansen PR, Lunde A, Nason JM (2003) Choosing the best volatility models: the model confidence set approach. Oxf Bull Econ Stat 65:839ā€“861

    ArticleĀ  Google ScholarĀ 

  • HƤrdle W (1990) Applied nonparametric regression. Cambridge University Press, Cambridge

    BookĀ  MATHĀ  Google ScholarĀ 

  • HƤrdle W, Bowman AW (1988) Bootstrapping in nonparametric regression: local adaptive smoothing and confidence bands. J Am Stat Assoc 83:102ā€“110

    MATHĀ  Google ScholarĀ 

  • HƤrdle W, Marron JS (1991) Bootstrap simultaneous error bars for nonparametric regression. Ann Stat 19:778ā€“796

    ArticleĀ  MATHĀ  Google ScholarĀ 

  • HƤrdle W, Vieu P (1992) Kernel regression smoothing of time series. J Time Ser Anal 13:209ā€“232

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Hart JD (1997) Nonparametric smoothing and lack-of-fit tests. Springer, New York

    BookĀ  MATHĀ  Google ScholarĀ 

  • Hart JD, Yi S (1998) One-sided cross-validation. J Am Stat Assoc 93(442):620ā€“631

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Hastie T, Tibshirani R, Friedman JH (2009) The elements of statistical learning: data mining, inference, and predictions, 2nd edn. Springer, New York

    BookĀ  Google ScholarĀ 

  • Hocking RR (1976) The analysis and selection of variables in linear regression. Biometrics 31(1):1ā€“49

    ArticleĀ  MathSciNetĀ  Google ScholarĀ 

  • Hong Y (1999) Hypothesis testing in time series via the empirical characteristic function: a generalized spectral density approach. J Am Stat Assoc 94:1201ā€“1220

    ArticleĀ  MATHĀ  Google ScholarĀ 

  • Hong Y, White H (2005) Asymptotic distribution theory for nonparametric entropy measures of serial dependence. Econometrica 73(3):837ā€“901

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Horowitz J (1998) Bootstrap methods for median regression models. Econometrica 66(6):1327ā€“1351

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Huber PJ (1973) Robust regression: asymptotics, conjectures and Monte Carlo. Ann Stat 1:799ā€“821

    ArticleĀ  MATHĀ  Google ScholarĀ 

  • Hurvich CM, Zeger S (1987) Frequency domain bootstrap methods for time series. Technical Report, New York University, Graduate School of Business Administration

    Google ScholarĀ 

  • Jentsch C, Politis DN (2015) Covariance matrix estimation and linear process bootstrap for multivariate time series of possibly increasing dimension. Ann Stat 43(3):1117ā€“1140

    ArticleĀ  MathSciNetĀ  Google ScholarĀ 

  • Kim TY, Cox DD (1996) Bandwidth selection in kernel smoothing of time series. JĀ Time Ser Anal 17:49ā€“63

    ArticleĀ  MathSciNetĀ  Google ScholarĀ 

  • Kirch C, Politis DN (2011) TFT-Bootstrap: resampling time series in the frequency domain to obtain replicates in the time domain. Ann Stat 39(3):1427ā€“1470

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Koenker R (2005) Quantile regression. Cambridge University Press, Cambridge

    BookĀ  MATHĀ  Google ScholarĀ 

  • Kokoszka P, Leipus R (2000) Change-point estimation in ARCH models. Bernoulli 6(3):513ā€“539

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Kokoszka P, Politis DN (2011) Nonlinearity of ARCH and stochastic volatility models and Bartlettā€™s formula. Probab Math Stat 31:47ā€“59

    MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Koopman SJ, Jungbacker B, Hol E (2005) Forecasting daily variability of the S&P 100 stock index using historical, realised and implied volatility measurements. J Empir Finance 12:445ā€“475

    ArticleĀ  Google ScholarĀ 

  • Kreiss J-P, Paparoditis E (2011) Bootstrap methods for dependent data: a review. JĀ Korean Stat Soc 40(4):357ā€“378

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Kreiss J-P, Paparoditis E (2012) The hybrid wild bootstrap for time series. J Am Stat Assoc 107:1073ā€“1084

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Kreiss J-P, Paparoditis E, Politis DN (2011) On the range of validity of the autoregressive sieve bootstrap. Ann Stat 39(4):2103ā€“2130

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Kuhn M, Johnson K (2013) Applied predictive modeling. Springer, New York

    BookĀ  MATHĀ  Google ScholarĀ 

  • KĆ¼nsch H (1989) The jackknife and the bootstrap for general stationary observations. Ann Stat 17:1217ā€“1241

    ArticleĀ  MATHĀ  Google ScholarĀ 

  • Lahiri SN (2003) A necessary and sufficient condition for asymptotic independence of discrete Fourier transforms under short-and long-range dependence. Ann Stat 31(2):613ā€“641

    ArticleĀ  MATHĀ  Google ScholarĀ 

  • Lei J, Robins J, Wasserman L (2013) Distribution free prediction sets. J Am Stat Assoc 108:278ā€“287

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Li Q, Racine JS (2007) Nonparametric econometrics. Princeton University Press, Princeton

    MATHĀ  Google ScholarĀ 

  • Linton OB, Chen R, Wang N, HƤrdle W (1997) An analysis of transformations for additive nonparametric regression. J Am Stat Assoc 92:1512ā€“1521

    ArticleĀ  MATHĀ  Google ScholarĀ 

  • Linton OB, Sperlich S, van Keilegom I (2008) Estimation of a semiparametric transformation model. Ann Stat 36(2):686ā€“718

    ArticleĀ  MATHĀ  Google ScholarĀ 

  • Loader C (1999) Local regression and likelihood. Springer, New York

    MATHĀ  Google ScholarĀ 

  • Mandelbrot B (1963) The variation of certain speculative prices. J Bus 36:394ā€“419

    ArticleĀ  Google ScholarĀ 

  • Maronna RA, Martin RD, Yohai VJ (2006) Robust statistics: theory and methods. Wiley, New York

    BookĀ  Google ScholarĀ 

  • Masarotto G (1990) Bootstrap prediction intervals for autoregressions. Int J Forecast 6(2):229ā€“239

    ArticleĀ  Google ScholarĀ 

  • Masry E, TjĆøstheim D (1995) Nonparametric estimation and identification of nonlinear ARCH time series. Econ Theory 11:258ā€“289

    ArticleĀ  Google ScholarĀ 

  • McCullagh P, Nelder J (1983) Generalized linear models. Chapman and Hall, London

    BookĀ  MATHĀ  Google ScholarĀ 

  • McMurry T, Politis DN (2008) Bootstrap confidence intervals in nonparametric regression with built-in bias correction. Stat Probab Lett 78:2463ā€“2469

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • McMurry T, Politis DN (2010) Banded and tapered estimates of autocovariance matrices and the linear process bootstrap. J Time Ser Anal 31:471ā€“482 [Corrigendum: J Time Ser Anal 33, 2012]

    Google ScholarĀ 

  • McMurry T, Politis DN (2015) High-dimensional autocovariance matrices and optimal linear prediction (with discussion). Electr J Stat 9:753ā€“822

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Meddahi N (2001) An eigenfunction approach for volatility modeling. Technical report, CIRANO Working paper 2001sā€“70, University of Montreal

    Google ScholarĀ 

  • Mikosch T, Starica C (2004) Changes of structure in financial time series and the GARCH model. Revstat Stat J 2(1):41ā€“73

    MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Nadaraya EA (1964) On estimating regression. Theory Probab Appl 9:141ā€“142

    ArticleĀ  Google ScholarĀ 

  • Nelson D (1991) Conditional heteroscedasticity in asset returns: a new approach. Econometrica 59:347ā€“370

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Neumann M, Polzehl J (1998) Simultaneous bootstrap confidence bands in nonparametric regression. J Nonparametr Stat 9:307ā€“333

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Olive DJ (2007) Prediction intervals for regression models. Comput Stat Data Anal 51:3115ā€“3122

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Pagan A, Ullah A (1999) Nonparametric econometrics. Cambridge University Press, Cambridge

    BookĀ  Google ScholarĀ 

  • Pan L, Politis DN (2014) Bootstrap prediction intervals for Markov processes. Discussion paper, Department of Economics, University of California, San Diego. Retrievable from http://escholarship.org/uc/item/7555757g. Accepted for publication in CSDA Annals of Computational and Financial Econometrics

  • Pan L, Politis DN (2015) Bootstrap prediction intervals for linear, nonlinear and nonparametric autoregressions (with discussion). J Stat Plan Infer (to appear)

    Google ScholarĀ 

  • Paparoditis E, Politis DN (1998) The backward local bootstrap for conditional predictive inference in nonlinear time series. In: Lipitakis EA (ed) Proceedings of the 4th Hellenic-European conference on computer mathematics and its applications (HERCMAā€™98). Lea Publishing, Athens, pp 467ā€“470

    Google ScholarĀ 

  • Paparoditis E, Politis DN (2001) A Markovian local resampling scheme for nonparametric estimators in time series analysis. Econ Theory 17(3):540ā€“566

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Paparoditis E, Politis DN (2002a) The local bootstrap for Markov processes. J Stat Plan Infer 108(1):301ā€“328

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Paparoditis E, Politis DN (2002b) Local block bootstrap. C R Acad Sci Paris Ser I 335:959ā€“962

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Pascual L, Romo J, Ruiz E (2004) Bootstrap predictive inference for ARIMA processes. J Time Ser Anal 25(4):449ā€“465

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Patel JK (1989) Prediction intervals: a review. Commun Stat Theory Methods 18:2393ā€“2465

    ArticleĀ  MATHĀ  Google ScholarĀ 

  • Patton AJ (2011) Volatility forecast evaluation and comparison using imperfect volatility proxies. J Econ 160(1):246ā€“256

    ArticleĀ  MathSciNetĀ  Google ScholarĀ 

  • Politis DN (1998) Computer-intensive methods in statistical analysis. IEEE Signal Process Mag 15(1):39ā€“55

    ArticleĀ  Google ScholarĀ 

  • Politis DN (2003a) A normalizing and variance-stabilizing transformation for financial time series. In: Akritas MG, Politis DN (eds) Recent advances and trends in nonparametric statistics. Elsevier, Amsterdam, pp 335ā€“347

    ChapterĀ  Google ScholarĀ 

  • Politis DN (2003b) Adaptive bandwidth choice. J Nonparametr Stat 15(4ā€“5):517ā€“533

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Politis DN (2004) A heavy-tailed distribution for ARCH residuals with application to volatility prediction. Ann Econ Finance 5:283ā€“298

    Google ScholarĀ 

  • Politis DN (2007a)Ā Model-free vs.Ā model-based volatility prediction. J Financ Econ 5(3):358ā€“389

    MathSciNetĀ  Google ScholarĀ 

  • Politis DN (2007b)Ā Model-free prediction, vol LXII. Bulletin of the International Statistical Institute, Lisbon, pp 1391ā€“1397

    Google ScholarĀ 

  • Politis DN (2010)Ā Model-free model-fitting and predictive distributions. Discussion paper, Department of Economics, University of California, San Diego. Retrievable from: http://escholarship.org/uc/item/67j6s174

  • Politis DN (2013)Ā Model-free model-fitting and predictive distributions (with discussion). Test 22(2):183ā€“250

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Politis DN (2014) Bootstrap confidence intervals in nonparametric regression without an additive model. In: Akritas MG, Lahiri SN, Politis DN (eds) Proceedings of the first conference of the international society for nonParametric statistics. Springer, New York, pp 271ā€“282

    Google ScholarĀ 

  • Politis DN, Romano JP (1992) A general resampling scheme for triangular arrays of alpha-mixing random variables with application to the problem of spectral density estimation. Ann Stat 20:1985ā€“2007

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Politis DN, Romano JP (1994) The stationary bootstrap. J Am Stat Assoc 89(428):1303ā€“1313

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Politis DN, Romano JP, Wolf M (1999) Subsampling. Springer, New York

    BookĀ  MATHĀ  Google ScholarĀ 

  • Politis DN, Thomakos D (2008) Financial time series and volatility prediction using NoVaS transformations. In: Rapach DE, Wohar ME (eds) Forecasting in the presence of structural breaks and model uncertainty. Emerald Group Publishing, Bingley, pp 417ā€“447

    ChapterĀ  Google ScholarĀ 

  • Politis DN, Thomakos DD (2012) NoVaS transformations: flexible inference for volatility forecasting. In: Chen X, Swanson N (eds) Recent advances and future directions in causality, prediction, and specification analysis: essays in honor of Halbert L. White Jr. Springer, New York, pp 489ā€“528

    Google ScholarĀ 

  • Pourahmadi M (1999) Joint mean-covariance models with applications to longitudinal data: unconstrained parameterisation. Biometrika 86(3):677ā€“690

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Pourahmadi M (2011) Modeling covariance matrices: the GLM and regularization perspectives. Stat Sci 26(3):369ā€“387

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Poon S, Granger C (2003) Forecasting volatility in financial markets: a review. JĀ Econ Lit 41:478ā€“539

    ArticleĀ  Google ScholarĀ 

  • Priestley MB (1965) Evolutionary spectra and non-stationary processes. J R Stat Soc Ser B 27:204ā€“237

    MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Priestley MB (1988) Nonlinear and nonstationary time series analysis. Academic, London

    Google ScholarĀ 

  • RaĆÆs N (1994) MĆ©thodes de rĆ©Ć©chantillonnage et de sous-Ć©chantillonnage pour des variables alĆ©atoires dĆ©pendantes et spatiales. Ph.D.Ā thesis, University of Montreal

    Google ScholarĀ 

  • Rajarshi MB (1990) Bootstrap in Markov sequences based on estimates of transition density. Ann Inst Stat Math 42:253ā€“268

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Resnick S, Samorodnitsky G, Xue F (1999) How misleading can sample ACFā€™s of stable MAā€™s be? (Very!) Ann Appl Probab 9(3):797ā€“817

    MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Rissanen J, Barbosa L (1969) Properties of infinite covariance matrices and stability of optimum predictors. Inf Sci 1:221ā€“236

    ArticleĀ  MathSciNetĀ  Google ScholarĀ 

  • Rosenblatt M (1952) Remarks on a multivariate transformation. Ann Math Stat 23:470ā€“472

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Ruppert D, Cline DH (1994) Bias reduction in kernel density estimation by smoothed empirical transformations. Ann Stat 22:185ā€“210

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Schmoyer RL (1992) Asymptotically valid prediction intervals for linear models. Technometrics 34:399ā€“408

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Schucany WR (2004) Kernel smoothers: an overview of curve estimators for the first graduate course in nonparametric statistics. Stat Sci 19:663ā€“675

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Seber GAF, Lee AJ (2003) Linear regression analysis, 2nd edn. Wiley, New York

    BookĀ  MATHĀ  Google ScholarĀ 

  • Shao J, Tu D (1995) The Jackknife and bootstrap. Springer, New York

    BookĀ  MATHĀ  Google ScholarĀ 

  • Shapiro SS, Wilk M (1965) An analysis of variance test for normality (complete samples). Biometrika 52:591ā€“611

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Shephard N (1996) Statistical aspects of ARCH and stochastic volatility. In: Cox DR, Hinkley DV, Barndorff-Nielsen OE (eds) Time series models in econometrics, finance and other fields. Chapman and Hall, London, pp 1ā€“67

    Google ScholarĀ 

  • Shi SG (1991) Local bootstrap. Ann Inst Stat Math 43:667ā€“676

    ArticleĀ  MATHĀ  Google ScholarĀ 

  • Shmueli G (2010) To explain or to predict? Stat Sci 25:289ā€“310

    ArticleĀ  MathSciNetĀ  Google ScholarĀ 

  • Starica C, Granger C (2005) Nonstationarities in stock returns. Rev Econ Stat 87(3):503ā€“522

    ArticleĀ  Google ScholarĀ 

  • Stine RA (1985) Bootstrap prediction intervals for regression. J Am Stat Assoc 80:1026ā€“1031

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Stine RA (1987) Estimating properties of autoregressive forecasts. J Am Stat Assoc 82:1072ā€“1078

    ArticleĀ  MathSciNetĀ  Google ScholarĀ 

  • Thombs LA, Schucany WR (1990) Bootstrap prediction intervals for autoregression. J Am Stat Assoc 85:486ā€“492

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Tibshirani R (1988) Estimating transformations for regression via additivity and variance stabilization. J Am Stat Assoc 83:394ā€“405

    ArticleĀ  MathSciNetĀ  Google ScholarĀ 

  • Tibshirani R (1996) Regression shrinkage and selection via the Lasso. J R Stat Soc Ser B 58(1):267ā€“288

    MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Thomakos DD, Klepsch J, Politis DN (2015) Multivariate NoVaS and inference on conditional correlations. Working paper, Department of Economics, University of California, San Diego

    Google ScholarĀ 

  • Wang L, Brown LD, Cai TT, Levine M (2008) Effect of mean on variance function estimation in nonparametric regression. Ann Stat 36:646ā€“664

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Wang L, Politis DN (2015) Asymptotic validity of bootstrap confidence intervals in nonparametric regression without an additive model. Working paper, Department of Mathematics, University of California, San Diego

    Google ScholarĀ 

  • Watson GS (1964) Smooth regression analysis. Sankhya Ser A 26:359ā€“372

    MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Wolf M, Wunderli D (2015) Bootstrap joint prediction regions. J Time Ser Anal 36(3):352ā€“376

    ArticleĀ  MathSciNetĀ  Google ScholarĀ 

  • Wolfowitz J (1957) The minimum distance method. Ann Math Stat 28:75ā€“88

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Wu S, Harris TJ, McAuley KB (2007) The use of simplified or misspecified models: linear case. Can J Chem Eng 75:386ā€“398

    Google ScholarĀ 

  • Wu W-B, Pourahmadi M (2009) Banding sample autocovariance matrices of stationary processes. Stat Sin 19(4):1755ā€“1768

    MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Xiao H, Wu W-B (2012) Covariance matrix estimation for stationary time series. Ann Stat 40(1):466ā€“493

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Zhang T, Wu W-B (2011) Testing parametric assumptions of trends of nonstationary time series. Biometrika 98(3):599ā€“614

    ArticleĀ  MathSciNetĀ  MATHĀ  Google ScholarĀ 

  • Zhou Z, Wu W-B (2009) Local linear quantile estimation for non-stationary time series. Ann Stat 37:2696ā€“2729

    ArticleĀ  MATHĀ  Google ScholarĀ 

  • Zhou Z, Wu W-B (2010) Simultaneous inference of linear models with time-varying coefficients. J R Stat Soc Ser B 72:513ā€“531

    ArticleĀ  Google ScholarĀ 

Download references

Acknowledgements

ChapterĀ 8 is based on the working paper: L. Pan and D.N. Politis, ā€œBootstrap prediction intervals for Markov processes,ā€ Dept.Ā of Economics, UCSD, retrievable from:

http://escholarship.org/uc/item/7555757g; the paper has been accepted to appear in the CSDA Annals of Computational and Financial Econometrics in 2015. Many thanks are due to CSDA Editor, E.J. Kontoghiorghes, and to Li Pan for compiling the software and running extensive simulations for the paper and the chapter. Additional simulations on the performance of Model-free confidence intervals can be found in: L. Pan and D.N. Politis, ā€œModel-Free Bootstrap for Markov processes,ā€ in Proceedings of the 60th World Statistics Congressā€“ISI2015, Rio de Janeiro, Brazil, July 26ā€“31, 2015.

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

Ā© 2015 The Author

About this chapter

Cite this chapter

Politis, D.N. (2015). Model-Free Inference for Markov Processes. In: Model-Free Prediction and Regression. Frontiers in Probability and the Statistical Sciences. Springer, Cham. https://doi.org/10.1007/978-3-319-21347-7_8

Download citation

Publish with us

Policies and ethics