Skip to main content
Log in

Modified LASSO estimators for time series regression models with dependent disturbances

  • Original Paper
  • Published:
Statistical Methods & Applications Aims and scope Submit manuscript

Abstract

This paper applies the modified least absolute shrinkage and selection operator (LASSO) to the regression model with dependent disturbances, especially, long-memory disturbances. Assuming the norm of different column in the regression matrix may have different order of observation length n, we introduce a modified LASSO estimator where the tuning parameter \(\lambda\) is not a scalar but vector. When the dimension of parameters is fixed, we derive the asymptotic distribution of the modified LASSO estimators under certain regularity condition. When the dimension of parameters increases with respect to n, the consistency on the probability of the correct selection of penalty parameters is shown under certain regularity conditions. Some simulation studies are examined.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Anderson TW (1971) The statistical analysis of time series. Wiley, Hoboken

    MATH  Google Scholar 

  • Beran J (1992) Statistical methods for data with long-range dependence. Stat Sci 7(4):404–427

    Article  Google Scholar 

  • Granger CW, Joyeux R (1980) An introduction to long-memory time series models and fractional differencing. J Time Ser Anal 1(1):15–29

    Article  MathSciNet  MATH  Google Scholar 

  • Grenander U, Rosenblatt M (1957) Statistical analysis of stationary time series. Wiley, New York

    Book  MATH  Google Scholar 

  • Hallin M, Taniguchi M, Serroukh A, Choy K (1999) Local asymptotic normality for regression model with long-memory disturbance. Ann Stat 27(6):2054–2080

    Article  MathSciNet  MATH  Google Scholar 

  • Hannan EJ (1970) Multiple time series. Wiley, Hoboken

    Book  MATH  Google Scholar 

  • Hurvich CM, Tsai CL (1989) Regression and time series model selection in small samples. Biometrika 76(2):297–307

    Article  MathSciNet  MATH  Google Scholar 

  • Kaul A (2014) Lasso with long memory regression errors. J Stat Plan Inference 153:11–26

    Article  MathSciNet  MATH  Google Scholar 

  • Kock AB, Callot L (2015) Oracle inequalities for high dimensional vector autoregressions. J Econom 180:325–344

    Article  MathSciNet  MATH  Google Scholar 

  • Mandelbrot BB, Taqqu MS (1979) Robust R/S analysis of long run serial correlation. Proc 42nd Sess Int Stat Inst (Bull Int Stat Inst) 48(2):69–104

    MathSciNet  MATH  Google Scholar 

  • Mandelbrot BB, Van Ness JW (1968) Fractional Brownian motions, fractional noises and applications. SIAM Rev 10(4):422–437

    Article  MathSciNet  MATH  Google Scholar 

  • Medeiros MC, Mendes EF (2016) \(l_1\)-regularization of high-dimensional time-series models with non-Gaussian and heteroskedastic errors. J Econom 191:255–271

    MATH  Google Scholar 

  • Meinshausen N, Bühlmann P (2006) High-dimensional graphs and variable selection with the lasso. Ann Stat 34(3):1436–1462

    Article  MathSciNet  MATH  Google Scholar 

  • Osborne MR, Presnell B, Turlach BA (2000) On the lasso and its dual. J Comput Graph Stat 9(2):319–337

    MathSciNet  Google Scholar 

  • Tang L, Zhou Z, Wu C (2012) Efficient estimation and variable selection for infinite variance autoregressive models. J Appl Math Comput 40:399–413

    Article  MathSciNet  MATH  Google Scholar 

  • Taniguchi M, Hirukawa J, Tamaki K (2008) Optimal statistical inference in financial engineering. CRC Press, Boca Raton

    MATH  Google Scholar 

  • Tibshirani R (1996) Regression shrinkage and selection via the lasso. J R Stat Soc Series B 58:267–288

    MathSciNet  MATH  Google Scholar 

  • Wang H, Li G, Tsai CL (2007) Regression coefficient and autoregressive order shrinkage and selection via the lasso. J R Stat Soc Ser B Stat Methodol 69(1):63–78

    Article  MathSciNet  Google Scholar 

  • Yajima Y (1991) Asymptotic properties of the LSE in a regression model with long-memory stationary errors. Ann Stat 19(1):158–177

    Article  MathSciNet  MATH  Google Scholar 

  • Yuan M, Lin Y (2007) Model selection and estimation in the Gaussian graphical model. Biometrika 94(1):19–35

    Article  MathSciNet  MATH  Google Scholar 

Download references

Acknowledgements

The first author would like to thank Mr. Fujimori for helping understand the high dimensional problem-solving idea. The second author thanks supports by Research Institute for Science and Engineering, Waseda University and JSPS Fundings: Kiban(A)(23244011, 15H02061) and Kiban(S)(18H05290).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yujie Xue.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xue, Y., Taniguchi, M. Modified LASSO estimators for time series regression models with dependent disturbances. Stat Methods Appl 29, 845–869 (2020). https://doi.org/10.1007/s10260-020-00506-w

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10260-020-00506-w

Keywords

Navigation