Skip to main content

Robust Recursive Estimation and Detection of Shifts in Regression

  • Conference paper
COMPSTAT

Abstract

Robust recursive estimation provides considerable computational advantage over iterative robust regression estimation, especially for large and ordered (e.g., with time) data sets. The robust recursive estimates are less sensitive than recursive least squares to the outliers and structural shifts, and produce residuals which are more effective in constructing tests for detecting a shift. In this paper we consider a problem of detecting a shift in regression when it is masked by outliers, and summarize results of a simulation study comparing several tests and estimates of the change point.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Beckman, R.J. and R.D. Cook (1979), “Testing for two-phase regression,” Technometrics, 21, 65–69.

    Article  Google Scholar 

  • Brown, R.I., J. Durbin, and J.M. Evans (1975), “Techniques for testing the constancy of regression relationships over time,” JRSS, B37, 149–192.

    Google Scholar 

  • Chow, G. (1960), “Tests of the equality between two sets of coefficients in two linear regressions,” Econometrica, 28, 561–605.

    Article  Google Scholar 

  • Dufour, J-M. (1982), “Recursive stability analysis of linear regression relationships,” Journal of Econometrics, 19, 31–76.

    Article  Google Scholar 

  • Hannan, E.J. (1977), “ARMAX and state space systems and recursive calculations, in M.D. Intrilligator, ed. Frontiers of Quantitative Economics-111A, Amsterdam: North-Holland, 321–336.

    Google Scholar 

  • Harvey, A.C. and G.D.A. Phillips (1979), “Maximum likelihood estimation of regression models with autoregressive — moving average disturbances,” Biometrika, 66, 1, 49–58.

    Google Scholar 

  • Hinkley, D. (1970), “Inference about the Change-Point in a Sequence of Random variables,” Biometrika, 57, 1–17.

    Article  Google Scholar 

  • Huber, P. (1981), Robust Statistics, J. Wiley and Sons, New York.

    Book  Google Scholar 

  • Jazwinski, A.H. (1970), Stochastic Processes and Filtering Theory, Academic Press, New York.

    Google Scholar 

  • Krasker, W. and R.E. Welsch (1982), “Efficient bounded-influence regression estimation,” JASA, 77, 595–604.

    Google Scholar 

  • Kuh, E., A. Samarov and M. Shell (1986), RECUR: A program for robust recursive estimation, stability testing, and forecasting, Technical Report No. 62, CCREMS, MIT., Cambridge, MA.

    Google Scholar 

  • Ljung, L. and T. Soderstrom (1983), Theory and practice of recursive identification, MIT Press, Cambridge, MA.

    Google Scholar 

  • Martin, R.D., C.J. Masreliez (1975), “Robust estimation via stochastic approximation,” IEEE Trans. on Information Theory, IT-21, 3, 263–271.

    Article  Google Scholar 

  • Phillips, G.D.A. and A.C. Harvey (1974), “A simple test for serial correlation in regression analysis,” JASA, 69, 935–939.

    Google Scholar 

  • Polyak, B. and Ja. Tsypkin (1979), “Adaptive estimation,” Automation and Remote Control3, 71–84.

    Google Scholar 

  • Quandt, R.E. (1958), “The estimation of the parameters of a linear regression system obeying two separate regimes,” JASA, 53, 873–880.

    Google Scholar 

  • Ronchetti, E. (1982), “Robust testing in linear models: the infinitesimal approach,” Ph.D dissertation, ETH, Zurich, 1982.

    Google Scholar 

  • Schrader, R.M. and T.P. Hettmansperger (1980), “Robust analysis of variance based upon a likelihood ratio criterion, Biometrica, 67, 93–101.

    Article  Google Scholar 

  • Schweder, T. (1976), “Some ‘optimal’ methods to detect structural shift or outliers in regression,” JASA, 71, 491–501.

    Google Scholar 

  • Sen, P. (1982), “Invariance principles for recursive residuals,” Annals of Mathematical Statistics, 10, 1, 307–312.

    Google Scholar 

  • West, M. (1981), “Robust sequential approximate Bayesian estimation,” JRSS, B, 43, 2, 157–166.

    Google Scholar 

  • Young, P. (1974), “Recursive approaches to time series analysis,” Bull Inst. Math. App 10, 209–224.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1986 Physica-Verlag, Heidelberg for IASC (International Association for Statistical Computing)

About this paper

Cite this paper

Kuh, E., Samarov, A. (1986). Robust Recursive Estimation and Detection of Shifts in Regression. In: De Antoni, F., Lauro, N., Rizzi, A. (eds) COMPSTAT. Physica-Verlag HD. https://doi.org/10.1007/978-3-642-46890-2_32

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-46890-2_32

  • Publisher Name: Physica-Verlag HD

  • Print ISBN: 978-3-7908-0355-6

  • Online ISBN: 978-3-642-46890-2

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics