Abstract
For Nadaraya-Watson regression estimates with window kernel self-contained proofs of strong universal consistency for special bandwidths and of the corresponding Cesàro summability for general bandwidths are given.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Aizerman, M.A., E. M. Braverman, and L. I. Rozonoer. (1964). The probability problem of pattern recognition learning and the method of potential functions. Automation and Remote Control 25, 1175–1190.
Bauer, H. (1991). Wahrscheinlichkeitstheorie, 4th ed. W. de Gruyter, Berlin.
Devroye, L. (1991). Exponential inequalities in nonparametric estimation. In: G. Roussas, Ed., Nonparametric Functional Estimation and Related Topics. NATO ASI Ser. C, Kluwer Acad. Publ., Dordrecht, 31–44.
Devroye, L., L. Gyöfi, A. Krzyzak, and G. Lugosi. (1994). On the strong universal consistency of nearest neighbor regression function estimates. Ann. Statist. 22, 1371–1385.
Devroye, L., L. Gyöfi, and G. Lugosi. (1996). A Probabilistic Theory of Pattern Recognition. Springer, New York, Berlin, Heidelberg.
Devroye, L. and A. Krzyzak. (1989). An equivalence theorem for L1 convergence of the kernel regression estimate. J. Statist. Plann. Inference 23, 71–82.
Devroye, L. and T. J. Wagner. (1980). Distribution-free consistency results in nonparametric discrimination and regression function estimation. Ann. Statist. 8, 231–239.
Devroye, L. and T. J. Wagner. (1980). On the L1 convergence of kernel estimators of regression functions with applications in discrimination. Z. Wahrscheinlichkeitstheorie Verw. Gebiete 51, 15–25.
Dunford, N. and J. Schwartz. (1958). Linear Operators, Part I. Interscience Publ., New York.
Efron, B. and C. Stein. (1981). The jackknife estimate of variance. Ann. Statist. 9, 586–596.
Etemadi, N. (1981). An elementary proof of the strong law of large numbers. Z. Wahrscheinlichkeitstheorie Verw. Gebiete 55, 119–122.
Gladyshev, E.G. (1965). On stochastic approximation. Theor. Probab. Appl. 10, 275–278.
Gyöfi, L. (1991). Universal consistencies of a regression estimate for unbounded regression functions. In: G. Roussas, Ed., Nonparametric Functional Estimation and Related Topics. NATO ASI Ser. C, Kluwer Acad. Publ., Dordrecht, 329–338.
Gyöfi, L., G. Morvai, and S. Yakowitz. (1998). Limits to consistent on-line forecasting for ergodic time series. IEEE Trans. Information Theory, 44, 886–892.
Hädle, W. (1990). Applied Nonparametric Regression. Cambridge University Press, Cambridge.
Hardy, G. H. (1949). Divergent Series. Clarendon Press, Oxford.
Loève, M. (1977). Probability Theory II, 4th ed. Springer, New York, Heidelberg, Berlin.
MacQueen, J. (1967). Some methods for classification and analysis of multivariate observations. In: J. Neyman, Ed., Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability. University of California Press, Berkeley and Los Angeles, 281–297.
McDiarmid, C. (1989). On the method of bounded differences. In: Surveys in Combinatorics 1989. Cambridge University Press, Cambridge, 148–188.
Nadaraya, E.A. (1964). On estimating regression. Theory Probab. Appl. 9, 141–142.
Nobel, A.B. (1999). Limits to classification and regression estimation from ergodic processes. Ann. Statist. 27, 262–273.
Robbins, H. and D. Siegmund. (1971). A convergence theorem for nonnegative almost supermartingales and some applications. In: J.S. Rustagi, Ed., Optimizing Methods of Statistics. Academic Press, New York, 233–257.
Spiegelman, C. and J. Sacks. (1980). Consistent window estimation in nonparametric regression. Ann. Statist. 8, 240–246.
Steele, J.M. (1986). An Efron-Stein inequality for nonsymmetric statistics. Ann. Statist. 14, 753–758.
Stone, C.J. (1977). Consistent nonparametric regression. Ann. Statist. 5, 595–645.
Van Ryzin, J. (1969). On strong consistency of density estimates. Ann. Math. Statist. 40, 1765–1772.
Walk, H. (1997). Strong universal consistency of kernel and partitioning regression estimates. Preprint 97-1, Math. Inst. A, Univ. Stuttgart.
Watson, G.S. (1964). Smooth regression analysis. Ser. A 26, 359–372.
Wheeden, R.L. and A. Zygmund. (1977). Measure and Integral. Marcel Dekker, New York.
Yakowitz, S. and C. C. Heyde. (1997). Long-range dependent effects with implications for forecasting and queueing inference. Preprint.
Zeller, K. and W. Beekmann. (1970). Theorie der Limitierungsverfahren, 2. Aufl. Springer, Berlin, Heidelberg, New York.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer Science + Business Media, Inc.
About this chapter
Cite this chapter
Walk, H. (2002). Almost Sure Convergence Properties of Nadaraya-Watson Regression Estimates. In: Dror, M., L’Ecuyer, P., Szidarovszky, F. (eds) Modeling Uncertainty. International Series in Operations Research & Management Science, vol 46. Springer, New York, NY. https://doi.org/10.1007/0-306-48102-2_10
Download citation
DOI: https://doi.org/10.1007/0-306-48102-2_10
Publisher Name: Springer, New York, NY
Print ISBN: 978-0-7923-7463-3
Online ISBN: 978-0-306-48102-4
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)