Abstract
In this note the problem of nonparametric regression function estimation in a random design regression model with Gaussian errors is considered from the Bayesian perspective. It is assumed that the regression function belongs to a class of functions with a known degree of smoothness. A prior distribution on the given class can be induced by a prior on the coefficients in a series expansion of the regression function through an orthonormal system. The rate of convergence of the resulting posterior distribution is employed to provide a measure of the accuracy of the Bayesian estimation procedure defined by the posterior expected regression function. We show that the Bayes’ estimator achieves the optimal minimax rate of convergence under mean integrated squared error over the involved class of regression functions, thus being comparable to other popular frequentist regression estimators.
Similar content being viewed by others
References
Amewou-Atisso M, Ghosal S, Ghosh JK, Ramamoorthi RV (2003) Posterior consistency for semi-parametric regression problems. Bernoulli 9:291–312
Barron A, Schervish MJ, Wasserman L (1999) The consistency of posterior distributions in nonparametric problems. Ann Stat 27:536–561
Choudhuri N, Ghosal S, Roy A (2005) Bayesian methods for function estimation. In: Dey D, Rao CR (eds) Handbook of statistics. Bayesian thinking, modeling and computation, vol 25
Choudhuri N, Ghosal S, Roy A (2007) Nonparametric binary regression using a Gaussian process prior. Stat Methodol 4:227–243
Cifarelli DM, Muliere P, Scarsini M (1981) Il modello lineare nell’approccio bayesiano non parametrico. Istituto Matematico “G. Castelnuovo”, Università degli Studi di Roma “La Sapienza”, vol 15
Diaconis P, Freedman D (1986a) On the consistency of Bayes estimates. With a discussion and a rejoinder by the authors. Ann Stat 14:1–67
Diaconis P, Freedman D (1986b) On inconsistent Bayes estimates of location. Ann Stat 14:68–87
Ghosal S, Roy A (2006) Posterior consistency of Gaussian process prior for nonparametric binary regression. Ann Stat 34:2413–2429
Ghosal S, Ghosh JK, van der Vaart AW (2000) Convergence rates of posterior distributions. Ann Stat 28:500–531
Kleijn BJK, van der Vaart AW (2006) Misspecification in infinite-dimensional Bayesian statistics. Ann Stat 34:837–877
Laha RG, Rohatgi VK (1979) Probability theory. Wiley, New York-Chichester-Brisbane
Nadaraya EA (1964) On estimating regression. Theory Probab Appl 9:141–142
Shen X, Wasserman L (2001) Rates of convergence of posterior distributions. Ann Stat 29:687–714
Tsybakov AB (2004) Introduction à l’estimation non-paramètrique. Springer, Berlin
Wasserman L (2006) All of nonparametric statistics. Springer, New York
Watson GS (1964) Smooth regression analysis. Sankhyā A 26:359–372
Yang Y, Barron A (1999) Information-theoretic determination of minimax rates of convergence. Ann Stat 27:1564–1599
Zhao LH (2000) Bayesian aspects of some nonparametric problems. Ann Stat 28:532–552
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Scricciolo, C. A note on Bayesian nonparametric regression function estimation. Stat Meth Appl 17, 321–334 (2008). https://doi.org/10.1007/s10260-007-0064-6
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10260-007-0064-6