Synonyms
Linear models; Regression analysis
Short Definition
Regression is a statistical approach for estimating the relationships among variables.
Introduction
Regression is a statistical approach for modelling the relationship between a response variable y and one or several explanatory variables x. Various types of regression methods are extensively applied for the analysis of data from literarily all fields of quantitative research. For example, multiple linear regression, logistic regression, and Cox proportional hazards models have been the main basic statistical tools in medical research for decades. In the last 20–30 years, the regression toolbox has been supplied with numerous extensions, like, for example, generalized additive models, regression methods for repeated measurements, and regression methods for high-dimensional data, to mention some.
Most regression models are fitted to data with the purpose of either (1) using the fitted model to predict values of yfor new...
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Alma, O.: Comparison of robust regression methods in linear regression. Int. J. Contemp. Math. Sci. 6(9), 409–421 (2011)
Bates, D.: Fitting linear mixed models in R. R News 5(1), 27–30 (2005)
Bates D, Maechler M, Bolker B and Walker S. lme4: Linear mixed-effects models using Eigen and S4. R package version 1.1-7, ArXiv e-print; submitted to Journal of Statistical Software, (2014) http://CRAN.R-project.org/package=lme4
Bühlmann, P., van de Geer, S.: Statistics for High-Dimensional Data: Methods, Theory and Applications. Springer Series in Statistics. Springer, Heidelberg/Berlin (2011)
Cherkassky, V., Ma, Y.: Comparison of model selection for regression. Neural Comput. 15, 1691–1714 (2003)
Collett, D.: Modelling Binary Data, 2nd edn. Chapman & Hall/CRC Texts in Statistical Science. Taylor & Francis, Boca Raton, Florida, USA (2002)
Cox, D.R.: Regression models and life-tables. J. R. Stat. Soc. Ser. B (Methodol.) 34(2), 187–220 (1972)
Dobson, A., Barnett, A.: An Introduction to Generalized Linear Models, 3rd edn. Chapman and Hall/CRC, Boca Raton, Florida, USA (2008)
Faraway, J.J.: Extending the Linear Model with R: Generalized Linear, Mixed Effects and Nonparametric Regression Models. Chapman & Hall/CRC, New York (2006)
Fitzmaurice, G., Laird, N., Ware, J.: Applied Longitudinal Analysis, 2nd edn. Wiley Series in Probability and Statistics. John Wiley & Sons, Inc., Hoboken, New Jersey, Wiley, New York (2011)
Fox, J., Weisberg, S.: An R Companion to Applied Regression, 2nd edn. Sage, Thousand Oaks (2011)
Friedman, J., Hastie, T., Tibshirani, R.: Regularization paths for generalized linear models via coordinate descent. J. Stat. Softw. 33(1), 1–22 (2010)
Gelman, A., Su, Y., Yajima, M., Hill, J., Pittau, M.G., Kerman, J., Zheng, T.: Arm: data analysis using regression and multilevel/hierarchical models. R package version 1.3-02, new version 1.6-10 2013 (2010)
Hadfield, J.D.: Mcmc methods for multi-response generalised linear mixed models: the mcmcglmm r package. J. Stat. Softw. 33, 1–22 (2010)
Harrell, F.E.: Regression Modeling Strategies: With Applications to Linear Models, Logistic Regression, and Survival Analysis. Springer Series in Statistics. Springer, New York (2001)
Hastie, T., Tibshirani, R.: Generalized Additive Models. Monographs on Statistics and Applied Probability Series. Chapman & Hall/CRC, Boca Raton, London (1990)
Hastie, T., Tibshirani, R., Friedman, J.: The Elements of Statistical Learning: Data Mining, Inference, and Prediction. Springer Series in Statistics. Springer, New York (2009)
Hoerl, A., Kennard, R.: Ridge regression: biased estimation for nonorthogonal problems. Technometrics 12, 55–67 (1970)
Hosmer, D.W.J., Lemeshow, S., May, S.: Applied Survival Analysis: Regression Modeling of Time to Event Data. Wiley Series in Probability and Statistics. Wiley, Hoboken, New Jersey (2011)
Huang, J., Ma, S., Zhang, C.H.: Adaptive lasso for sparse high-dimensional regression models. Stat. Sin. 18, 1603–1618 (2008)
Kadane, J., Lazar, N.: Methods and criteria for model selection, review article. J. Am. Stat. Assoc. 99(465), 279–290 (2004)
Kleinbaum, D.G.: Applied Regression Analysis and Multivariable Methods. Duxbury Applied Series. Thomson Brooks/Cole Publishing, Belmont, California, USA (2007)
Kleinbaum, D., Klein, M.: Logistic Regression: A Self-learning Text, 3rd edn. Springer, New York (2010)
Kleinbaum, D., Klein, M.: Survival Analysis. Statistics for Biology and Health. Springer, New York (2012)
Kutner, M., Nachtcheim, C., Neter, J., Li, W.: Applied Linear Statistical Models, 5th edn. McGraw-Hill Companies, Boston (2005)
Maronna, R.A., Martin, R.D., Yohai, V.J.: Robust Statistics: Theory and Methods. Wiley, Chichester, England (2006)
Martinussen, T., Scheike, T.: Dynamic Regression Models for Survival Data. Springer, New York (2006)
McCullagh, P., Nelder, J.: Generalized Linear Models, 2nd edn. Chapman & Hall, London (1989)
McCulloch, C., Searle, S., Neuhaus, J.: Generalized, Linear and Mixed Models, 2nd edn. Wiley Series in Probability and Statistics. Wiley, New York (2008)
Nelder, J., Wedderburn, R. Generalized linear models. J. R. Stat. Soc.: Ser. A 132, 370–384 (1972)
Rabe-Hesketh, S., Skrondal, A.: Multilevel and Longitudinal Modeling Using Stata, 3rd edn. Stata Press, College Station (2012)
Royston, P., Sauerbrei, W.: Multivariable Model – Building: A Pragmatic Approach to Regression Analysis Based on Fractional Polynomials for Modelling Continuous Variables. Wiley Series in Probability and Statistics. Wiley, Chichester, England (2008)
Tibshirani, R.: Regression shrinkage and selection via the lasso. J. R. Stat. Soc. 58, 267–288 (1996)
Venables, W., Ripley, B.: Modern Applied Statistics with S, 4th edn. Springer, New York (2002)
Verbeke, G., Molenberghs, G.: Linear, Mixed Models for Longitudinal Data. Springer Series in Statistics. Springer, New York (2000)
Wood, S.: Generalized Additive Models: An Introduction with R. Texts in Statistical Science Series. Chapman and Hall/CRC, Boca Raton, Florida, USA (2006)
Yuan, M., Lin, Y.: Model selection and estimation in regression with grouped variables. J. R. Stat. Soc.: Ser. B 68(1), 49–67 (2006)
Zou, H., Hastie, T.: Regularization and variable selection via the elastic net. J. R. Stat. Soc.: Ser. B (Stat. Methodol.) 67(2), 301–320 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer-Verlag Berlin Heidelberg
About this entry
Cite this entry
Glad, I.K., Tharmaratnam, K. (2015). Regression. In: Engquist, B. (eds) Encyclopedia of Applied and Computational Mathematics. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-70529-1_420
Download citation
DOI: https://doi.org/10.1007/978-3-540-70529-1_420
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-70528-4
Online ISBN: 978-3-540-70529-1
eBook Packages: Mathematics and StatisticsReference Module Computer Science and Engineering