Abstract
The technique of calibration in survey sampling is a widely used technique in the field of official statistics. The main element of the calibration process is an optimization procedure, for which a variety of penalty functions can be used. In this chapter, we consider three of the classical penalty functions that are implemented in many of the standard calibration software packages. We present two algorithms used by many of these software packages, and explore the properties of the calibrated weights and the corresponding estimates when using these two algorithms with the classical calibration penalty functions.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bankier, M., Rathwell, S., Majkowski, M., et al.: Two step generalized least squares estimation in the 1991 Canadian census. In: Proceedings of the Workshop on Uses of Auxiliary Information in Surveys (1992)
Bardsley, P., Chambers, R.: Multipurpose estimation from unbalanced samples. Appl. Stat. 33 (3), 290–299 (1984)
Bocci, J., Beaumont, C.: Another look at ridge calibration. Metron 66 (1), 5–20 (2008)
Brewer, K.: Cosmetic calibration with unequal probability sampling. Surv. Methodol. 25 (2), 205–212 (1999)
Brodie, P., Cotterell, B.: Reducing or eliminating the effects of extreme calibration weights in social surveys. In: Proceedings, 3rd European Conference on Quality in Survey Statistics, Cardiff (2006)
Chambers, R.: Robust case-weighting for multipurpose establishment surveys. J. Off. Stat. 12 (1), 3–32 (1996)
Chauvet, G., Deville, J., El Haj Tirari, M., Le Guennec, J.: Evaluation de trois logiciels de calage: g-CALIB 2.0, CALMAR 2 et BASCULA 4.0. Tech. rep., Statistics Belgium (2005)
Davies, G., Gillard, J., Zhigljavsky, A.: Calibration in survey sampling as an optimization problem. In: Optimization, Control, and Applications in the Information Age, pp. 67–89. Springer, Cham (2015)
Deville, J.C., Särndal, C.E.: Calibration estimators in survey sampling. J. Am. Stat. Assoc. 87 (418), 376–382 (1992)
Deville, J.C., Särndal, C.E., Sautory, O.: Generalized raking procedures in survey sampling. J. Am. Stat. Assoc. 88 (423), 1013–1020 (1993)
Estevao, V.: Calculation of g-weights under calibration and bound constraints. Tech. rep., Statistics Canada (1994)
Estevao, V., Hidiroglou, M., Särndal, C.: Methodological principles for a generalized estimation system at statistics Canada. J. Off. Stat. 11 (2), 181–204 (1995)
Fuller, W., Loughin, M., Baker, H.: Regression weighting in the presence of nonresponse with application to the 1987–1988 national food consumption survey. Surv. Methodol. 20, 75–85 (1994)
Han, S.P.: A successive projection method. Math. Program. 40 (1), 1–14 (1988)
Horvitz, D.G., Thompson, D.J.: A generalization of sampling without replacement from a finite universe. J. Am. Stat. Assoc. 47 (260), 663–685 (1952)
Huang, E., Fuller, W.: Nonnegative regression estimation for sample survey data. In: Proceedings of the Social Statistics Section, vol. 21, pp. 300–305. American Statistical Association, Washington, D.C. (1978)
Kalton, G., Flores-Cervantes, I.: Weighting methods. J. Off. Stat. 19 (2), 81–98 (2003)
Kish, L.: Weighting for unequal pi. J. Off. Stat. 8 (2), 183 (1992)
Kott, P.S.: Using calibration weighting to adjust for nonresponse and coverage errors. Surv. Methodol. 32 (2), 133–142 (2006)
Le Guennec, J., Sautory, O.: La macro CALMAR2: redressement d’un échantillon par calage sur marges. Tech. rep., INSEE (2005)
Lumley, T.: Package ‘survey’. R package version 3.30-3 (2015)
Lundström, S., Särndal, C.E.: Calibration as a standard method for treatment of nonresponse. J. Off. Stat. 15, 305–327 (1999)
Mathar, R., Žilinskas, A.: A class of test functions for global optimization. J. Glob. Optim. 5 (2), 195–199 (1994)
Nieuwenbroek, N., Boonstra, H.: Bascula 4.0 Reference Manual. Statistics Netherlands, The Hague/Heerlen (2002)
Office for National Statistics. Social Survey Division: Labour Force Survey Five-Quarter Longitudinal Dataset, April 2012–June 2013. UK Data Service. SN: 7379. http://dx.doi.org/10.5255/UKDA-SN-7379-2 (2015)
Rao, J., Singh, A.: Range restricted weight calibration for survey data using ridge regression. Pak. J. Stat. 25 (4), 371–384 (2009)
Särndal, C.: The calibration approach in survey theory and practice. Surv. Methodol. 33 (2), 99–119 (2007)
Särndal, C.E., Swensson, B., Wretman, J.: Model Assisted Survey Sampling. Springer, New York (2003)
Sautory, O.: Redressements d’échantillons d’enquêtes auprès des ménages par calage sur marges. Tech. rep., INSEE (1991)
Sautory, O.: La macro CALMAR. Redressement d’un échantillon par calage sur marges. Tech. rep., INSEE (1993)
Sautory, O.: CALMAR2: a new version of the CALMAR calibration adjustment program. In: Proceedings of Statistics Canada Symposium (2003)
Singh, A., Mohl, C.: Understanding calibration estimators in survey sampling. Surv. Methodol. 22 (2), 107–116 (1996)
Tate, P.F.: Utilising longitudinally linked data from the British labour force survey. Surv. Methodol. 25, 99–104 (1999)
Théberge, A.: Calibration and restricted weights. Surv. Methodol. 26 (1), 99–108 (2000)
Tillé, Y., Matei, A.: Package ‘sampling’. R package version 2.6 (2015)
Torn, A., Žilinskas, A.: Global Optimization. Springer, New York (1989)
Vanderhoeft, C.: Generalised calibration at Statistics Belgium: SPSS module g-CALIB-S and current practices. Tech. rep., Statistics Belgium (2001)
Ypma, T.J.: Historical development of the Newton-Raphson method. SIAM Rev. 37 (4), 531–551 (1995)
Zardetto, D.: Package ‘ReGenesees’. R package version 1.7 (2015)
Zhigljavsky, A., Žilinskas, A.: Stochastic Global Optimization. Springer, Berlin (2008)
Žilinskas, A.: A review of statistical models for global optimization. J. Glob. Optim. 2 (2), 145–153 (1992)
Žilinskas, A.: On similarities between two models of global optimization: statistical models and radial basis functions. J. Glob. Optim. 48 (1), 173–182 (2010)
Žilinskas, A.: A statistical model-based algorithm for ‘black-box’ multi-objective optimisation. Int. J. Syst. Sci. 45 (1), 82–93 (2014)
Žilinskas, A., Žilinskas, J.: Branch and bound algorithm for multidimensional scaling with city-block metric. J. Glob. Optim. 43 (2), 357–372 (2009)
Žilinskas, A., Žilinskas, J.: P-algorithm based on a simplicial statistical model of multimodal functions. Top 18 (2), 396–412 (2010)
Acknowledgements
Work of the first author was supported by the Engineering and Physical Sciences Research Council, project number 1638853 “Examination of approaches to calibration and weighting for non-response in cross-sectional and longitudinal surveys.” The work of the third author was supported by the Russian Science Foundation, project No. 15-11-30022 “Global optimization, supercomputing computations, and application”.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Davies, G., Gillard, J., Zhigljavsky, A. (2016). Comparative Study of Different Penalty Functions and Algorithms in Survey Calibration. In: Pardalos, P., Zhigljavsky, A., Žilinskas, J. (eds) Advances in Stochastic and Deterministic Global Optimization. Springer Optimization and Its Applications, vol 107. Springer, Cham. https://doi.org/10.1007/978-3-319-29975-4_6
Download citation
DOI: https://doi.org/10.1007/978-3-319-29975-4_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-29973-0
Online ISBN: 978-3-319-29975-4
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)