Skip to main content
SpringerLink
Log in

The Impact of Texas HIPPY on School Readiness and Academic Achievement: Optimal Full Propensity Score Analysis Approach

  • Published:
Early Childhood Education Journal Aims and scope Submit manuscript

Abstract

This study was intended to evaluate the impact of socioeconomically disadvantaged children’s participation in the Texas home instruction for parents of preschool youngsters (TXHIPPY) program on their school readiness and academic achievement for grades K to eight. The study used a quasi-experimental design and applied optimal full propensity score matching (PSM) to address the evaluation concern of the impact of the TXHIPPY program on HIPPY participants’ academic achievement compared to non-HIPPY participants. This study targeted former HIPPY participants and tracked them in the Dallas independent school district (DISD) database through grade levels. Data were obtained by administering istation’s indicators of progress (ISIP) for kindergarten, TerraNova/SUPERA for grades K to two, and State of Texas assessments of academic readiness (STAAR) for math and reading for grades three to eight. HIPPY and non-HIPPY groups were matched using propensity score analysis procedures. The findings show that the TXHIPPY program positively influences kindergarten students to start school ready to learn. The findings of math and reading achievements suggest that HIPPY children scored at the same level or higher than non-HIPPY children did on math and reading achievement, indicating that TXHIPPY program has achieved its goal of helping children maintain long-term academic success. However, the study findings also indicate that the impact evaluation framework must be designed with attention to higher-level factors beyond academic achievement that influence children’s academic success. This work is vital to policymakers, program managers, and evaluators in the field of home visiting interventions in which it guides implementing rigorous evaluation studies.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Data Availability

Data were collected by querying the Visit Tracker ® database, an internet-based family management tracking system managed by Texas HIPPY Corps Center at the University of North Texas. Data available upon request.

Code Availability

The R software code was specifically developed for this study and available upon request.

References

  • Andrews, R. J., Jargowsky, P., & Kuhne, K. (2012). The effects of Texas’s targeted pre-indergarten program on academic performance. American Institutes for Research.

    Book  Google Scholar 

  • Anthony, E. K., King, B., & Austin, M. J. (2011). Reducing child poverty by promoting child well-being: Identifying best practices in a time of great need. Children and Youth Services Review, 33, 1999–2009. https://doi.org/10.1016/j.childyouth.2011.05.029

    Article  Google Scholar 

  • Austin, P. C., & Stuart, E. A. (2015). Estimating the effect of treatment on binary outcomes using full matching on the propensity score. Statistical Methods in Medical Research, 26, 2505–2525. https://doi.org/10.1177/0962280215601134

    Article  Google Scholar 

  • Baker, A. J., Piotrkowski, C. S., & Brooks-Gunn, J. (1998). The effects of the home instruction program for preschool youngsters (HIPPY) on children’s school performance at the end of the program and one year later. Early Childhood Research Quarterly, 13, 571–588. https://doi.org/10.1016/S0885-2006(99)80061-1

    Article  Google Scholar 

  • Bancroft, K. (2010). Implementing the mandate: The limitations of benchmark tests. Educational Assessment, Evaluation and Accountability, 22, 53–72. https://doi.org/10.1007/s11092-010-9091-1

    Article  Google Scholar 

  • BarHava-Monteith, G., Harre, N., & Field, J. (1999). An evaluation of the HIPPY program in New Zealand. Child Development and Care, 159, 145–157.

    Article  Google Scholar 

  • Barnett, W. S. (2011). Effectiveness of early educational intervention. Science, 333, 975–978. https://doi.org/10.1126/science.1204534

    Article  Google Scholar 

  • Barton, J. L. (2016). Federal investments in evidence-based early childhood home visiting: A multiple streams analysis. Poverty & Public Policy, 8, 248–262. https://doi.org/10.1002/pop4.142

    Article  Google Scholar 

  • Bowden, A. B., Shand, R., Belfield, C. R., Wang, A., & Levin, H. M. (2017). Evaluating educational interventions that induce service receipt: A case study application of city connects. American Journal of Evaluation, 38, 405–419. https://doi.org/10.1177/1098214016664983

    Article  Google Scholar 

  • Bradley, R. H., & Gilkey, B. (2002). The impact of HIPPY on school performance in third and sixth grades. In M. Westheimer (Ed.), Parents making a difference: International research on the home instruction for parents of preschool youngsters (HIPPY) program (pp. 91–101). The Hebrew University Magnes Press.

    Google Scholar 

  • Brigman, G., Villares, E., Wells, C., Carey, C., Harrington, K., & Webb, L. (2015). Psychometric properties and confirmatory factor analysis of the student engagement in school success skills. Measurement & Evaluation in Counseling & Development, 48, 3–14. https://doi.org/10.1177/0748175614544545

    Article  Google Scholar 

  • Brown, A. L. (2008). Children of teenage mothers: School readiness outcomes and predictors of school success. Doctoral Dissertation, University of North Texas, Texas (OCLC No. 320842419).

  • Brown, A. L. (2015). The impact of early intervention on the school readiness of children born to teenage mothers. Journal of Early Childhood Research, 13, 181–195. https://doi.org/10.1177/1476718X13479048

    Article  Google Scholar 

  • Brown, A. L., & Johnson, U. (2014). The impact of HIPPY participation on school readiness and parent involvement. NHSA Dialog, 17, 74.

    Google Scholar 

  • Brown, A. L., & Lee, J. (2017). Evaluating the efficacy of children participating in home instruction for parents of preschool youngsters and head start. Journal of Early Childhood Research, 15, 61–72. https://doi.org/10.1177/1476718X15577006

    Article  Google Scholar 

  • Caliendo, M., & Kopeinig, S. (2008). Some practical guidance for the implementation of propensity score matching. Journal of Economic Surveys, 22, 31–72. https://doi.org/10.1111/j.1467-6419.2007.00527.x

    Article  Google Scholar 

  • Chase-Lansdale, P. L., & Brooks-Gunn, J. (2014). Two-generation programs in the twenty-first century. The Future of Children, 24, 13–39. https://doi.org/10.1353/foc.2014.0003

    Article  Google Scholar 

  • Cohen, J. (1988). Statistical power analysis for the behavioral sciences. New York, NY: Routledge Academic.

    Google Scholar 

  • Connell, C. M., & Prinz, R. J. (2002). The impact of childcare and parent-child interactions on school readiness and social skills development for low-income African American children. Journal of School Psychology, 40, 177–193. https://doi.org/10.1016/S0022-4405(02)00090-0

    Article  Google Scholar 

  • Darling-Hammond, L. (2004). Standards, accountability, and school reform. Teachers College Record, 106, 1047–1085. https://doi.org/10.1111/j.1467-9620.2004.00372.x

    Article  Google Scholar 

  • Data Recognition Corporation. (2016). TerraNova, third edition K-12 assessment, instruction, and reporting solutions. Retrieved from http://www.datarecognitioncorp.com/Assessment-Solutions/Documents/TerraNova-3-Overview-Brochure-2017.pdf

  • DeNavas-Walt, C., Proctor, B. D., & Smith, J. C. (2010). Income, poverty, and health insurance coverage in the United States: 2009. U.S. Census Bureau, current population reports, P60–238. U.S. Government Printing Office.

    Google Scholar 

  • Dallas Independence School District. (2015). Dallas ISD: Destination 2020 comprehensive plan. Dallas, Texas. Retrieved from http://learningcurve.dmagazine.com/wp-content/uploads/2014/08/ProgramsAndFacilities2020.pdf

  • Evans, G. W. (2004). The environment of child poverty. American Psychologist, 59, 77–92.

    Article  Google Scholar 

  • Garcia, M. G. (2006). The impact of the Home Instruction for Parents of Preschool Youngsters (HIPPY) program on reading, mathematics, and language achievement of Hispanic English language learners. Doctoral Dissertation, University of North Texas, Texas (OCLC No. 70660456).

  • Gere, A. R., Burke, A., Gibson, G., Hammond, J., Knutson, A. V., McCarty, R. J., Parsons, C., Parsons, M., Tacke, E., & Tucker, B. (2014). How standardized tests shape—and limit—student learning: A policy research brief produced by the National Council of Teachers of English. Council Chronicle, 24, 13–15.

    Google Scholar 

  • Gershoff, E. T., Aber, J. L., Raver, C. C., & Lennon, M. C. (2007). Income is not enough: Incorporating material hardship into models of income associations with parenting and child development. Child Development, 78, 70–95. https://doi.org/10.1111/j.1467-8624.2007.00986.x

    Article  Google Scholar 

  • Gomby, D., Culross, P., & Behrman, R. (1999). Home visiting: Recent program evaluations: Analysis and recommendations. The Future of Children, 9, 4–26. https://doi.org/10.2307/1602719

    Article  Google Scholar 

  • Guo, S., & Frasher, M. W. (2010). Propensity score analysis: Statistical methods and applications. Sage Publication.

    Google Scholar 

  • Hamre, B. K., Pianta, R. C., Downer, J. T., DeCoster, J., Mashburn, A. J., Jones, S. M., & Hamagami, A. (2013). Teaching through interactions: Testing a developmental framework of teacher effectiveness in over 4000 classrooms. The Elementary School Journal, 113, 461–487. https://doi.org/10.1086/669616

    Article  Google Scholar 

  • Hinkley, S. (2018). Evaluation of the 2017–2018 home instruction for parents of preschool youngsters’ (HIPPY) program (Report No. EA 18–178-4). Dallas Independence School Districts.

    Google Scholar 

  • HIPPY USA. (n.d.). Program model and implementation overview. Retrieved from https://www.hippyusa.org/memanage/pdf/Implementing%20Home%20Instruction%20for%20Parents%20of%20Preschool%20Youngsters.pdf

  • Holmes, W. (2014). Using propensity scores in quasi-experimental designs. SAGE Publications.

    Book  Google Scholar 

  • Hull, D. M., Hinerman, K. M., Ferguson, S. L., Chen, Q., & Näslund-Hadley, E. I. (2018). Teacher-led math inquiry: A cluster randomized trial in belize. Educational Evaluation and Policy Analysis, 40, 336–358. https://doi.org/10.3102/0162373718768430

    Article  Google Scholar 

  • Huston, A., Gupta, A., & Schexnayder, D. (2012). Study of early education in Texas the relationship of pre-K attendance to 3rd grade test results. University of Texas at Austin.

    Google Scholar 

  • Jiang, Y., Ekono, M., & Skinner, C. (2015). Basic facts about low-income children: Children under 3 years, 2013. National Center for Children in Poverty.

    Google Scholar 

  • Johnson, U. Y., Martinez-Cantu, V., Jacobson, A. L., & Weir, C. (2012). The home instruction for parents of preschool youngsters program’s relationship with mother and school outcomes. Early Education and Development, 23, 713–727. https://doi.org/10.1080/10409289.2011.596002

    Article  Google Scholar 

  • Klebanov, P., & Brooks-Gunn, J. (2006). Cumulative, human capital, and psychological risk in the context of early intervention: Links with IQ at ages 3, 5, and 8. Annals of the New York Academy of Sciences, 1094, 63–82. https://doi.org/10.1196/annals.1376.007

    Article  Google Scholar 

  • Knudsen, E. I., Heckman, J. J., Cameron, J. L., & Shonkoff, J. P. (2006). Economic, neurobiological, and behavioral perspectives on building america’s future workforce. Proceedings of the National Academy of Sciences of the United States of America, 103, 10155–10162. https://doi.org/10.1073/pnas.0600888103

    Article  Google Scholar 

  • Korat, O., & Haglili, S. (2007). Maternal evaluations of children’s emergent literacy level, maternal mediation in book reading, and children’s emergent literacy level: A comparison between SES groups. Journal of Literary Research, 39, 249–276. https://doi.org/10.1080/10862960701331993

    Article  Google Scholar 

  • Lazar, I., Darlington, R., Murray, H., Royce, J., Snipper, A., & Ramey, C. T. (1982). Lasting effects of early education: A report from the consortium for longitudinal studies. Monographs of the Society for Research in Child Development. https://doi.org/10.2307/1165938

    Article  Google Scholar 

  • Leite, W. L., Aydin, B., & Gurel, S. (2018). A comparison of propensity score weighting methods for evaluating the effects of programs with multiple versions. Journal of Experimental Education, 39, 1–14. https://doi.org/10.1080/00220973.2017.1409179

    Article  Google Scholar 

  • Lowenstein, A. E., Friedman-Krauss, A. H., Raver, C. C., Jones, S. M., & Pess, R. A. (2015). School climate, teacher-child closeness, and low-income children’s academic skills in kindergarten. Journal of Educational and Developmental Psychology, 5, 89–101.

    Article  Google Scholar 

  • Mathes, P., Torgesen, J., & Herron, J. (2016). Computer adaptive testing system for continuous progress monitoring of reading growth for students pre-K through Grade 3. Istation.

    Google Scholar 

  • McEnturff, A. (2014). Evaluation of the 2016–2017 home instruction for parents of preschool youngsters’ (HIPPY) program (Report No EA 14-178-4). Dallas Independence School Districts.

    Google Scholar 

  • Muschkin, C. G., Ladd, H. F., & Dodge, K. A. (2015). Impact of North Carolina’s early childhood initiatives on special education placements in third grade. Educational Evaluation and Policy Analysis, 37, 478–500. https://doi.org/10.3102/0162373714559096

    Article  Google Scholar 

  • Palladino, D. K. (2016). Evaluation of the 2015–2016 home instruction for parents of preschool youngsters’ (HIPPY) program (Report No. EA 16-178-2). Dallas Independence School Districts.

    Google Scholar 

  • Pianta, R. C., & Hamre, B. K. (2009). Conceptualization, measurement, and improvement of classroom processes: Standardized observation can leverage capacity. Educational Researcher, 38, 109–119. https://doi.org/10.3102/0013189X09332374

    Article  Google Scholar 

  • Pianta, R. C., & Stuhlman, M. W. (2004). Teacher-child relationships and children’s success in the first years of school. School Psychology Review, 33, 444.

    Article  Google Scholar 

  • Rosenbaum, P. R. (2002). Observational studies (2nd ed.). Springer.

    Book  Google Scholar 

  • Rubin, D. B. (2001). Using propensity scores to help design observational studies: Application to the tobacco litigation. Health Services and Outcomes Research Methodology, 2, 169–188. https://doi.org/10.1023/A:1020363010465

    Article  Google Scholar 

  • Rubin, D. B. (2006). Matched sampling for causal effects. Cambridge University Press.

    Book  Google Scholar 

  • Shonkoff, J. P., & Phillips, D. A. (2000). From neurons to neighborhoods: The science of early childhood development. National Academy Press.

    Google Scholar 

  • Steiner, P. M., Cook, T. D., Shadish, W. R., & Clark, M. H. (2010). The importance of covariate selection in controlling for selection bias in observational studies. Psychological Methods, 15, 250–267. https://doi.org/10.1037/a0018719

    Article  Google Scholar 

  • Stuart, E. A. (2010). Matching methods for causal inference: A review and a look forward. Statistical Science, 25, 1–21. https://doi.org/10.1214/09-STS313

    Article  Google Scholar 

  • Stuart, E. A., & Green, K. M. (2008). Using full matching to estimate causal effects in non-experimental studies: Examining the relationship between adolescent marijuana use and adult outcomes. Developmental Psychology, 44, 395–406. https://doi.org/10.1037/0012-1649.44.2.395

    Article  Google Scholar 

  • Texas Education Agency. (2016). Independent evaluation of the validity and reliability of STAAR grades 3–8 assessment scores. Retrieved from https://tea.texas.gov/student.assessment/reports/

  • Turner, H., & Hinkley, S. (2017). Evaluation of the 2016–2017 home instruction for parents of preschool youngsters’ (HIPPY) Program (Report No. EA 17-178-4). Dallas Independence School Districts.

    Google Scholar 

  • U.S. Department of Health and Human Services. (2010). Head Start impact study (Final report). Retrieved from: https://www.acf.hhs.gov/sites/default/files/opre/executive_summary_final_508.pdf

  • Wang, Y., Cai, H., Li, C., Jiang, Z., Wang, L., Song, J., & Xia, J. (2013). Optimal caliper width for propensity score matching of three treatment groups: A monte Carlo Study. PLoS ONE. https://doi.org/10.1371/journal.pone.0081045

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Educational Psychology, University of North Texas, Plano, TX, USA

    Noor Amal Abdulaziz

Authors
  1. Noor Amal Abdulaziz
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Noor Amal Abdulaziz.

Ethics declarations

Conflict of interest

The author declare that he have no conflict of interest to disclose.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Abdulaziz, N.A. The Impact of Texas HIPPY on School Readiness and Academic Achievement: Optimal Full Propensity Score Analysis Approach. Early Childhood Educ J 50, 925–935 (2022). https://doi.org/10.1007/s10643-021-01226-w

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10643-021-01226-w

Keywords

Search

Navigation