Abstract
Children living with HIV (HIV+) experience increased risk of neurocognitive deficits, but standardized cognitive testing is limited in low-resource, high-prevalence settings. The Penn Computerized Neurocognitive Battery (PennCNB) was adapted for use in Botswana. This study evaluated the criterion validity of a locally adapted version of the PennCNB among a cohort of HIV+ individuals aged 10–17 years in Botswana. Participants completed the PennCNB and a comprehensive professional consensus assessment consisting of pencil-and-paper psychological assessments, clinical interview, and review of academic performance. Seventy-two participants were classified as cases (i.e., with cognitive impairment; N = 48) or controls (i.e., without cognitive impairment; N = 24). Sensitivity, specificity, positive predictive value, negative predictive value, and the area under receiver operating characteristic curves were calculated. Discrimination was acceptable, and prediction improved as the threshold for PennCNB impairment was less conservative. This research contributes to the validation of the PennCNB for use among children affected by HIV in Botswana.
Similar content being viewed by others
Availability of Data and Material
All data support published conclusions.
References
UNAIDS. UNAIDS Data 2020. Geneva; 2020.
World Health Organization. Botswana HIV Country Profile: 2016. https://www.who.int/hiv/data/Country_profile_Botswana.pdf?ua=1. Accessed 2021.
Farahani M, Vable A, Lebelonyane R, Seipone K, Anderson M, Avalos A, et al. Outcomes of the Botswana national HIV/AIDS treatment programme from 2002 to 2010: a longitudinal analysis. Lancet Glob Health. 2014;2(1):e44-50.
Le Doare KBR, Newell ML. Neurodevelopment in children born to HIV-infected mothers by infection and treatment status. Pediatrics. 2012;130:e1326–44.
Smith R, Chernoff M, Williams PL, Malee KM, Sirois PA, Kammerer B, et al. Impact of HIV severity on cognitive and adaptive functioning during childhood and adolescence. Pediatr Infect Dis J. 2012;31(6):592–8.
Ruel TD, Boivin MJ, Boal HE, Bangirana P, Charlebois E, Havlir DV, et al. Neurocognitive and motor deficits in HIV-infected Ugandan children with high CD4 cell counts. Clin Infect Dis. 2012;54(7):1001–9.
Phillips N, Amos T, Kuo C, Hoare J, Ipser J, Thomas KG, et al. HIV-associated cognitive impairment in perinatally infected children: a meta-analysis. Pediatrics. 2016;138(5):e20160893.
Wedderburn CJ, Evans C, Yeung S, Gibb DM, Donald KA, Prendergast AJ. Growth and neurodevelopment of HIV-exposed uninfected children: a conceptual framework. Curr HIV/AIDS Rep. 2019;16(6):501–13.
Churchill M, Nath A. Where does HIV hide? A focus on the central nervous system. Curr Opin HIV AIDS. 2013;8(3):165–9.
Blokhuis C, Kootstra N, Caan M, Pajkrt D. Neurodevelopmental delay in pediatric HIV/AIDS: current perspectives. Neurobehav HIV Med. 2016;7:1–13.
Crowell CS, Malee KM, Yogev R, Muller WJ. Neurologic disease in HIV-infected children and the impact of combination antiretroviral therapy. Rev Med Virol. 2014;24(5):316–31.
Burns S, Hernandez-Reif M, Jessee P. A review of pediatric HIV effects on neurocognitive development. Issues Compr Pediatr Nurs. 2008;31(3):107–21.
Behen ME, Helder E, Rothermel R, Solomon K, Chugani HT. Incidence of specific absolute neurocognitive impairment in globally intact children with histories of early severe deprivation. Child Neuropsychol. 2008;14(5):453–69.
Lazarus JR, Rutstein RM, Lowenthal ED. Treatment initiation factors and cognitive outcome in youth with perinatally acquired HIV infection. HIV Med. 2015;16(6):355–61.
Linn K, Fay A, Meddles K, Isbell S, Lin PN, Thair C, et al. HIV-related cognitive impairment of orphans in Myanmar with vertically transmitted HIV taking antiretroviral therapy. Pediatr Neurol. 2015;53(6):485–90.
Scott JC, Van Pelt AE, Port AM, Njokweni L, Gur RC, Moore TM, et al. Development of a computerised neurocognitive battery for children and adolescents with HIV in Botswana: study design and protocol for the Ntemoga study. BMJ Open. 2020;10(8):e041099.
Gur RCER, Gur RE. Neurobehavioral probes for physiologic neuroimaging studies. Arch Gen Psychiatry. 1992;49:409–14.
Roalf DR, Gur RE, Ruparel K, Calkins ME, Satterthwaite TD, Bilker WB, et al. Within-individual variability in neurocognitive performance: age- and sex-related differences in children and youths from ages 8 to 21. Neuropsychology. 2014;28(4):506–18.
Moore TMRS, Gur RE, Hakonarson H, Gur RC. Psychometric properties of the penn computerized neurocognitive battery. Neuropsychology. 2015;29:235–46.
Gur RC, Richard J, Hughett P, Calkins ME, Macy L, Bilker WB, et al. A cognitive neuroscience-based computerized battery for efficient measurement of individual differences: standardization and initial construct validation. J Neurosci Methods. 2010;187(2):254–62.
Cohen S, Ter Stege JA, Geurtsen GJ, Scherpbier HJ, Kuijpers TW, Reiss P, et al. Poorer cognitive performance in perinatally HIV-infected children versus healthy socioeconomically matched controls. Clin Infect Dis. 2015;60(7):1111–9.
van Widenfelt BM, Treffers PD, de Beurs E, Siebelink BM, Koudijs E. Translation and cross-cultural adaptation of assessment instruments used in psychological research with children and families. Clin Child Fam Psychol Rev. 2005;8(2):135–47.
Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol. 1993;46(12):1417–32.
Gur RC, Richard J, Calkins ME, Chiavacci R, Hansen JA, Bilker WB, et al. Age group and sex differences in performance on a computerized neurocognitive battery in children age 8–21. Neuropsychology. 2012;26(2):251–65.
Hartung EA, Kim JY, Laney N, Hooper SR, Radcliffe J, Port AM, et al. Evaluation of neurocognition in youth with CKD using a novel computerized neurocognitive battery. Clin J Am Soc Nephrol. 2016;11(1):39–46.
Swagerman SC, de Geus EJC, Kan KJ, van Bergen E, Nieuwboer HA, Koenis MMG, et al. The computerized neurocognitive battery: validation, aging effects, and heritability across cognitive domains. Neuropsychology. 2016;30(1):53–64.
Van Pelt AE, Cobb SJ, Morales K, Matshaba M, Gur RC, Tshume O, Thuto B, Lowenthal ED, Moore TM. Structural validity of a computerized neurocognitive battery for youth living with Human Immunodeficiency Virus in Botswana. Psychol Assess. 2021;34:139–46.
Nasreddine ZS, Phillips NA, Bedirian V, Charbonneau S, Whitehead V, Collin I, et al. The montreal cognitive assessment, MoCA: a brief screening tool for mild cognitive impairment. J Am Geriatr Soc. 2005;53(4):695–9.
Naglieri JA. DAP, Draw a person: a quantitative scoring system. San Antonio: Psychological Corporation; 1988.
Botswana S. Education statistics report 2014. 2019.
Strauss E, Sherman EMS, Spreen O. A compendium of neuropsychological tests: administration, norms, and commentary. Oxford: Oxford University Press; 2006.
Zou KH, O’Malley AJ, Mauri L. Receiver-operating characteristic analysis for evaluating diagnostic tests and predictive models. Circulation. 2007;115(5):654–7.
Ghanem E, Antoci V Jr, Pulido L, Joshi A, Hozack W, Parvizi J. The use of receiver operating characteristics analysis in determining erythrocyte sedimentation rate and C-reactive protein levels in diagnosing periprosthetic infection prior to revision total hip arthroplasty. Int J Infect Dis. 2009;13(6):e444–9.
Kumar R, Indrayan A. Receiver operating characteristic (ROC) curve for medical researchers. Indian Pediatr. 2011;48(4):277–87.
Lemeshow DHS. Applied logistic regression. 2nd ed. New York: Wiley; 2000.
Olashore AA, Paruk S, Akanni O, Tomita A, Chiliza B. Psychiatric disorders in adolescents living with HIV and association with antiretroviral therapy adherence in Sub-Saharan Africa: a systematic review and meta-analysis. AIDS Behav. 2021;25:1711–28.
Parikh R, Mathai A, Parikh S, Chandra Sekhar G, Thomas R. Understanding and using sensitivity, specificity and predictive values. Indian J Ophthalmol. 2008;56(1):45–50.
Acknowledgements
This research was supported by the National Institute of Child Health and Human Development (F31 HD101346 and R01 HD095278). This publication was made possible in part through core services and support from the Penn Center for AIDS Research (CFAR), an NIH-funded (P30 045088) program and the Penn Mental Health AIDS Research Center (PMHARC; P30 MH097488). TMM is supported by NIMH R01 MH117014 and by the Lifespan Brain Institute (LiBI) of Penn Medicine and CHOP.
Funding
This work was funded by the National Institute of Child Health and Human Development (F31 HD101346; R01 HD095278). This publication was made possible in part through core services and support from the Penn Center for AIDS Research (CFAR), an NIH-funded (P30 045088) program, and the Penn Mental Health AIDS Research Center (PMHARC; P30 MH097488).
Author information
Authors and Affiliations
Contributions
A.E.V.P., E.D.L., and M.M. contributed to the concept and design of the research. A.E.V.P., J.C.S., and E.D.L. obtained funding. A.E.V.P. designed the study protocol. O.P. collected data. J.C.S., O.P., L.M., S.R., and E.D.L. contributed to the professional consensus discussion. A.E.V.P. analyzed data. T.M.M., K.H.M., and E.D.L. provided supervision. A.E.V.P. drafted the manuscript. All authors provided critical revision of content and have read and approved the final manuscript.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Consent for Publication
N/A.
Ethical Approval
All procedures were approved by the Institutional Review Boards at the Health Research and Development Committee within the Ministry of Health and Wellness of Botswana, the Botswana-Baylor Children’s Clinical Centre of Excellence (CoE), and the University of Pennsylvania.
Informed Consent
Informed consent was obtained from all individual participants included in the study.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Van Pelt, A.E., Moore, T.M., Scott, J.C. et al. Predictive Validity of a Computerized Battery for Identifying Neurocognitive Impairments Among Children Living with HIV in Botswana. AIDS Behav 26, 2758–2767 (2022). https://doi.org/10.1007/s10461-022-03620-w
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10461-022-03620-w