Abstract
When considering the best available treatment, it is crucial that assessments yield valid and reliable measures to produce effective treatment options. Currently, this research is limited, giving behavior analysis a platform to evaluate the psychometric properties and content validity of assessment tools used across settings. One major issue that practicing behavior analysts face is conducting the most comprehensive assessment within the time constraints put in place by insurance companies. Utilizing a method of assessment that includes indirect and direct descriptive methods and experimental manipulations could aid in cutting down assessment time, especially if those methods have known correspondence with each other. The purpose of the present study was to assess the components of the Promoting the Emergence of Advanced Knowledge Relational Training System: Direct Training Module (PEAK-DT) for children with autism. More specifically, this study evaluated the correspondence between the PEAK indirect assessment (PEAK-IA) and PEAK preassessment (PEAK-PA) for the Direct Training Module. Comparisons were also made to determine which method offers the best predictive validity of actual performance on the PEAK-DT module. Results indicate that PEAK-IA completed by parents and PEAK-PA share moderate correspondence, with the PEAK-PA offering the strongest predictive validity of direct testing outcomes. Implications for behavior-analytic practice, as well as directions for future research, are discussed.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Ackley, M., Subramanian, J. W., Moore, J. W., Litten, S., Lundy, M. P., & Bishop, S. K. (2019). A review of language development protocols for individuals with autism. Journal of Behavior Education. https://doi.org/10.1007/s10864-01909327-8.
Baer, D. M., Wolf, M. M., & Risley, T. R. (1968). Some current dimensions of applied behavior analysis. Journal of Applied Behavior Analysis, 1, 91–97. https://doi.org/10.1901/jaba.1968.1-91.
Behavior Analyst Certification Board. (2014a). Professional and ethical compliance code for behavior analysts. Retrieved from https://bacb.com/wp-content/uploads/170706-compliance-code-english.pdf
Behavior Analyst Certification Board. (2014b). Applied behavior analysis treatment of autism spectrum disorder: Practice guidelines for healthcare funders and managers. Retrieved from https://www.bacb.com/wp-content/uploads/2017/09/ABA_Guidelines_for_ASD.pdf
Centers for Disease Control and Prevention. (2008). Prevalence of autism spectrum disorders—Autism and Developmental Disabilities Monitoring Network, 14 sites, United States, 2008. MMWR Surveillance Summary, 61, 1–19.
Cooper, J. O., Heron, T. E., & Heward, W. L. (2007). Applied behavior analysis (2nd ed.). Upper Saddle River, NJ: Pearson Prentice-Hall.
Daniels, A. M., & Mandell, D. S. (2014). Explaining differences in age at autism spectrum disorder diagnosis: A critical review. Autism, 18(5), 583–597. https://doi.org/10.1177/1362361313480277.
Dixon, M. R. (2014a). The PEAK relational training system: Direct training module. Carbondale, IL: Shawnee Scientific Press.
Dixon, M. R. (2014b). The PEAK relational training system: Generalization module. Carbondale, IL: Shawnee Scientific Press.
Dixon, M. R. (2015). The PEAK relational training system: Equivalence module. Carbondale, IL: Shawnee Scientific Press.
Dixon, M. R. (2016). The PEAK relational training system: Transformation module. Carbondale, IL: Shawnee Scientific Press.
Dixon, M. R., Belisle, J., McKeel, A., Whiting, S., Speelman, R., Daar, J. H., & Rowsey, K. (2017). An internal and critical review of the PEAK Relational Training System for children with autism and related intellectual disabilities: 2014–2017. The Behavior Analyst, 40(2), 493–521. https://doi.org/10.1007/s40614-017-0119-4.
Dixon, M. R., Belisle, J., Stanley, C., Rowsey, K., Daar, J. H., & Szekely, S. (2015). Toward a behavior analysis of complex language for children with autism: Evaluating the relationship between PEAK and the VB-MAPP. Journal of Developmental and Physical Disabilities, 27, 223–233. https://doi.org/10.1007/s10882-014-9410-4.
Dixon, M. R., Belisle, J., Whiting, S. W., & Rowsey, K. E. (2014). Normative sample of the PEAK Relational Training System: Direct Training Module and subsequent comparisons to individuals with autism. Research in Autism Spectrum Disorders, 8(11), 1597–1606. https://doi.org/10.1016/j.rasd.2014.07.020.
Dixon, M. R., Carman, J., Tyler, P. A., Whiting, S. W., Enoch, M. R., & Daar, J. H. (2014). PEAK Relational Training System for children with autism and developmental disabilities: Correlations with Peabody Picture Vocabulary Test and assessment reliability. Journal of Developmental and Physical Disabilities, 26, 603–614. https://doi.org/10.1007/s10882-014-9384-2.
Dixon, M. R., Stanley, C., Belisle, J., & Rowsey, K. E. (2016). The test-retest and interrater reliability of the Promoting the Emergence of Advanced Knowledge–Direct Training assessment for use with individuals with autism and related disabilities. Behavior Analysis: Research and Practice, 16, 34–40. https://doi.org/10.1037/bar0000027.
Dixon, M. R., Whiting, S. W., Rowsey, K., & Belisle, J. (2014). Assessing the relationship between intelligence and the PEAK Relational Training System. Research in Autism Spectrum Disorders, 8(9), 1208–1213. https://doi.org/10.1016/j.rasd.2014.05.005.
Doggett, R. A., Edwards, R. P., Moore, J. W., Tingstrom, D. H., & Wilczynski, S. M. (2001). An approach to functional assessment in general education classroom settings. School Psychology Review, 30, 313–328.
Dufrene, B. A., Doggett, R. A., Henington, C., & Watson, T. S. (2007). Functional assessment and intervention for disruptive classroom behaviors in preschool and Head Start classrooms. Journal of Behavioral Education, 16(4), 368–388.
Dufrene, B. A., Parker, K., Menousek, K., Zhou, Q., Harpole, L. L., & Olmi, D. J. (2012). Direct behavioral consultation in Head Start to increase teacher use of praise and effective instruction delivery. Journal of Educational and Psychological Consultation, 22(3), 159–186. https://doi.org/10.1080/10474412.
Floyd, R. G., Phaneuf, R. L., & Wilczynski, S. M. (2005). Behavioral assessment: A review of research. School Psychology Review, 34, 58–73.
Gould, E., Dixon, D. R., Najdowski, A. C., Smith, M. N., & Tarbox, J. (2011). A review of assessments for determining the content of early intensive behavioral intervention programs for autism spectrum disorders. Research in Autism Spectrum Disorders, 5(3), 990–1002. https://doi.org/10.1016/j.rasd.2011.01.012.
Hanley, G. P. (2012). Functional assessment of problem behavior: Dispelling myths, overcoming implementation obstacles, and developing new lore. Behavior Analysis in Practice, 5, 54–72. https://doi.org/10.1007/FBF03391818.
LeGray, M. W., Dufrene, B. A., Sterling-Turner, H., Olmi, D. J., & Bellone, K. (2010). A comparison of function-based differential reinforcement interventions for children engaging in disruptive classroom behavior. Journal of Behavioral Education, 19(3), 185–204. https://doi.org/10.1007/s10864-010-9109-2.
National Institutes of Health. (2017). What does it mean for something to be evidence-based? Retrieved from https://prevention.nih.gov/resources-for-researchers/dissemination-and-implementation-resources/evidence-based-programs-practices
Roane, H. S., Fisher, W. W., & Carr, J. E. (2016). Applied behavior analysis as treatment for autism spectrum disorder. Journal of Pediatrics, 175, 27–32. https://doi.org/10.1016/j.jpeds.2016.04.023.
Rowsey, K. E., Belisle, J., & Dixon, M. R. (2015). Principal component analysis of the PEAK Relational Training System. Journal of Developmental and Physical Disabilities, 27, 15–23. https://doi.org/10.1007/s10882-014-9398-9.
Skinner, B. F. (1957). Verbal behavior. Englewood Cliffs, NJ: Prentice-Hall.
Smith, T. (2013). What is evidence-based behavior analysis? The Behavior Analyst, 36, 7–33. https://doi.org/10.1007/bf03392290.
Smith, T., & Iadarola, S. (2015). Evidence base update for autism spectrum disorder. Journal of Clinical Child & Adolescent Psychology, 44, 897–922. https://doi.org/10.1080/15374416.2015.1077448.
Sundberg, M. L. (2008). VB-MAPP: Verbal behavior milestones assessment and placement program. Concord, CA: AVB Press.
Thompson, R. H., & Iwata, B. A. (2007). A comparison of outcomes from descriptive and functional analyses of problem behavior. Journal of Applied Behavior Analysis, 40, 333–338. https://doi.org/10.1901/jaba.2007.56-06.
Author Note
Portions of the study came from the master’s project of the first author for partial completion of the requirements for the master’s of science degree.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
No author benefitted financially from participating in this research.
Ethical Approval
Procedures were in accordance with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. All procedures were in accordance with the ethical standards of the Behavior Analyst Certification Board.
Informed Consent
Informed consent was obtained from all individual participants included in this study.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Moore, J.W., Rizer, H.B., Warren, L.K. et al. An Initial Evaluation of an Assessment Method for the PEAK Relational System Direct Training Module. Behav Analysis Practice 13, 126–136 (2020). https://doi.org/10.1007/s40617-019-00387-w
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40617-019-00387-w