Abstract
We report the results of a social validity assessment that was administered to special education service providers (N = 44) to document the acceptability and effectiveness ratings of several treatment integrity training methods. The participants judged performance feedback as the most likely method to improve their treatment integrity, followed by avoidance (negative reinforcement) of supervision meetings, online training, and financial incentive. Performance feedback was also rank-ordered as most effective among the four training methods. We discuss the merits of social validity assessment in designing programs for enhancing treatment integrity among practitioners within educational and clinical settings.
This is a preview of subscription content, log in via an institution to check access.
References
Codding, R. S., Feinberg, A. B., Dunn, E. K., & Pace, G. M. (2005). Effects of immediate performance feedback on implementation of behavior support plans. Journal of Applied Behavior Analysis, 38, 205–219.
DiGennaro Reed, F. D., & Codding, R. S. (2011). Intervention integrity assessment. In J. K. Luiselli (Ed.), Teaching and behavior support for children and adults with autism spectrum disorder: a practitioner’s guide (pp. 38–47). New York: Oxford University Press.
DiGennaro Reed, F. D., Hirst, J. M., & Howard, V. J. (2013). Empirically supported staff selection, training, and management strategies. In D. D. Reed, F. D. DiGennaro Reed, & J. K. Luiselli (Eds.), Handbook of crisis intervention and developmental disabilities (pp. 71–85). New York: Springer.
DiGennaro, F. D., Martens, B. K., & McIntyre, L. L. (2005). Increasing treatment integrity through negative reinforcement: effects of teacher and student behavior. School Psychology Review, 34, 220–231.
DiGennaro, F. D., Martens, B. K., & Kleinmann, A. E. (2007). A comparison of performance feedback procedures on teachers’ treatment implementation integrity and students’ inappropriate behavior in special education classrooms. Journal of Applied Behavior Analysis, 40, 447–461.
Fiske, K. E. (2008). Treatment integrity of school-based behavior analytic interventions: a review of the research. Behavior Analysis In Practice, 1, 19–25.
Kazdin, A. E. (1977). Assessing the clinical or applied importance of behavior change through social validation. Behavior Modification, 1, 427–452.
Luiselli, J. K. (2013). Peer review. In D. D. Reed, F. D. DiGennaro Reed, & J. K. Luiselli (Eds.), Handbook of crisis intervention and developmental disabilities (pp. 27–48). New York: Springer.
McIntyre, L. L., Gresham, F. M., DiGennaro, F. D., & Reed, D. D. (2007). Treatment integrity of school-based interventions with children in the Journal of Applied Behavior Analysis 1991–2005. Journal of Applied Behavior Analysis, 40, 659–672.
Noell, G. H., Witt, J. C., LaFleur, L. H., Mortenson, B. P., Ranier, D. D., & LeVelle, J. (2000). Increasing intervention implementation in general education following consultation: a comparison of two follow-up strategies. Journal of Applied Behavior Analysis, 33, 271–284.
Noell, G. H., Gresham, F. M., & Gansle, K. A. (2002). Does treatment integrity matter? A preliminary investigation of instructional implementation and mathematics performance. Journal of Behavioral Education, 11, 51–67.
Noell, G. H., Witt, J. C., Slider, N. J., Connell, J. E., Gatti, S. L., Williams, K. L., & Duhon, G. J. (2005). Treatment implementation following behavioral consultation in schools: a comparison of three follow-up strategies. School Psychology Review, 34, 87–106.
Reid, D. H. (2004). Training and supervising direct support personnel to carry out behavioral procedures. In J. L. Matson, R. B. Laud, & M. L. Matson (Eds.), Behavior modification for persons with developmental disabilities: Treatments and supports (pp. 73–97). Kingston, NY: NADD Press.
Reid, D. H., & Parsons, M. B. (1995). Motivating human services staff: supervisory strategies for maximizing work effort and work enjoyment. Morganton, NC: Habilitative Management Consultants Inc.
Ricciardi, J. N. (2005). Achieving human services outcomes through competency based training: a guide for practitioners. Behavior Modification, 29, 488–507.
Solomon, B. G., Klein, S. A., & Politylo, B. C. (2012). The effect of performance feedback on teachers’ treatment integrity: a meta-analysis of the single-case literature. School Psychology Review, 41, 160–175.
Wilder, D. A., Atwell, J., & Wine, B. (2006). The effects of varying levels of treatment integrity on child compliance during a three-step prompting procedure. Journal of Applied Behavior Analysis, 39, 369–373.
Wolf, M. M. (1978). Social validity: the case for subjective measurement of how applied behavior analysis is finding its heart. Journal of Applied Behavior Analysis, 11, 203–214.
Acknowledgments
This study was conducted at the May Center School for Autism and Developmental Disabilities, Randolph, MA. Craig Strohmeier is currently affiliated with the Kennedy Krieger Institute, Baltimore, MD; Christina Mulé is currently affiliated with Tufts University Medical Center, Boston, MA.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Strohmeier, C., Mulé, C. & Luiselli, J.K. Social Validity Assessment of Training Methods to Improve Treatment Integrity of Special Education Service Providers. Behav Analysis Practice 7, 15–20 (2014). https://doi.org/10.1007/s40617-014-0004-5
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40617-014-0004-5