Abstract
Clinical practice guidelines (CPG) provide a framework for evidence-based practice; however, few studies have assessed the methodological quality of CPGs relevant to child and youth mental health. This study was a systematic review of CPGs for the assessment, prevention and treatment of disruptive behavior, including attention-deficit hyperactivity disorder (ADHD), oppositional defiant disorder (ODD), conduct disorder (CD) and aggression in children and youth. Systematic review identified 29 CPGs meeting inclusion criteria that were appraised using the Appraisal of Guidelines for Research and Evaluation II (AGREE II) validated tool. Twenty-two guidelines addressed ADHD, 2 CD, 1 ODD, 2 for Behavior Disorders collectively and 2 for Aggression. Among the 29 guidelines, two that were developed for ADHD (NICE 2013a; Spanish Ministry of Health, 2010) and one practice guideline developed for CD (NICE 2013b) met high quality criteria; one guideline for behavior disorders (Gorman et al. 2015), two for ADHD (AAP 2011a, b; SIGN 2009a, b, c, d, e), and two for aggression (Knapp et al. 2012; Scotto Rosato et al. 2012a, b) met minimum quality criteria. Findings from this review provide important information for clinicians and organizations who want to utilize guidelines to implement best-practice clinical services for children and youth with disruptive behavior.
Similar content being viewed by others
References
Acosta, M. T., Castellanos, F. X., Bolton, K. L., Balog, J. Z., Eagen, P., Lee, N., … Muenke, M. (2008). Latent class subtyping of attention-deficit/hyperactivity disorder and comorbid conditions. Journal of the American Academy of Child and Adolescent Psychiatry, 47(7), 797–807.
AGREE Next Steps Consortium. (2013). AGREE-II user’s manual. Retrieved from http://www.agreetrust.org.
AHRQ. US Agency for Healthcare Research and Quality.
American Academy of Pediatrics (AAP). (2011a). ADHD: Clinical practice guideline for the diagnosis, evaluation, and treatment of attention-deficit/hyperactivity disorder in children and adolescents. Pediatrics. https://doi.org/10.1542/peds.2011-2654.
American Academy of Pediatrics (AAP). (2011b). Implementing the key action statements: An algorithm and explanation for process of care for the evaluation, diagnosis, treatment, and monitoring of ADHD in children and adolescents. Pediatrics, 128(5), SI1–SI21.
Bennett, K., Duda, S., Brouwers, M., Szatmari, P., Newton, A., … Rice, M. (2018). Towards high-quality, useful practice guidelines for child and youth mental health disorders: Protocol for a systematic review and consensus exercise. British Medical Journal Open. https://doi.org/10.1136/bmjopen-2017-018053.
Bennett, K., Gorman, D. A., Duda, S., Brouwers, M., & Szatmari, P. (2016). Practitioner review: On the trustworthiness of clinical practice guidelines—A systematic review of the quality of methods used to develop guidelines in child and youth mental health. Journal of Child Psychology and Psychiatry, 57(6), 662–673.
Bezdjian, S., Krueger, R. F., Derringer, J., Malone, S., McGue, M., & Iacono, W. G. (2011). The structure of DSM-IV ADHD, ODD, and CD criteria in adolescent boys: A hierarchical approach. Psychiatry Research, 188, 411–421.
Biederman, J., Newcorn, J., & Sprich, S. (1991). Comorbidity of attention deficit hyperactivity disorder with conduct, depressive, anxiety, and other disorders. The American Journal of Psychiatry, 148(5), 564–577.
Bolea-Alamañac, B., Nutt, D. J., Adamou, M., Asherson, P., Bazire, S., Coghill, D., … Young, S. J. (2014). Evidence-based guidelines for the pharmacological management of attention deficit hyperactivity disorder: Update on recommendations from the British Association for Psychopharmacology. Journal of Psychopharmacology, 28(3), 179–203. https://doi.org/10.1177/0269881113519509.
Brouwers, M. C., Kho, M. E., Browman, G. P., Burgers, J. S., Cluzeau, F., Feder, G., & Consortium, A. N. S (2010a). Agree-II: Advancing guideline development, reporting and evaluation in health care. Canadian Medical Association Journal, 182, 839–842.
Brouwers, M. C., Kho, M. E., Browman, G. P., Burgers, J. S., Cluzeau, F., Feder, G., & Consortium, A. N. S (2010b). Development of AGREE-II, part 1: Performance, usefulness and areas for improvement. Canadian Medical Association Journal, 182, 1045–1052.
Brouwers, M. C., Kho, M. E., Browman, G. P., Burgers, J. S., Cluzeau, F., Feder, G., & Consortium, A. N. S (2010c). Development of the AGREE-II, part 2: Assessment of validity of items and tools to support application. Canadian Medical Association Journal, 182, 472–478.
Burke, J. D., Loeber, R., & Birmaher, B. (2002). Oppositional defiant disorder and conduct disorder: A review of the past 10 years, Part II. Journal of the American Academy of Child and Adolescent Psychiatry, 41(11), 1275–1293.
Canadian Agency for Drugs and Technologies in Health. (2013). CADTH Peer review checklist for search strategies. Retrieved from https://www.cadth.ca/resources/finding-evidence/cadth-peer-review-checklist-search-strategies.
Canadian Agency for Drugs and Technologies in Health. (2014). CADTH’s database search filters. Retrieved from https://www.cadth.ca/resources/finding-evidence/strings-attached-cadths-database-search-filters.
Canadian Attention Deficit Hyperactivity Disorder Resource Alliance (CADDRA). (2011). Canadian ADHD practice guidelines (3rd ed.). Toronto: CADDRA.
Castro, J., & Brown, J. L. (2011). Attention-deficit/hyperactivity disorder (ADHD) in children and adolescents. AR: Arkansas Department of Human Services. https://studylib.net/doc/6755909/adhd---uams-psychiatric-research-institute.
Charach, A., Dashti, B., Carson, P., Booker, L., Lim, C. G., Lillie, E., … Schachar, R. (2011). Attention deficit hyperactivity disorder: Effectiveness of treatment in at-risk preschoolers; long-term effectiveness in all ages; and variability in prevalence, diagnosis, and treatment. In Comparative Effectiveness Reviews, No. 44.
Chorpita, B. F., Rotheram-Borus, M. J., Daleiden, E. L., Bernstein, A., Cromley, T., Swendeman, D., & Regan, J. (2011). The old solutions are the new problem: How do we better use what we already know about reducing the burden of mental illness? Perspectives on Psychological Science, 6(5), 493–497.
Clinical practice guidelines in the Spanish NHS. (2010). Clinical practice guideline on attention deficit hyperactivity disorder (ADHD) in children and adolescents: Quality plan for the national health system of the Ministry of Health, Social Policy and Equality. Catalonia: Agència dinformació Avaluació i Qualitat (AIAQS).
Clinical practice guidelines in the Spanish NHS Ministry of Health and social policies. Version: 2010. Ministry of Science and Innovation. http://www.guiasalud.es/GPC/GPC_477_TDAH_AIAQS_compl_en.pdf.
Copeland, W. E., Shanahan, L., Costello, E., & Angold, A. (2009). Childhood and adolescent psychiatric disorders as predictors of young adult disorders. Archives of General Psychaitry, 66(7), 764–772
Cortese, S., et al. (2013a). Practitioner review: Current best practice in the management of adverse events during treatment with ADHD medications in children and adolescents. Journal of Child Psychology and Psychiatry, 54(3), 227–246.
Cortese, S., et al. (2013b). Assessment and management of sleep problems in youths with attention-deficit/hyperactivity disorder. Journal of the American Academy of Child & Adolescent Psychiatry, 52(8), 784–796.
Courtney, D., Duda, S., Szatmari, P., Henderson, J., & Bennett, K. (2018). Systematic review and quality appraisal of practice guidelines for self-harm in children and adolescents. Suicide & Life-threatening behavior. https://doi.org/10.1111/sltb.12466.
Epstein, J. N., Langerg, J. M., Lichstenstein, P. K., Mainwaring, B. A., Luzader, C. P., & Stark, L. J. (2008). Community-wide intervention to improve the attention-deficit/hyperactivity disorder assessment and treatment practices of community physicians. Pediatrics. https://doi.org/10.1542/peds.2007-2704.
Fleiss, J. L., & Cohen, J. (1973). The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educational and Psychological Measurement, 33(3), 613–619. https://doi.org/10.1177/001316447303300309.
Foster, E. M., Jones, D. E., Bierman, K. L., Coie, J. D., & Group, T. C. P. P. R (2005). The high costs of aggression: Public expenditures resulting from conduct disorder. American Journal of Public Health, 95, 1767–1772.
Fung, D. S., Lim, C. G., Wong, J. C., Ng, K. H., Cheok, C. C., Kiing, J. S., … Low, C. (2014). Academy of Medicine-Ministry of Health clinical practice guidelines: Attention deficit hyperactivity disorder. Singapore Medical Journal, 55(8), 411–414 (quiz 415).
Gathright, M. M., & Tyler, L. H. (2014). Disruptive behaviors in children and adolescents. Little Rock: University of Arkansas for Medical Services. Retrieved from http://psychiatry.uams.edu/files/2015/02/disruptive.pdf.
Girlanda, F., et al. (2017). The evidence-practice gap in specialist mental healthcare: Systematic review and meta-analysis of guideline implementation studies. British Journal of Psychiatry, 210(1), 24–30.
Gorman, D. A., Gardner, D. M., Murphy, A. L., Feldman, M., Belanger, S. A., Steele, M. M., … Pringsheim, T. (2015). Canadian guidelines on pharmacotherapy for disruptive and aggressive behaviour in children and adolescents with attention-deficit hyperactivity disorder, oppositional defiant disorder, or conduct disorder. Canadian Journal of Psychiatry - Revue Canadienne de Psychiatrie, 60(2), 62–76.
Graham, J., Banaschewski, T., Buitelaar, J., Coghill, D., Danckaerts, M., Dittmann, R. W., … Taylor, E. (2011). European guidelines on managing adverse effects of medication for ADHD. European Child & Adolescent Psychiatry, 20(1), 17–37. https://doi.org/10.1007/s00787-010-0140-6.
Grimshaw, J. M., Eccles, M. P., Lavis, J. N., Hill, S. J., & Squires, J. E. (2012). Knowledge translation of research findings. Implementation Science. https://doi.org/10.1186/1748-5908-7-50.
Hamilton, R., Gray, C., Bélanger, S. A., Warren, A. E., Gow, R. M., Sanatani, S., … Schachar, R. (2009). Cardiac risk assessment before the use of stimulant medications in children and youth: A joint position statement by the Canadian Paediatric Society, the Canadian Cardiovascular Society and the Canadian Academy of Child and Adolescent Psychiatry. Journal of the Canadian Academy of Child and Adolescent Psychiatry, 18(4), 349–355.
Institute of Medicine (US) Committee on Standards for Developing Trustworthy Clinical Practice Guidelines. (2011). Clinical Practice Guidelines We Can Trust. Washington (DC): National Academies Press (US).
Kazdin, A. E. (2011). Evidence-based treatment research: Advances, limitations, and next steps. American Psychologist, 66, 685–698.
Knapp, P., Chait, A., Pappadopulos, E., Crystal, S., & Jensen, P. S. (2012). Treatment of maladaptive aggression in youth: CERT guidelines I. Engagement, assessment, and management. Pediatrics, 129(6), e1562–e1576. https://doi.org/10.1542/peds.2010-1360.
Knapp, P., Chait, A., Pappadopulos, E., Crystal, S., Jensen, P. S., & Group, T.-M. S. (2012). Treatment of maladaptive aggression in youth: CERT guidelines I. Engagement, assessment, and management. Pediatrics. https://doi.org/10.1542/peds.2010-1360.
Leadbeater, B. J., & Ames, M. E. (2017). The longitudinal effects of oppositional defiant disorder symptoms on academic and occupational functioning in the transition to young adulthood. Journal of Abnormal Child Psychology. https://doi.org/10.1007/s10802-016-0190-4.
Leslie, L. K., Weckerly, J., Plemmons, D., Landsverk, J., & Eastman, S. (2004). Implementing the American academy of pediatrics attention-deficit/hyperactivity disorder diagnostic guidelines in primary care settings. Pediatrics. https://doi.org/10.1542/peds.114.1.129.
Lin, E., Goering, P., Offord, D. R., Campbell, D., & Boyle, M. H. (1996). The use of mental health services in Ontario: Epidemiologic findings. Canadian Journal of Psychiatry, 41, 572–577.
List, B. A., & Barzman, D. H. (2011). Evidence-based recommendations for the treatment of aggression in pediatric patients with attention deficit hyperactivity disorder. Psychiatric Quarterly, 82(1), 33–42. https://doi.org/10.1007/s11126-010-9145-z.
Mahajan, R., Bernal, M. P., Panzer, R., Whitaker, A., Roberts, W., Handen, B., … Veenstra-VanderWeele, J. (2012). Clinical practice pathways for evaluation and medication choice for attention-deficit/hyperactivity disorder symptoms in autism spectrum disorders. Pediatrics, 130(Supplement 2), S125–S138. https://doi.org/10.1542/peds.2012-0900J.
Merikangas, K. R., He, J. P., Burstein, M., Swendsen, J., Aveneyoli, S., Case, B., … Olfson, M. (2011). Service utilization for lifetime mental health disorders in U.S. adolescents: Results of the National Comorbidity Survey-Adolescent Supplement (NCS-A). Journal of the American Academy of Child and Adolescent Psychiatry, 50(1), 32–45.
Miller, G. E., & Prinz, R. J. (2003). Engagement of families in treatment for childhood conduct problems. Behaviour Therapy, 34, 517–534.
Ministry of Health Malaysia. (2008). Management of attention deficit hyperactivity disorder in children and adolescents. Putrajaya: Ministry of Health Malaysia.
Ministry of Social Development. (2015). Conduct disorder guideline.
National Collaborating Centre for Mental Health. (2013a). Attention deficit hyperactivity disorder: The NICE guideline on diagnosis and management of ADHD in children, young people and adults. London: The British Psychological Society & The Royal College of Psychiatrists.
National Collaborating Centre for Mental Health. (2013b). Antisocial behaviour and conduct disorders in children and young people: The NICE guideline on recognition, intervention and management. London: The British Psychological Society and The Royal College of Psychiatrists.
National Health and Medical Research Council. (2012). Appendices: Clinical practice points on the dianosis, assessment and management of attention deficit hyperactivity disorder in children and adolescents. Commonwealth of Australia National Health and Medical Research Council.
National Health and Medical Research Council. (2012). Clinical practice points on the diagnosis, assessment and management of attention deficit hyperactivity disorder in children and adolescents. Commonwealth of Australia: National Health and Medical Research Council.
National Institute for Health and Care Excellence. (2008). Attention deficit hyperactivity disorder: diagnosis and management. Tools and resources.
National Institute for Health and Care Excellence (NICE). (2013a). Antisocial behaviour and conduct disorders in children and young people: Recognition and management—Supporting evidence. Retrieved from https://www.nice.org.uk/guidance/cg158/evidence.
National Institute for Health and Care Excellence (NICE). (2013b). Antisocial behaviour and conduct disorders in children and young people: Recognition and management—Tools and resources. Retrieved from https://www.nice.org.uk/guidance/cg158/resources.
National Institute for Health and Care Excellence. (2013c). Attention deficit hyperactivity disorder: diagnosis and management. Supporting evidence: Appendices. Retrieved from https://www.nice.org.uk/guidance/cg72/evidence.
National Institute for Health and Care Excellence. (2013d). NICE Charter. Retrieved from https://www.nice.org.uk/Media/Default/About/Who-we-are/NICE_Charter.pdf.
National Institute for Health and Clinical Excellence. (2006). The guidelines manual.
National Institute for Health and Clinical Excellence. (2009). The guidelines manual.
NiMH. (2008). Strategic objective 1: Promote discovery in the brain and behavioral sciences to fuel research on the causes of mental disorders. Retrieved from http://www.nimh.nih.gov/about/strategic-planningreports/NIMH_StrategicPlanforResearch_508Compliant_CORRECTED_FINAL_149979.pdf.
Nock, M. K., Kazdin, A. E., Hiripi, E., & Kessler, R. C. (2007). Lifetime prevalence, correlates, and persistence of oppositional defiant disorder: Results from the national comorbidity survey replication. Journal of Child Psychology and Psychiatry, 48(7), 703–713.
Nutt, D. J., Fone, K., Asherson, P., Bramble, D., Hill, P., Matthews, K., … Young, S. (2007). Evidence-based guidelines for management of attention-deficit/hyperactivity disorder in adolescents in transition to adult services and in adults: Recommendations from the British Association for Psychopharmacology. Journal of Psychopharmacology, 21(1), 10–41. https://doi.org/10.1177/0269881106073219.
Pliszka, S. (2007). Practice parameter for the assessment and treatment of children and adolescents with attention-deficit/hyperactivity disorder. Journal of the American Academy of Child & Adolescent Psychiatry, 46(7), 894–921. https://doi.org/10.1097/chi.0b013e318054e724.
Pliszka, S. R., Crismon, M. L., Hughes, C. W., Corners, C. K., Emslie, G. J., Jensen, P. S., … Lopez, M. (2006). The Texas Children’s Medication algorithm project: Revision of the algorithm for pharmacotherapy of attention-deficit/hyperactivity disorder. Journal of the American Academy of Child & Adolescent Psychiatry, 45(6), 642–657. https://doi.org/10.1097/01.chi.0000215326.51175.eb.
Pringsheim, T., Hirsch, L., Gardner, D., & Gorman, D. A. (2015a). The pharmacological management of oppositional behaviour, conduct problems, and aggression in children and adolescents with attention-deficit hyperactivity disorder, oppositional defiant disorder, and conduct disorder: A systematic review and meta-analysis. Part 1: psychostimulants, alpha-2 agonists, and atomoxetine. The Canadian Journal of Psychiatry, 60(2), 42–51. https://doi.org/10.1177/070674371506000202.
Pringsheim, T., Hirsch, L., Gardner, D., & Gorman, D. A. (2015b). The pharmacological management of oppositional behaviour, conduct problems, and aggression in children and adolescents with attention-deficit hyperactivity disorder, oppositional defiant disorder, and conduct disorder: A systematic review and meta-analysis. Part 2: antipsychotics and traditional mood stabilizers. The Canadian Journal of Psychiatry, 60(2), 52–61. https://doi.org/10.1177/070674371506000203.
Rees, G., Huby, G., McDade, L., & McKechnie, L. (2004). Joint working in community mental health teams: Implementation of an integrated care pathway. Health and Social Care in the Community, 13, 527–536.
Remschmidt, H. (2005). Global consensus on ADHD/HKD. European Child & AdolescentPsychiatry, 14(3), 127–137. https://doi.org/10.1007/s00787-005-0439-x.
Rushton, J. L., Fant, K. E., & Clark, S. J. (2004). Use of practice guidelines in the primary care of children with attention deficit/hyperactivity disorder. Pediatrics, 114(1), e23–e28. https://doi.org/10.1542/peds.114.1.e23.
Scott, J. G., Pedersen, M. G., Erskine, H. e., Bikic, A., Demontis, D., McGrath, J. J., & Dalsgaard, S. (2017). Mortality in individuals with disruptive behavior disorders diagnosed by specialist services—A nationwide cohort study. Psychiatry Research, 25, 255–260.
Scottish Intercollegiate Guidelines Network. (2008). SIGN 50: A guideline developer’s handbook.
Scottish Intercollegiate Guidelines Network (SIGN). (2009a). Management of attention deficit and hyperkinetic disorders in children and young people: Apple app & Android app. Retrieved from http://www.sign.ac.uk/guidelines/fulltext/112/index.html.
Scottish Intercollegiate Guidelines Network (SIGN). (2009b). Management of attention deficit and hyperkinetic disorders in children and young people: Patient leaflet. Retrieved from http://www.sign.ac.uk/guidelines/fulltext/112/index.html.
Scottish Intercollegiate Guidelines Network (SIGN). (2009c). Management of attention deficit and hyperkinetic disorders in children and young people: Quick reference guide. Retrieved from http://www.sign.ac.uk/guidelines/fulltext/112/index.html.
Scottish Intercollegiate Guidelines Network (SIGN). (2009d). Management of attention deficit and hyperkinetic disorders in children and young people: Search narrative. Retrieved from http://www.sign.ac.uk/guidelines/fulltext/112/index.html.
Scottish Intercollegiate Guidelines Network (SIGN). (2009e). Management of attention deficit and hyperkinetic disorders in children and young people: Summary of recommendations. Retrieved from http://www.sign.ac.uk/guidelines/fulltext/112/index.html.
Scotto Rosato, N., Correll, C. U., Pappadopulos, E., Chait, A., Crystal, S., & Jensen, P. S. (2012a). Treatment of maladaptive aggression in youth: CERT guidelines II. Treatments and ongoing management. Pediatrics, 129(6), e1577–e1586. https://doi.org/10.1542/peds.2010-1361.
Scotto Rosato, N., Correll, C. U., Pappadopulos, E., Chait, A., Crystal, S., & Jensen, P. S. (2012b). Treatment of maladaptive aggression in youth: CERT guidelines II. Treatments and ongoing management-supplemental information. Pediatrics, 129(6), SI1–SI22. https://doi.org/10.1542/peds.2010-1361.
Shaneyfelt, T. M., Mayo-Smith, M. F., & Rothwangl, J. (1999). Are guidelines following guidelines? The methodological quality of clinical practice guidelines in the peer-reviewed medical literature. Journal of the American Medical Association, 281(20), 1900–1905.
Spencer, T., Biederman, J., & Wilens, T. (1999). Atention-deficit/hyperactivity disorder and comorbidity. Pediatric Clinics of North America, 46, 915–927.
Steiner, H., & Remsing, L. (2007). Practice parameter for the assessment and treatment of children and adolescents with oppositional defiant disorder. Journal of the American Academy of Child and Adolescent Psychiatry, 46(1), 126–141.
The AGREE Research Trust. AGREE II overview tutorial. Retrieved from http://www.agreetrust.org/resource-centre/agree-ii-training-tools/.
The AGREE Research Trust. My AGREE PLUS. Retrieved from http://www.agreetrust.org/login.
The National Guideline Clearinghouse. (2014). 2013 (revised) criteria for inclusion of clinical practice guidelines in NGC. Retrieved from http://www.guideline.gov/about/inclusion-criteria.aspx.
The REACH Institute. (2010). Treatment of maladaptive aggression in youth (T-MAY) guidelines toolkit. Retrieved from http://t-may.org/.
University of Michigan Health System. (2013). Attention-deficit hyperactivity disorder: Guidelines for clinical care. Ann Arbor: University of Michigan.
Vetter, V. L., Elia, J., Erickson, C., Berger, S., Blum, N., Uzark, K., & Webb, C. L. (2008). Cardiovascular monitoring of children and adolescents with heart disease receiving medications for attention deficit/hyperactivity disorder. A Scientific Statement from the American Heart Association Council on Cardiovascular Disease in the Young Congenital Cardiac Defects Committee and the Council on Cardiovascular Nursing, 117(18), 2407–2423. https://doi.org/10.1161/circulationaha.107.189473.
Vlayen, J., Aertgeerts, B., Hannes, K., Sermeus, W., & Ramaekers, D. (2005). A systematic review of appraisal tools for clinical practice guidelines: Multiple similarities and one common deficit. International Journal for Quality in Health Care, 17(3), 235–242. https://doi.org/10.1093/intqhc/mzi027.
Funding
This study was funded by the Margret and Wallace McCain Centre for Child Youth and Family Mental Health at the Centre for Addiction and Mental Health, Toronto, Canada.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors, Brendan F. Andrade, Darren Courtney, Stephanie Duda, Madison Aitken, Stephanie G. Craig, Peter Szatmari, Joanna Henderson, Kathryn Bennett declare that he/she has no conflict of interest.
Ethical Approval
This article does not contain any studies with human participants performed by any of the authors.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Andrade, B.F., Courtney, D., Duda, S. et al. A Systematic Review and Evaluation of Clinical Practice Guidelines for Children and Youth with Disruptive Behavior: Rigor of Development and Recommendations for Use. Clin Child Fam Psychol Rev 22, 527–548 (2019). https://doi.org/10.1007/s10567-019-00292-2
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10567-019-00292-2