Abstract
CONTEXT: Previous studies testing continuous quality improvement (CQI) for depression showed no effects. Methods for practices to self-improve depression care performance are needed. We assessed the impacts of evidence-based quality improvement (EBQI), a modification of CQI, as carried out by 2 different health care systems, and collected qualitative data on the design and implementation process.
OBJECTIVE: Evaluate impacts of EBQI on practice-wide depression care and outcomes.
DESIGN: Practice-level randomized experiment comparing EBQI with usual care.
SETTING: Six Kaiser Permanente of Northern California and 3 Veterans Administration primary care practices randomly assigned to EBQI teams (6 practices) or usual care (3 practices). Practices included 245 primary care clinicians and 250,000 patients.
INTERVENTION: Researchers assisted system senior leaders to identify priorities for EBQI teams; initiated the manual-based EBQI process; and provided references and tools.
EVALUATION PARTICIPANTS: Five hundred and sixty-seven representative patients with major depression.
MAIN OUTCOME MEASURES: Appropriate treatment, depression, functional status, and satisfaction.
RESULTS: Depressed patients in EBQI practices showed a trend toward more appropriate treatment compared with those in usual care (46.0% vs 39.9% at 6 months,P=.07), but no significant improvement in 12-month depression symptom outcomes (27.0% vs 36.1% poor depression outcome,P=.18). Social functioning improved significantly (mean score 65.0 vs 56.8 at 12 months,P=.02); physical functioning did not.
CONCLUSION: Evidence-based quality improvement had perceptible, but modest, effects on practice performance for patients with depression. The modest improvements, along with qualitative data, identify potential future directions for improving CQI research and practice.
Similar content being viewed by others
References
Institute of Medicine. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, DC: National Academy Press; 2001.
Institute for the Future. Health and Health Care 2010: The Forecast, the Challenge. 2nd edn. New York: John Wiley & Sons; 2002.
Schulberg HC, Katon W, Simon GE, Rush AJ. Treating major depression in primary care practice: an update of the agency for health care policy and research practice guidelines. Arch Gen Psychiatry. 1998;55:1121–7.
Depression Guideline Panel. Clinical Practice Guideline, Depression in Primary Care: Vol. 1. Detection and Diagnosis (AHCPR Publication No. 93-0550). Rockville, MD: U.S. Department of Health and Human Services, Public Health Service Agency for Health Care Policy and Research; 1993.
Depression Guideline Panel. Clinical Practice Guideline, Depression in Primary Care: Vol. 2. Treatment of Major Depression (AHCPR Publication No. 93-0551). Rockville, MD: U.S. Department of Health and Human Services, Public Health Service Agency for Health Care Policy and Research; 1993.
Charbonneau A, Rosen AK, Ash AS, et al. Measuring the quality of depression care in a large integrated health system. Med Care. 2003;41:669–80.
Kerr EA, McGlynn EA, Van Vorst KA, Wickstrom SL. Measuring antidepressant prescribing practice in a health care system using administrative data: implications for quality measurement and improvement. Jt Comm J Qual Improv. 2000;26:203–16.
Olfson M, Marcus SC, Druss B, Elinson L, Tanielian T, Pincus HA. National trends in the outpatient treatment of depression. JAMA. 2002;287:203–9.
Rollman BL, Hanusa BH, Lowe HJ, Gilbert T, Kapoor WN, Schulberg HC. A randomized trial using computerized decision support to improve treatment of major depression in primary care. J Gen Intern Med. 2002;17:493–503.
Dobscha SK, Gerrity MS, Ward MF. Effectiveness of an intervention to improve primary care provider recognition of depression. Eff Clin Pract. 2001;4:163–71.
Thompson C, Kinmonth AL, Stevens L, et al. Effects of a clinical-practice guideline and practice-based education on detection and outcome of depression in primary care: hampshire depression project randomised controlled trial. Lancet. 2000;355:185–91.
Katon WJ, Von Korff M, Lin E, et al. Collaborative management to achieve treatment guidelines: impact on depression in primary care. JAMA. 1995;273:1026–31.
Rost K, Nutting P, Smith J, Werner J, Duan N. Improving depression outcomes in community primary care practice: a randomized trial of the quEST intervention. Quality enhancement by strategic teaming. J Gen Intern Med. 2001;16:143–9.
Wells KB, Sherbourne C, Schoenbaum M, et al. Impact of disseminating quality improvement programs for depression in managed primary care: a randomized controlled trial. JAMA. 2000;283:212–20.
Dietrich AJ, Oxman TE, Williams JW Jr., et al. Re-engineering systems for the treatment of depression in primary care: cluster randomised controlled trial. BMJ. 2004;329:602.
Unutzer J, Katon W, Callahan CM, et al. Collaborative care management of late-life depression in the primary care setting: a randomized controlled trial. JAMA. 2002;288:2836–45.
Hunkeler EM, Meresman JF, Hargreaves WA, et al. Efficacy of nurse telehealth care and peer support in augmenting treatment of depression in primary care. Arch Fam Med. 2000;9:700–8.
Donabedian A. Explorations in Quality Assessment and Monitoring. Vol. I: The Definition of Quality and Approaches to its Assessment. Ann Arbor, MI: Health Administration Press; 1980.
Schoenbaum M, Unutzer J, Sherbourne C, et al. Cost-effectiveness of practice-initiated quality improvement for depression: results of a randomized controlled trial. JAMA. 2001;286:1325–30.
Liu CF, Hedrick SC, Chaney EF, et al. Cost-effectiveness of collaborative care for depression in a primary care veteran population. Psychiatr Serv. 2003;54:698–704.
Simon GE, Katon WJ, VonKorff M, et al. Cost-effectiveness of a collaborative care program for primary care patients with persistent depression. Am J Psychiatry. 2001;158:1638–44.
Shortell SM, Bennett CL, Byck GR. Assessing the impact of continuous quality improvement on clinical practice: what it will take to accelerate progress. Milbank Q. 1998;76:593–624.
McLaughlin CP, Kaluzny CA. Continuous Quality Improvement in Health Care. 2nd edn. Gaithersburg, MD: Aspen; 1999.
Berwick DM. Continuous improvement as an ideal in health care. N Engl J Med. 1989;320:53–6.
Brown BW, Jr.Shye D, McFarland BH, Nicholas GA, Mullooly JP, Johnson R. Controlled trials of CQI and academic detailing to implement a clinical practice guideline for depression. Jt Comm J Qual Improv. 2000;26:39–54.
Horowitz CR, Goldberg HI, Martin DP, et al. Conducting a randomized controlled trial of CQI and academic detailing to implement clinical guidelines. Jt Comm J Qual Improv. 1996;22:734–50.
Solberg LI, Fischer LR, Wei F, et al. A CQI intervention to change the care of depression: a controlled study. Eff Clin Pract. 2001;4:239–49.
Oxman AD, Thomson MA, Davis DA, Haynes RB. No magic bullets: a systematic review of 102 trials of interventions to improve professional practice. Can Med Assoc J. 1995;153:1423–31.
Davis DD, Thomson MA, Oxman AD, Haynes RB. Evidence for the effectiveness of CME: a review of 50 randomized controlled trials. JAMA. 1992;268:1111–7.
Grimshaw JM, Shirran L, Thomas R, et al. Changing provider behavior: an overview of systematic reviews of interventions. Med Care. 2001;39(Suppl):II-45.
Cook TDCDT. Quasi-Experimentation: Design and Analysis Issues for Field Settings. Boston: Houghton Mifflin Company; 1979.
Grimshaw J, Campbell M, Eccles M, Steen N. Experimental and quasi-experimental designs for evaluating guideline implementation strategies. Fam Pract. 2000;(Suppl 1):11–6.
Agency for Health Care Policy and Research. Clinical Practice Guideline: Quick Reference Guide for Clinicians. AHCPR Publication No. 93-0552. Rockville, MD: Agency for Health Care Policy and Research; 1993.
Rubenstein LV, Parker LE, Meredith LS, et al. Understanding team-based quality improvement for depression in primary care. Health Serv Res. 2002;37:1009–29.
Rubenstein LV, Meredith L, Parker LE, et al. Design and Implementation of Evidence-based Quality Improvement for Depression in the Mental Health Awareness Project: Background, Methods, Evaluation, and Manuals, MR1699-NIMH. Santa Monica: RAND Corporation; 2003.
Rubenstein LV, Jackson-Triche M, Unutzer J, et al. Evidence-based care for depression in managed primary care practices. Health Aff (Millwood). 1999;18:89–105.
Depression Patient Outcomes Research Team (PORT-II). Partners in care (PIC) tool for an integrated approach to improving care for depression in primary care. Available at: http://www.rand.org/health/pic.products/. Accessed February 3, 2006. 2003.
Rubenstein LV, Fink A, Yano EM, Simon B, Chernof B, Robbins AS. Increasing the impact of quality improvement on health: an expert panel method for setting institutional priorities. Jt Comm J Qual Improv. 1995;21:420–32.
Sherbourne C, Schoenbaum M, Wells KB, Croghan TW. Characteristics, treatment patterns, and outcomes of persistent depression despite treatment in primary care. Gen Hosp Psychiatry. 2004;26:106–14.
Rubenstein LV, McCoy JM, Cope DW, et al. Improving patient quality of life with feedback to physicians about functional status. J Gen Intern Med. 1995;10:607–14.
World Health Organization. Composite International Diagnostic Interview (CIDI) Core Version 2.1 Interviewer’s Manual. Geneva: World Health Organization; 1997.
Meredith LS, Orlando M, Humphrey N, Camp P, Sherbourne CD. Are better ratings of the patient-provider relationship associated with higher quality care for depression? Med Care. 2001;39:349–60.
Clever S, Ford DE, Rubenstein LV, et al. Primary care patients involvement in decision making is associated with improvements in depression. Med Care. 2006; 44:398–405.
Sherbourne CD, Wells KB, Duan N, et al. Long-term effectiveness of disseminating quality improvement for depression in primary care. Arch Gen Psychiatry. 2001;58:696–703.
Radloff L. The CES-D scale. A self-report depression scale for research in the general population. Appl Psychiatric Measures. 1997;1:385–401.
Ware JE Jr, Kosinski M, Keller S. SF-12: How to Score the SF-12 Physical and Mental Health Summary Scales. Boston, MA: The Health Institute, New England Medical Center; 1995.
Ware JE Jr, Sherbourne CD. The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care. 1992;30:473–83.
Bohn MJ, Babor TF, Kranzler HR. The alcohol use disorders identification test (AUDIT): validation of a screening instrument for use in medical settings. J Stud Alcohol. 1995;56:423–32.
Smith JP. Racial and ethnic differences in wealth in the health and retirement study. J Hum Resour. 1995;30(suppl):S158–83.
van Belle G, Fisher LD, Heagerty PJ, Lumley T. Biostatistics: A Methodology for the Health Sciences. 2nd edn. Hoboken, NJ: Wiley-Interscience; 2004.
McCaffrey DF, Bell RM. Bias reduction in standard errors for linear regression with multi-stage samples. AT&T Technical Report TD-4S9H9T; 2000.
Williams RL. A note on robust variance estimation for cluster-correlated data. Biometrics. 2000;56:645–6.
Sherman SE, Chapman A, Garcia D, Braslow JT. Improving recognition of depression in primary care: a study of evidence-based quality improvement. Jt Comm J Qual Safety. 2004;30:80–88.
Wagner EH, Austin BT, Von Korff M. Organizing care for patients with chronic illness. Milbank Q. 1996;74:511–44.
Katon WJ. The Institute of Medicine “Chasm” report: implications for depression collaborative care models. Gen Hosp Psychiatry. 2003;25:222–9.
Rosenheck RA. Organizational process: a missing link between research and practice. Psychiatr Serv. 2001;52:1607–12.
Lehman WE, Greener JM, Simpson DD. Assessing organizational readiness for change. J Subst Abuse Treat. 2002;22:197–209.
Weeks B, Helms MM, Ettkin LP. A physical examination of health care’s readiness for a total quality management program: a case study 1. Hosp Mater Manage Q. 1995;17:68–74.
Gustafson DH, Sainfort F, Eichler M, Adams L, Bisognano M, Steudel H. Developing and testing a model to predict outcomes of organization change. Health Serv Res. 2003;38:751–76.
Nutting PA, Dickinson LM, Rubenstein LV, Keeley RD, Smith JL, Elliot CE. Improving detection of suicidal ideation among depressed patients in primary care. Ann Fam Med. 2005;3:529–36.
Solberg LI, Kottake TE, Brekke ML, et al. Failure of a continuous quality improvement intervention to increase the delivery of preventive services: a randomised trial. Eff Clin Pract. 2000;3:105.
Flottorp S, Havelsrud K, Oxman AD. Process evaluation of a cluster randomized trial of tailored interventions to implement guidelines in primary care-why is it so hard to change practice? Fam Pract. 2003;20:333–9.
Wagner EH, Glasgow RE, Davis C, et al. Quality improvement in chronic illness care: a collaborative approach. Jt Comm J Qual Improv. 2001;27:63–80.
Campbell MK, Elbourne DR, Altman DG. CONSORT statement: extension to cluster randomised trials. BMJ. 2004;328:702–8.
Davidoff F, Batalden P. Toward stronger evidence on quality improvement. Draft publication guidelines: the beginning of a concensus project. Qual Saf Health Care. 2005;14:319–25.
Meredith LS, Rubenstein LV, Rost K, et al. Treating depression in staff-model versus network-model managed care organizations. J Gen Intern Med. 1999;14:39–48.
Author information
Authors and Affiliations
Corresponding author
Additional information
No conflicts of interest.
L.V.R. was the principal investigator and is guarantor. She designed the study along with L.S.M. and L.E.P. C.O. led data collection. Data analysis was carried out by L.V.R., M.L.L., and S.C.H. with support from all authors. All authors collaborated on interpretation of the data and writing the manuscript. The study could not have taken place without the support of Kaiser Permanente in Northern California and of the VA Greater Los Angeles Healthcare System, Los Angeles, California.
Funding sources: The National Institute for Mental Health, the MacArthur Foundation, and the VA Health Services Research and Development Center of Excellence for the Study of Healthcare Provider Behavior funded the Mental Health Awareness Project upon which this paper is based. The study funders had no involvement in this publication.
Rights and permissions
About this article
Cite this article
Rubenstein, L.V., Meredith, L.S., Parker, L.E. et al. Impacts of evidence-based quality improvement on depression in primary care a randomized experiment. J GEN INTERN MED 21, 1027–1035 (2006). https://doi.org/10.1111/j.1525-1497.2006.00549.x
Received:
Revised:
Accepted:
Issue Date:
DOI: https://doi.org/10.1111/j.1525-1497.2006.00549.x