Abstract
Public debate on costs and effectiveness of health care in the United States has generated a growing emphasis on “profiling” of medical care providers. The process of profiling involves comparing resource use and quality of care among medical providers to community or to normative standards. Information from provider profiles may be used to determine whether providers deviate from acceptable standards in the type of care they deliver. In this paper we profile hospitals based on 30-day mortality rates for a cohort of 14,581 Medicare patients discharged with acute myocardial infarction (AMI) in 1993 from hospitals located in Alabama, Connecticut, Iowa, or Wisconsin. Clinical and socio-demographic information for the study cohort were collected retrospectively from individually reviewed medical charts and administrative files.
To account for within-hospital association among patient outcomes and between-hospital variability of practice patterns, we fit a Hierarchical Logistic Regression Model to the mortality data. We also employed multiple imputation methods to impute anomalous and missing values under the assumption that the complete multivariate data follow a General Location Model. Once predictor variables were selected and appropriately transformed, imputed datasets were then fitted to the Hierarchical Logistic Regression Model using Markov Chain Monte Carlo methods, and the results of each fit were combined across imputations to produce inferences for the model. We estimated several indices of excess mortality: (1) the posterior probability that hospital mortality was one and one half times the median mortality over all hospitals for patients of average admission severity, (2) the probability that the difference between adjusted and standardized hospital mortality was large, and (3) the probability that hospital mortality was greater than a benchmark value.
We found that the overall unadjusted 30-day mortality rate was 21%, and ranged from 18% in Connecticut to 23% in Alabama; observed hospital-specific mortality ranged from 0 to 67% across the 389 hospitals. After adjusting for patient age, mean arterial pressure, creatinine and respiration rate measured at admission in each hospital, hospital mortality ranged from 10% to 53%. The probability that hospital-specific mortality for the “average” patient was one and one half times the median mortality for similar patients was greater than 14% for one quarter of the sampled hospitals. The posterior probability of a large discrepancy between risk-adjusted and standardized hospital-specific mortality was less than 6% for three quarters of the hospitals.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
American Hospital Association (1989). International Classification of Diseases, Ninth Revision, Clinical Modification. Chicago, Ill: American Hospital Publishing Inc.
Anderson, T.W. (1971). An Introduction to Multivariate Statistics. New York, NY; John Wiley & Sons.
Berwick, D.M. and Wald, D.L. (1990). Hospitals leaders’ opinions of the HCFA mortality data. JAMA; 263: 247–249.
Box, G. and Tiao, G. (1973). Bayesian Inference in Statistical Analyses. Reading, MA; Addison-Wesley Publishing Co.
Breiman, L., Friedman, J.H., Olshen, R.A., Stone, C.J. (1984). Classification and Regression Trees. Belmont, CA; Wadsworth Publishing Co.
The Cardiology Working Group, Ryan et al (1991). The Cardiology Working Group: Cardiology and the quality of medical practice. JAMA, 265: 482–485.
Chassin, M.R., Brook, R.H., Park, R.E., et al (1986). Variations in the use of medical and surgical procedures. N Engl J Med; 314: 285–290.
Codman, E. (1916). Hospital standardization. Surg Gyn Obst; 22: 119–120.
Daley, J., Jencks, S., Draper, D., Lenhart, G., et al (1988). Predicting hospital-associated mortality for medicare patients: A method for patients with stroke, pneumonia, acute myocardial infarction, and congestive heart failure. JAMA, 260: 3617–3624.
De Wood, M.A., Spores, J., Notske, R., et al (1980). Prevalence of total coronary occlusion during the early hours of transmural myocardial infarction. N Engl J Med; 303: 897–902.
DuBois, R.W., Rogers, W.H., Moxley, J.H., et al (1987). Hospital inpatient mortality: Is it a predictor of quality? N Engl J Med, 317, 1674–1679.
Ellerbeck, E., Jencks, S., Radford, M., et al (1995). Treatment of medicare patients with acute myocardial infarction: Report on a four state pilot of the Cooperative Cardiovascular Project. JA MA; 273: 1509–1514.
FTTCG, The Fibrinolytic Therapy Trialists Collaborative Group (1994). Indications for fibrinolytic therapy in suspected acute myocardial infarction: Collaborative overview of early mortality and major morbidity results from all randomized trials of more than 1000 patients. Lancet, 343: 311–322.
Fuchs, V.R. (1965). Toward a theory of poverty. InThe Concept of Poverty. Task Force on Economic Growth and Opportunity, First Report. Washington, DC; Chamber of Commerce of the United States.
Gatsonis, C.A., Epstein AM, Newhouse JP, et al (1995). Variations in the utilization of coronary angiography for elderly patients with an acute myocardial infarction: An analysis using hierarchical logistic regression. Medical Care; 33: 625–642.
Gatsonis, C.A., Liu, C.H., Normand, S.L. (1995). Bayesian methods for hierarchical logistic and normal models, with applications to the analysis of health care utilization data. Manuscript under preparation, Department of Health Care Policy, Harvard Medical School.
Gelman, A., Carlin, J., Stern, H., Rubin, D. (1995). Bayesian Data Analysis; New York, NY: Chapman and Hall Inc.
Gelman, A., Rubin, D. (1992). Inference from iterative simulation using multiple sequences. Statistical Science; 7: 457–472.
The GUSTO Investigators (1993). An international randomized trials comparing four thrombolytic strategies for acute myocardial infarction. N Engl J Med; 329: 673–682.
The GUSTO Investigators (1995). Predictors of 30-day mortality in the era of reperfusion for acute myocardial infarction: Results from an international trial of 41,021 patients. Circulation; 91: 1659–1668.
Hastie, T., Tibshirani, R. (1986). Generalized additive models. Statistical Science; 1: 297–310.
Health and Human Services (1992). Medicare Hospital Information, 1992. Washington DC: US Dept of Health and Human Services.
ISIS-2, The Second International Study of Infarct Survival Collaborative Group (1988). Randomized trial of intravenous streptokinase, oral aspirin, both, or neither among 17187 cases of suspected acute myocardial infarction. Lancet; ii: 349–360.
ISIS-4, The Fourth International Study of Infarct Survival Collaborative Group (1994). A randomized factorial trial assessing early oral captopril, oral mononitrate, and intravenous magnesium sulphate in 58,050 patients with suspected acute myocardial infarction. Lancet; 345: 669–685.
Jencks, S.F. and Wilensky, G.R. (1992). The Health Care Quality Improvement Initiative: A new approach to quality assurance in medicare. JAMA; 268: 900–903.
Kahn, K.L., Rogers, W.H., Rubenstein, L.V., et al (1990). Measuring quality of care with explicit process criteria before and after implementation of the DRG-based prospective payment system. JAMA; 264: 1969–1973.
Kassirer, J.P. (1994). Use and abuse of practice profiles. New Engl J Med; 330: 634–635.
Knaus, W.A., Zimmerman, J.E., Wagner, D.P., et al, (1981). APACHE–acute physiology and chronic health evaluation: a physiologically based classification system. Crit Care Med.; 9: 591–597.
Lau, J., Antman, E., Jimenez-Silva, J., et al (1992). Cumulative meta-analyses of therapeutic trials for myocardial infarction. New Engl J Med; 327: 248–254.
Little, R.J.A., Schluchter, M.D. (1985). Maximum likelihood estimation for mixed continuous and categorical data with missing values. Biometrika; 72: 497–512.
Liu, C.H., Rubin, D.B. (1995). M: Data Manipulation Environment Programming Language Graphics, Department of Statistics & Department of Health Care Policy, Harvard University and Harvard Medical School, Boston MA.
Malec, D., Sedransk, J., Thompson, L. (1993). Bayesian predictive inference for small areas for binary variables in the National Health Interview survey. In Case Studies in Bayesian Statistics, eds. C Gatsonis, J Hodges, R Kass and N Singpurwalla. New York NY: Springer-Verlag.
McClellan, M., McNeil, B.J., Newhouse, J.P. (1994). Does more intensive treatment of acute myocardial infarction in the elderly reduce mortality? Analysis using instrumental variables. Journal of the American Medical Association; 272, 859–866.
Normand, S.L., Glickman, M.E., Sharma, R.G.V.R.K, McNeil, B.J. (1996). Using admission characteristics to predict short-term mortality from myocardial infarction: Results from the Cooperative Cardiovascular Project. To appear in Journal of the American Medical Association.
Office of Research and Demonstrations, Health Care Financing Administration (1990). Health Care Financing Administration, Special Report: Hospital Data by Geographic Area for Aged Medicare Beneficiaries: Selected Procedures, 1986. Washington, DC: Health Care Financing Administration, US Dept of Health and Human Services.
Olkin, I., Tate, R.F. (1961). Multivariate correlation models with mixed discrete and continuous variables. Ann of Mathematical Stat; 32: 448–465.
Pashos, C.L., Newhouse, J.P., McNeil, B.J. (1993). Temporal changes in the care and outcomes of elderly patients with acute myocardial infarction. JAMA; 270: 1832–1836.
Pashos, C.L., Normand, S.L., Garfinkle, J.B., et al (1994). Trends in the use of drug therapies in patients with acute myocardial infarction: 1988–1992. JACC; 23: 1023–1030.
Peterson, E.D., Wright, S.M., Daley, J., et al (1994). Racial variation in cardiac procedure use and survival following acute myocardial infarction in the department of Veterans Affairs. JAMA, 271: 1175–1180.
Peterson, E.D., Wright, S.M., Daley, J., et al (1992). Racial variation in cardiac procedure use and survival following acute myocardial infarction in the VA. Circulation; 86 (Suppl): 1–10.
Pfeffer, M.A., Braunwald, E., Moye, L.A., et al. (SAVE Investigators) (1992). Effect of captopril on mortality and morbidity in patients with left ventricular dysfunction after myocardial infarction. Results of the Survival and Ventricular Enlargement Trial. New Engl J Med, 327: 669–677.
Rogers, W.J., Bowlby, L.J., Chandra, N.C., et al (1994). Treatment of myocardial infarction in the United States (1990 to 1993): Observations from the National Registry of Myocardial Infarction. Circulation, 90: 2103–2114.
Rubenstein, L.V., Kahn, K.L., Reinisch, E.J., et al (1990). Changes in quality of care for five diseases measured by implicit review, 1981–1986. JAMA; 264: 1974–1979.
Rubin, D.B. (1984). Bayesian justifiable and relevant frequency calculations for the applied statistician. Annals of Statistics; 12: 1151–1172.
Rubin, D.B. (1987). Multiple Imputation for Nonresponse in Surveys. New York, NY; John Wiley & Sons.
Schafer, J.L. (1991). Algorithms for multiple imputation and posterior simulation from incomplete multivariate data with ignorable nonresponse. Doctoral thesis, Department of Statistics, Harvard University, Cambridge MA.
S-PLUS (1991). S-PL US User’s Manual Vol.1 & Vol. 2, Seattle WA, Statistical Sciences Inc.
Terrin, M.L., Williams, D.O., Kleiman, N.S., et al (1993). Two and three year results of the thrombolysis in myocardial infarction (TIMI) phase II clinical trial. J Am Coll Cardiol; 22: 1763–1772.
The TIMI Investigators (1994). Effects of tissue plasminogen activator and a comparison of early invasive and conservative strategies in unstable angina and non-Q-wave myocardial infarction. Circulation; 89: 1545–1556.
TIMI IIB (1989). Comparison of invasive and conservative strategies after treatment with intravenous tissue plasminogen activator in acute myocardial infarction: Results of the Thrombolysis in Myocardial Infarction (TIMI) Phase II Trial. New Engl J Med; 320: 618–627.
Udvarhelyi, I.S., Gatsonis, C.A., Epstein, A.M., et al (1992). Acute myocardial infarction in the Medicare population: Process of care and clinical outcomes. JAMA; 268: 2530–2536.
Van der Werf, F., Topol, E.J., Kerry, K.L., et al (1995). Variations in patient management and outcomes for acute myocardial infarction in the United States and other countries. JAMA, 273: 1586–1591.
Wennberg, J., Gittelsohn, A. (1982). Variations in medical care among small areas. Sci Am; 246: 120–135.
Wong, G., Mason, W. (1985). The hierarchical logistic regression model for multilevel analysis. JASA; 80: 513–524.
Wong, G., Mason, W. (1991). Contextually specific effects and other generalizations of the hierarchical linear model for comparative analysis. JASA; 86: 487–503.
Wright, S.M., Peterson, E.D., Daley, J., et al (1993). Variation in cardiac procedures and survival following acute myocardial infarction in the VA. JACC; 21 (Suppl): 175A.
Algina, J. (1992). Special issue: the National Assessment of Educational Progress (Editor’s Note). Journal of Educational Measurement, 29, 93–94.
Arrow, Kenneth J. (1985) “The Economics of Agency,” in John Pratt and Richard J. Zeckhauser, eds., Principals and Agents, Cambridge, MA: Harvard Business School.
Cutler, David M. (1995). “The Incidence of Adverse Medical Outcomes under Prospective Payment,” Econometrica, 63, 29–50.
Dranove, David and Mark A. Satterthwaite. (1992). Monopolistic competition when price and quality are imperfectly observable. Rand Journal of Economics, 23, 518–534.
Fudenberg, Drew, Holmström, Bengt, and Paul Milgrom (1995). “Short-Term and Long-Term Agency Relationships,” Journal of Economic Theory, forthcoming.
Gal-Or, Esther (1995) “Optimal Reimbursement and Malpractice Reform in Health Care Markets,” manuscript, Katz Graduate School of Business, University of Pittsburgh.
Gaynor, Martin and Paul J. Gertler (1995) “Moral Hazard and Risk Spreading in Medical Partnerships,” Rand Journal of Economics, Winter, forthcoming.
Guterman, Stuart and Allen Dobson (1986) “Impact of Medicare Prospective Payment System for Hospitals,” Health Care Financing Review, 7, 97–114.
Hart, Oliver and Bengt Holmström (1987) “The Theory of Contracts,” in Advances in Economic Theory, Fifth World Congress, Truman Bewley, ed., Cambridge, UK: Cambridge University Press.
Hillman A.L., Pauly M.V., Kerstein J.J. (1989) “How do Financial Incentives Affect Physicians’ Clinical Decisions and the Financial Performance of Health Maintenance Organizations,” New England Journal of Medicine, 321, 2, 86–92.
Hillman, Alan L. (1991) “Managing the Physician: Rules Versus Incentives,” Health Affairs, Winter, 138–146.
Holmström, Bengt (1979) “Moral Hazard and Observability,” The Bell Journal of Economics, 10, 1, 74–91.
Johnson, E. G., Mislevy, R. J., and Thomas, N. (1994). Theoretical background and philosophy of NAEP scaling procedures. Chapter 8, pp. 133–146 in Johnson, E. G., Mazzeo, J. and Kline, D. L. (1994). Technical Report of the NAEP 1992 Trial State Assessment Program in Reading. Washington, DC: Office of Educational Research and Improvement, U.S. Department of Education.
Kahn, Katherine L. et al. (1990) “Comparing Outcomes of Care Before and After Implementation of the DRG-Based Prospective Payment System,” Journal of the American Medical Association, 264, 1984–1988.
Liu, C. H. and Rubin, D. B. (1995). M: Data manipulation environment programming language graphics, Department of Statistics and Department of Health Care Policy, Harvard University and Harvard Medical School. Cambridge, MA.
Madigan, D. and Raftery, A. E. (1994). Model selection and accounting for model uncertainty in graphical models using Occam’s Window. Journal of the American Statistical Association, 89, 1535–1546.
Normand, S.-L., Glickman, M. E., and Ryan, T. J. (1995). Modeling mortality rates for elderly heart attack patients: profiling hospitals in the Cooperative Cardiovascular Project. Invited Paper, this workshop.
Normand, S.-L., Glickman, M. E., and Ryan, T. J. (1995). Modeling mortality rates for elderly heart attack patients: profiling hospitals in the Cooperative Cardiovascular Project. Invited Paper, this workshop.
Phelps, Charles E. (1992) Health Economics, New York: Harper Collins Publishers.
Prospective Payment Assessment Commission (1991) Medicare Prospective Payment and the American Health Care System, Washington, D.C.: Prospective Payment Assessment Commission.
Radner, Roy (1985) “Repeated Principal-Agent Games with Discounting,” Econometrica, 53, 1173–1198.
Rodgers, William H. et al. (1990) “Quality of Care Before and After Implementation of the DRG- Based Prospective Payment System: A Summary of Effects,” Journal of the American Medical Association, 264, 1989–1994.
Ross, Steven (1973) “The Economic Theory of Agency: The Principal’s Problem,” American Economic Review, 63, 134–139.
Rubinstein, Ariel and Menachem Yaari (1983) “Repeated Insurance Contracts and Moral Hazard,” Journal of Economic Theory, 30, 74–97.
Silber, J. H., Rosenbaum, P. R. and Ross, R. N. (1995). Comparing the contributions of groups of predictors: which outcomes vary with hospitals rather than patient characteristics? Journal of the American Statistical Association, 90, 7–18.
Spirtes, P., Glymour, C., and Scheines, R. (1993). Causation, prediction, and search. New York: Springer-Verlag.
Staiger, Douglas and Gary L. Gaumer (1990) “The Impact of Financial Pressure on Quality of Care in Hospitals: Post-Admission Mortality Under Medicare’s Prospective Payment System,” unpublished manuscript, Stanford University.
Williamson, Oliver E. (1975) Markets and Hierarchies, NY: Free Press.
Zwick, R. (1992). Special issue on the National Assessment of Educational Progress. Journal of Educational Measurement, 17, 93–94.
Chib, S. (1995), “Marginal Likelihood From the Gibbs Output,” Journal of the American Statistical Association, 90, 1313–1321.
Chib, S. and Greenberg, E. (1995), “Hierarchical Analysis of SUR Models with Extensions to Correlated Serial Errors and Time-Varying Parameter Models,” Journal of Econometrics, 68, 339–360.
Hobert, J. and Casella, G. (1993), “Gibbs Sampling with Improper Prior Distributions,” manuscript.
Kass, R. and Raftery, A. (1995), “Bayes Factors,” Journal of the American Statistical Association, 90, 773–795.
Koop, G., Osiewalski, J. and Steel, M.F.J. (1995), “Efficiency Analysis Through Individual Effects: Hospital Cost Frontiers,” Journal of Econometrics, forthcoming.
McCulloch, R. and Rossi, P. (1994), “An Exact Likelihood Analysis of the Multinomial Probit Model,” Journal of Econometrics, 64, 207–240.
Rossi, P., McCulloch, R. and Allenby, G. (1994), “Hierarchical Modelling of Consumer Heterogeneity: An Application to Target Marketing,” manuscript.
Verdinelli, I. and Wasserman, L. (1995), “Computing Bayes Factors Using a Generalization of the Savage-Dickey Density Ratio,” Journal of the American Statistical Association, 90, 614–618.
Chassin, M.R., Hannanm E.L., DeBuono, B.A. (1996). Benefits and hazards of reporting medical outcomes publicly. New England Journal of Medicine, 334, 394–398.
CONQUEST 1.0 Diskette and User’s Guide (1996). US National Technical Information Service, PB96–501655.
Green, J., Wintfeld, N. (1995). Report cards on cardiac surgeons: Assessing New York State’s approach. New England Journal of Medicine, 332, 1129–1232.
Krumholtz, H.M., Radford, M.J., Ellerbeck, E.F., et al (1996). Aspirin for secondary prevention after acute myocardial infarction in the elderly: Prescribed use and outcomes. Annal of Internal Medicine, 124, 292–298.
Rosenbaum, P.R. (1984). The consequences of adjustment for a concomitant variable that has been affected by treatment. Journal of the Royal Statistical Society, A, 147, 656–666.
Silber, J.H. (1995). Report cards on cardiac surgeons. New England Journal of Medicine, 333, 938–939.
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1997 Springer-Verlag New York, Inc.
About this paper
Cite this paper
Normand, SL.T., Glickman, M.E., Ryan, T.J. (1997). Modeling Mortality Rates for Elderly Heart Attack Patients: Profiling Hospitals in the Cooperative Cardiovascular Project. In: Gatsonis, C., Hodges, J.S., Kass, R.E., McCulloch, R., Rossi, P., Singpurwalla, N.D. (eds) Case Studies in Bayesian Statistics. Lecture Notes in Statistics, vol 121. Springer, New York, NY. https://doi.org/10.1007/978-1-4612-2290-3_4
Download citation
DOI: https://doi.org/10.1007/978-1-4612-2290-3_4
Publisher Name: Springer, New York, NY
Print ISBN: 978-0-387-94990-1
Online ISBN: 978-1-4612-2290-3
eBook Packages: Springer Book Archive