Skip to main content
SpringerLink
Log in

A Brief Note on Methodology: Pragmatic Diagnostic Accuracy Studies

  • Chapter
  • First Online:
Dementia in Clinical Practice: A Neurological Perspective

Abstract

This chapter examines the methodology used to assess the diagnostic accuracy of clinical signs, cognitive and non-cognitive screening instruments used in the cognitive disorders clinic to assist in the diagnosis of dementia. The relevance of pragmatic diagnostic accuracy studies, compared to experimental studies, as a better reflection of the idiom of clinical practice, is emphasized.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Altman DG, Machin D, Bryant TN, Gardner MJ. Statistics with confidence. Confidence intervals and statistical guidelines. 2nd ed. London: BMJ Books; 2000.

    Google Scholar 

  • American Psychiatric Association. Diagnostic and statistical manual of mental disorders, 4th edition, text revision (DSM-IV-TR). Washington: American Psychiatric Association; 2000.

    Book  Google Scholar 

  • Armstrong MJ, Litvan I, Lang AE, et al. Criteria for the diagnosis of corticobasal degeneration. Neurology. 2013;80:496–503.

    Article  PubMed Central  PubMed  Google Scholar 

  • Bachmann LM, Puhan MA, ter Riet G, Bossuyt PM. Sample sizes of studies on diagnostic accuracy: literature survey. BMJ. 2006;332:1127–9.

    Article  PubMed Central  PubMed  Google Scholar 

  • Black WC, Armstrong P. Communicating the significance of radiologic test results: the likelihood ratio. AJR Am J Roentgenol. 1986;147:1313–8.

    Article  CAS  PubMed  Google Scholar 

  • Bossuyt PM, Reitsma JB, Bruns DE, et al. Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. BMJ. 2003a;326:41–4.

    Article  PubMed Central  PubMed  Google Scholar 

  • Bossuyt PM, Reitsma JB, Bruns DE, et al. The STARD statement for reporting studies of diagnostic accuracy: explanation and elaboration. Clin Chem. 2003b;49:7–18.

    Article  CAS  PubMed  Google Scholar 

  • Bourke GJ, Daly LE, McGilvray J. Interpretation and uses of medical statistics. 3rd ed. Oxford: Blackwell Scientific Publications; 1985.

    Google Scholar 

  • Clopper CJ, Pearson ES. The use of confidence or fiducial limits illustrated in the case of the binomial. Biometrika. 1934;26:404–13.

    Article  Google Scholar 

  • Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960;20:37–46.

    Article  Google Scholar 

  • Deeks JJ, Altman DG. Diagnostic tests 4: likelihood ratios. BMJ. 2004;329:168–9.

    Article  PubMed Central  PubMed  Google Scholar 

  • Doran M, Vinjamuri S, Collins J, Parker D, Larner AJ. SPECT perfusion imaging in the differential diagnosis of dementia: a retrospective regional audit. Int J Clin Pract. 2005;59:496–500.

    Article  CAS  PubMed  Google Scholar 

  • Dubois B, Feldman HH, Jacova C, et al. Research criteria for the diagnosis of Alzheimer’s disease: revising the NINCDS-ADRDA criteria. Lancet Neurol. 2007a;6:734–46.

    Article  PubMed  Google Scholar 

  • Dubois B, Burn D, Goetz C, et al. Diagnostic procedures for Parkinson’s disease dementia: recommendations from the Movement Disorder Society task force. Mov Disord. 2007b;22:2314–24.

    Article  PubMed  Google Scholar 

  • Emre M, Aarsland D, Brown R, et al. Clinical diagnostic criteria for dementia associated with Parkinson’s disease. Mov Disord. 2007;22:1689–707.

    Article  PubMed  Google Scholar 

  • Ghadiri-Sani M, Larner AJ. How to write a case report. Br J Hosp Med. 2014;75 (in press).

    Google Scholar 

  • Gifford DR, Cummings JL. Evaluating dementia screening tests. Methodologic standards to rate their performance. Neurology. 1999;52:224–7.

    Article  CAS  PubMed  Google Scholar 

  • Glas AS, Lijmer JG, Prins MH, Bonsel GJ, Bossuyt PM. The diagnostic odds ratio: a single indicator of test performance. J Clin Epidemiol. 2003;56:1129–35.

    Article  PubMed  Google Scholar 

  • Gorelick PB, Scuteri A, Black SE, et al. Vascular contributions to cognitive impairment and dementia: a statement for healthcare professionals from the American Heart Association/American Stroke Association. Stroke. 2011;42:2672–713.

    Article  PubMed Central  PubMed  Google Scholar 

  • Gorno-Tempini ML, Hillis AE, Weintraub S, et al. Classification of primary progressive aphasia and its variants. Neurology. 2011;76:1006–14.

    Article  PubMed Central  PubMed  Google Scholar 

  • Hand DJ. Statistics. A very short introduction. Oxford: Oxford University Press; 2008.

    Book  Google Scholar 

  • Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143:29–36.

    CAS  PubMed  Google Scholar 

  • Hanley JA, McNeil BJ. A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology. 1983;148:839–43.

    CAS  PubMed  Google Scholar 

  • Hinkle DE, Wiersma W, Jurs SG. Applied statistics for the behavioral sciences. 5th ed. New York: Houghton Mifflin; 1998.

    Google Scholar 

  • Hunter KM. Doctors’ stories. The narrative structure of medical knowledge. Princeton: Princeton University Press; 1991.

    Google Scholar 

  • Jaeschke R, Guyatt G, Sackett DL. Users’ guide to the medical literature. III. How to use an article about a diagnostic test. B. What are the results and will they help me in caring for my patients? JAMA. 1994;271:703–7.

    Article  CAS  PubMed  Google Scholar 

  • Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.

    Article  CAS  PubMed  Google Scholar 

  • Larner AJ. Proton magnetic resonance spectroscopy (1H-MRS): audit of pragmatic use in the Cognitive Function Clinic. J Neurol. 2006a;253 Suppl 2:II92 (abstract P363).

    Google Scholar 

  • Larner AJ. An audit of the Addenbrooke’s Cognitive Examination (ACE) in clinical practice. 2. Longitudinal change. Int J Geriatr Psychiatry. 2006b;21:698–9.

    Article  CAS  PubMed  Google Scholar 

  • Larner AJ. Proton magnetic resonance spectroscopy (1H-MRS): pragmatic study of Alzheimer’s disease and frontotemporal dementia. Eur J Neurol. 2008;15 Suppl 3:283 (abstract P2287).

    Google Scholar 

  • Larner AJ. ACE-R: cross-sectional and longitudinal use for cognitive assessment. In: Fisher A, Hanin I, editors. New trends in Alzheimer and Parkinson related disorders: ADPD 2009. Collection of selected free papers from the 9th international conference on Alzheimer’s and Parkinson’s disease AD/PD, Prague, 11–15 Mar 2009. Bologna: Medimond International Proceedings; 2009a. p. 103–7.

    Google Scholar 

  • Larner AJ. Addenbrooke’s Cognitive Examination-Revised: cross-sectional and longitudinal use for cognitive assessment. Neurodegen Dis. 2009b;6 Suppl 1:194.

    Google Scholar 

  • Larner AJ. Teleneurology by internet and telephone. A study in self-help. London: Springer; 2011a.

    Book  Google Scholar 

  • Larner AJ. Camptodactyly: a 10-year series. Eur J Dermatol. 2011b;21:771–5.

    PubMed  Google Scholar 

  • Larner AJ. Pragmatic diagnostic accuracy studies. http://bmj.com/content/345/bmj.e3999?tab=responses. Accessed 28 Aug 2012.

  • Larner AJ. Introduction to cognitive screening instruments: rationale, desiderata, and assessment of utility. In: Larner AJ, editor. Cognitive screening instruments. A practical approach. London: Springer; 2013. p. 1–14.

    Chapter  Google Scholar 

  • Litvan I, Agid Y, Calne D, et al. Clinical research criteria for the diagnosis of progressive supranuclear palsy (Steele-Richardson-Olszewski syndrome): report of the NINDS-SPSP International Workshop. Neurology. 1996;47:1–9.

    Article  CAS  PubMed  Google Scholar 

  • Litvan I, Goldman JG, Troster AI, et al. Diagnostic criteria for mild cognitive impairment in Parkinson’s disease: Movement Disorder Society Task Force guidelines. Mov Disord. 2012;27:349–56.

    Article  PubMed Central  PubMed  Google Scholar 

  • Llewelyn H. Likelihood ratios are not good for differential diagnosis. BMJ. 2012;344:e3660.

    Article  PubMed  Google Scholar 

  • Lusted L. Introduction to medical decision making. Springfield: Charles Thomas; 1968.

    Google Scholar 

  • Mallett S, Halligan S, Thompson M, Collins GS, Altman DG. Interpreting diagnostic accuracy studies for patient care. BMJ. 2012;344:e3999.

    Article  Google Scholar 

  • McCrea MA. Mild traumatic brain injury and postconcussion syndrome. The new evidence base for diagnosis and treatment. Oxford: Oxford University Press; 2008.

    Google Scholar 

  • McKeith IG, Galasko D, Kosaka K, et al. Consensus guidelines for the clinical and pathologic diagnosis of dementia with Lewy bodies (DLB): report of the consortium on DLB international workshop. Neurology. 1996;47:1113–24.

    Article  CAS  PubMed  Google Scholar 

  • McKeith IG, Perry EK. Perry RH for the Consortium on Dementia with Lewy Bodies. Report of the second dementia with Lewy body international workshop. Neurology. 1999;53:902–5.

    Article  CAS  PubMed  Google Scholar 

  • McKeith IG, Dickson DW, Lowe J, et al. Diagnosis and management of dementia with Lewy bodies: third report of the DLB Consortium. Neurology. 2005;65:1863–72.

    Article  CAS  PubMed  Google Scholar 

  • McKhann G, Drachman D, Folstein M, et al. Clinical diagnosis of Alzheimer’s disease. Report of the NINCDS-ADRDA work group under the auspices of the Department of Health and Human Service Task forces on Alzheimer’s disease. Neurology. 1984;34:939–44.

    Article  CAS  PubMed  Google Scholar 

  • McKhann GM, Albert MS, Grossman M, Miller B, Dickson D, Trojanowski JQ. Clinical and pathological diagnosis of frontotemporal dementia. Report of the Work Group on Frontotemporal Dementia and Pick’s disease. Arch Neurol. 2001;58:1803–9.

    Article  CAS  PubMed  Google Scholar 

  • McKhann GM, Knopman DS, Chertkow H, et al. The diagnosis of dementia due to Alzheimer’s disease: Recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer’s disease. Alzheimers Dement. 2011;7:263–9.

    Article  PubMed Central  PubMed  Google Scholar 

  • Mitchell AJ. The clinical significance of subjective memory complaints in the diagnosis of mild cognitive impairment and dementia: a meta-analysis. Int J Geriatr Psychiatry. 2008;23:1191–202.

    Article  PubMed  Google Scholar 

  • Mitchell AJ. Sensitivity × PPV is a recognized test called the clinical utility index (CUI+). Eur J Epidemiol. 2011;26:251–2.

    Article  PubMed  Google Scholar 

  • Mitchell AJ, McGlinchey JB, Young D, Chelminski I, Zimmerman M. Accuracy of specific symptoms in the diagnosis of major depressive disorder in psychiatric out-patients: data from the MIDAS project. Psychol Med. 2009;39:1107–16.

    Article  CAS  PubMed  Google Scholar 

  • National Institute for Clinical Excellence. Principles for best practice in clinical audit. Abingdon: Radcliffe Medical Press; 2002.

    Google Scholar 

  • Neary D, Snowden JS, Gustafson L, et al. Frontotemporal lobar degeneration: a consensus on clinical diagnostic criteria. Neurology. 1998;51:1546–54.

    Article  CAS  PubMed  Google Scholar 

  • Norman G, Monteiro S, Salama S. Sample size calculations: should the emperor’s clothes be off the peg or made to measure? BMJ. 2012;345:e5728.

    Google Scholar 

  • Petersen RC, Smith GE, Waring SC, Ivnik RJ, Tangalos EG, Kokmen E. Mild cognitive impairment: clinical characterization and outcome. Arch Neurol. 1999;56:303–8.

    Article  CAS  PubMed  Google Scholar 

  • Qizilbash N. Evidence-based diagnosis. In: Qizilbash N, Schneider LS, Chui H, et al., editors. Evidence-based dementia practice. Oxford: Blackwell; 2002. p. 18–25.

    Google Scholar 

  • Rascovsky K, Hodges JR, Knopman D, et al. Sensitivity of revised diagnostic criteria for the behavioural variant of frontotemporal dementia. Brain. 2011;134:2456–77.

    Article  PubMed Central  PubMed  Google Scholar 

  • Román GC, Tatemichi TK, Erkinjuntti T, et al. Vascular dementia: diagnostic criteria for research studies. Report of the NINDS-AIREN international workshop. Neurology. 1993;43:250–60.

    Article  PubMed  Google Scholar 

  • Schuetz GM, Schlattmann F, Dewey M. Use of 3x2 tables with an intention to diagnose approach to assess clinical performance of diagnostic tests: meta-analytical evaluation of coronary CT angiography studies. BMJ. 2012;345:e6717.

    Article  PubMed Central  PubMed  Google Scholar 

  • Smith GE, Bondi MW. Mild cognitive impairment and dementia. Definitions, diagnosis, and treatment. Oxford: Oxford University Press; 2013.

    Google Scholar 

  • Sperling RA, Aisen PS, Beckett LA, et al. Toward defining the preclinical stages of Alzheimer’s disease: Recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer’s disease. Alzheimers Dement. 2011;7:280–92.

    Article  PubMed Central  PubMed  Google Scholar 

  • Swets JA. Measuring the accuracy of diagnostic systems. Science. 1988;240:1285–93.

    Article  CAS  PubMed  Google Scholar 

  • Swinscow TDV. Statistics at square one. 8th ed. London: BMJ Books; 1983.

    Google Scholar 

  • The Ronald and Nancy Reagan Research Institute of the Alzheimer’s Association and the National Institute on Aging Working Group. Consensus report of the Working Group on: “Molecular and biochemical markers of Alzheimer’s disease”. Neurobiol Aging. 1998;19:109–16.

    Google Scholar 

  • Whiting P, Rutjes AW, Reitsma JB, Glas AS, Bossuyt PM, Kleijnen J. Sources of variation and bias in studies of diagnostic accuracy: a systematic review. Ann Intern Med. 2004a;140:189–202.

    Article  PubMed  Google Scholar 

  • Whiting P, Rutjes AW, Dinnes J, Reitsma J, Bossuyt PM, Kleijnen J. Development and validation of methods for assessing the quality of diagnostic accuracy studies. Health Technol Assess. 2004b;8:iii, 1–234.

    CAS  PubMed  Google Scholar 

  • Winblad B, Palmer K, Kivipelto M, et al. Mild cognitive impairment – beyond controversies, towards a consensus: report of the International Working Group on Mild Cognitive Impairment. J Int Med. 2004;256:240–6.

    Article  CAS  Google Scholar 

  • Youden WJ. Index for rating diagnostic tests. Cancer. 1950;3:32–5.

    Article  CAS  PubMed  Google Scholar 

  • Zerr I, Kallenberg K, Summers DM, et al. Updated clinical diagnostic criteria for sporadic Creutzfeldt-Jakob disease. Brain. 2009;132:2659–68 [Erratum Brain. 2012;135:1335].

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  • Zweig MH, Campbell G. Receiver-operating characteristic (ROC) plots: a fundamental tool in clinical medicine. Clin Chem. 1993;39:561–77.

    CAS  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Cognitive Function Clinic, Walton Centre for Neurology and Neurosurgery, Liverpool, UK

    A. J. Larner

Authors
  1. A. J. Larner
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer-Verlag London Limited

About this chapter

Cite this chapter

Larner, A.J. (2014). A Brief Note on Methodology: Pragmatic Diagnostic Accuracy Studies. In: Dementia in Clinical Practice: A Neurological Perspective. Springer, London. https://doi.org/10.1007/978-1-4471-6371-8_2

Download citation

  • DOI: https://doi.org/10.1007/978-1-4471-6371-8_2

  • Published:

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-4471-6370-1

  • Online ISBN: 978-1-4471-6371-8

  • eBook Packages: MedicineMedicine (R0)

Publish with us

Policies and ethics

Search

Navigation