Skip to main content
SpringerLink
Log in

Pearls and Pitfalls in Gold Standards and Biological Correlation

  • Chapter
  • First Online:
Imaging Biomarkers

  • 1116 Accesses

Abstract

The pitfalls relating to the validation of imaging biomarkers are discussed including the identifying suitable reference standards, the effects of the imperfect reference standard, strategies to handle imperfect “gold standards” and how to achieve the best possible validation. These topics are illustrated by reference to three currently used markers: MR elastography as a surrogate marker of liver fibrosis stage, CT colonography detected adenomas as an imaging biomarker of colon cancer risk and CT perfusion metrics as imaging biomarkers of tumour blood supply.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 129.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Aboagye EO, Gilbert FJ, Fleming IN, Experimental Cancer Medicine Centre Imaging Network Group, et al. Recommendations for measurement of tumour vascularity with positron emission tomography in early phase clinical trials. Eur Radiol. 2012;22:1465–78.

    Article  PubMed  Google Scholar 

  2. Al-Mallah MH, Sitek A, Moore SC, et al. Assessment of myocardial perfusion and function with PET and PET/CT. J Nucl Cardiol. 2010;17:498–513.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Atkin W, Dadswell E, Wooldrage K, et al. Computed tomographic colonography versus colonoscopy for investigation of patients with symptoms suggestive of colorectal cancer (SIGGAR): a multicentre randomised trial. Lancet. 2013;381:1194–202.

    Article  PubMed  Google Scholar 

  4. Bathon JM, Martin RW, Fleischmann RM, et al. A comparison of etanercept and methotrexate in patients with early rheumatoid arthritis. N Engl J Med. 2001;343:1586–93.

    Article  Google Scholar 

  5. Bisdas S, Rumboldt Z, Surlan-Popovic K, et al. Perfusion CT in squamous cell carcinoma of the upper aerodigestive tract: long-term predictive value of baseline perfusion CT measurements. AJNR Am J Neuroradiol. 2010;31:576–81.

    Article  CAS  PubMed  Google Scholar 

  6. Bravo AA, Sheth SG, Chopra S. Liver biopsy. N Engl J Med. 2001;344:495–500.

    Article  CAS  PubMed  Google Scholar 

  7. The Cardiac Arrhythmia Suppression Trial (CAST) Investigators. Preliminary report: effect of encainide and flecainide on mortality in a randomized trial of arrhythmia suppression after myocardial infarction. N Engl J Med. 1989;321:406–12.

    Article  Google Scholar 

  8. Choi H, Charnsangavej C, Faria SC, et al. Correlation of computed tomography and positron emission tomography in patients with metastatic gastrointestinal stromal tumor treated at a single institution with imatinib mesylate: proposal of new computed tomography response criteria. J Clin Oncol. 2007;25:1753–9.

    Article  PubMed  Google Scholar 

  9. Chu DZ, Giacco G, Martin RG, et al. The significance of synchronous carcinoma and polyps in the colon and rectum. Cancer. 1986;57:445–50.

    Article  CAS  PubMed  Google Scholar 

  10. Clark JC, Collan Y, Eide TJ, et al. Prevalence of polyps in an autopsy series from areas with varying incidence of large-bowel cancer. Int J Cancer. 1985;36:179–86.

    Article  CAS  PubMed  Google Scholar 

  11. de Haan MC, Pickhardt PJ, Stoker J. CT colonography: accuracy, acceptance, safety and position in organised population screening. Gut. 2015;64:342–50.

    Article  PubMed  Google Scholar 

  12. Dighe S, Blake H, Jeyadevan N, et al. Perfusion CT vascular parameters do not correlate with immunohistochemically derived microvessel density count in colorectal tumors. Radiology. 2013;268:400–10.

    Article  PubMed  Google Scholar 

  13. Eide TJ. Remnants of adenomas in colorectal carcinomas. Cancer. 1983;51:1866–72.

    Article  CAS  PubMed  Google Scholar 

  14. Everhart JE, Wright EC, Goodman ZD, et al. Prognostic value of Ishak fibrosis stage: findings from the hepatitis C antiviral long-term treatment against cirrhosis trial. Hepatology. 2010;51:585–94.

    Article  PubMed  Google Scholar 

  15. Fearon ER, Vogelstein B. A genetic model for colorectal tumorigenesis. Cell. 1990;61:759–67.

    Article  CAS  PubMed  Google Scholar 

  16. Friedenberg MA, Miller L, Chung CY, et al. Simplified method of hepatic fibrosis quantification: design of a new morphometric analysis application. Liver Int. 2005;25:1156–61.

    Article  PubMed  Google Scholar 

  17. Friedrich-Rust M, Ong MF, Martens S, et al. Performance of transient elastography for the staging of liver fibrosis: a meta-analysis. Gastroenterology. 2008;134:960–74.

    Article  PubMed  Google Scholar 

  18. Gillespie PE, Chambers TJ, Chan KW, et al. Colonic adenomas – a colonoscopy survey. Gut. 1979;20:240–5.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  19. Goh V, Ng QS, Miles K. Computed tomography perfusion imaging for therapeutic assessment: has it come of age as a biomarker in oncology? Invest Radiol. 2012;47:2–4.

    Article  PubMed  Google Scholar 

  20. Gold R, Reichman M, Greenberg E, et al. Developing a new reference standard. Acad Radiol. 2010;17:1079–82.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Goodman ZD, Becker Jr RL, Pockros PJ, et al. Progression of fibrosis in advanced chronic hepatitis C: evaluation by morphometric image analysis. Hepatology. 2007;45:886–94.

    Article  CAS  PubMed  Google Scholar 

  22. Grüner JM, Paamand R, Kosteljanetz M, et al. Brain perfusion CT compared with 15O-H2O PET in patients with primary brain tumours. Eur J Nucl Med Mol Imaging. 2012;39:1691–701.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Grüner JM, Paamand R, Højgaard L, et al. Brain perfusion CT compared with 15O-H2O-PET in healthy subjects. EJNMMI Res. 2011;1:28.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Haldorsen IS, Grüner R, Husby JA, et al. Dynamic contrast-enhanced MRI in endometrial carcinoma identifies patients at increased risk of recurrence. Eur Radiol. 2013;23:2916–25.

    Article  PubMed  Google Scholar 

  25. Hamilton Bailey’s demonstration of physical signs in clinical surgery. Chapter 35. 19th Edition. Editors: Lumley JSP, D’Cruz AK, Hoballah JJ et al. 2016. CRC Press.

    Google Scholar 

  26. Halligan S, Wooldrage K, Dadswell E, et al. Computed tomographic colonography versus barium enema for diagnosis of colorectal cancer or large polyps in symptomatic patients (SIGGAR): a multicentre randomised trial. Lancet. 2013;381:1185–93.

    Article  PubMed  Google Scholar 

  27. Heresback D, Djabbari M, Riou F, et al. Accuracy of computed tomographic colonography in a nationwide multicenter trial, and its relation to radiologist expertise. Gut. 2011;60:658–65.

    Article  Google Scholar 

  28. Hlatky L, Hahnfeldt P, Folkman J. Clinical application of antiangiogenic therapy: microvessel density, what it does and doesn’t tell us. J Natl Cancer Inst. 2002;94:883–93.

    Article  PubMed  Google Scholar 

  29. Ishak K, Baptista A, Bianchi L, et al. Histological grading and staging of chronic hepatitis. J Hepatol. 1995;22:696–9.

    Article  CAS  PubMed  Google Scholar 

  30. Jensch S, de Vries AH, Peringa J, et al. CT colonography with limited bowel preparation: performance characteristics in an increased-risk population. Radiology. 2008;247:122–32.

    Article  PubMed  Google Scholar 

  31. Kaminski MF, Anderson J, Valori R, et al. Leadership training to improve adenoma detection rate in screening colonoscopy: a randomized trial. Gut. 2016;65(4):616–24.

    Google Scholar 

  32. Kim AH, Kamaya A, Willmann JK. CT Perfusion of the Liver: Principles and Applications in Oncology Radiology. 2014;272:322-344.

    Google Scholar 

  33. Köksal AŞ, Kalkan IH, Torun S, et al. A simple method to improve adenoma detection rate during colonoscopy: altering patient position. Can J Gastroenterol. 2013;27:509–12.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Lapalus MG, Helbert T, Napoleon B, et al. Does chromoendoscopy with structure enhancement improve the colonoscopic adenoma detection rate? Endoscopy. 2006;38:444–8.

    Article  PubMed  Google Scholar 

  35. Lenze F, Beyna T, Lenz P, et al. Endocuff-assisted colonoscopy: a new accessory to improve adenoma detection rate? technical aspects and first clinical experiences. Endoscopy. 2014;46:610–4.

    Article  PubMed  Google Scholar 

  36. Lemoine S, Papillard M, Belloi A, et al. Renal perfusion: noninvasive measurement with multidetector CT versus fluorescent microspheres in a pig model. Radiology. 2011;260:414–20.

    Article  PubMed  Google Scholar 

  37. Li SP, Makris A, Gogbashian A, et al. Predicting response to neoadjuvant chemotherapy in primary breast cancer using volumetric helical perfusion computed tomography: a preliminary study. Eur Radiol. 2012;22:1871–80.

    Article  PubMed  Google Scholar 

  38. Liedenbaum MH, de Vries AH, van Rijn AF, et al. CT colonography with limited bowel preparation for the detection of colorectal neoplasia in an FOBT positive screening population. Abdom Imaging. 2010;35:661–8.

    Article  PubMed  Google Scholar 

  39. Materne R, Van Beers BE, Smith AM, et al. Non-invasive quantification of liver perfusion with dynamic computed tomography and a dual-input one-compartmental model. Clin Sci (Lond). 2000;99:517–25.

    Article  CAS  Google Scholar 

  40. Mazza E, Nava A, Hahnloser D, et al. The mechanical response of human liver and its relation to histology: An in vivo study. Medical Image Analysis. 2007;11:663–672.

    Google Scholar 

  41. Miles KA, Lee TY, Goh V, Experimental Cancer Medicine Centre Imaging Network Group, et al. Current status and guidelines for the assessment of tumour vascular support with dynamic contrast-enhanced computed tomography. Eur Radiol. 2012;22:1430–41.

    Article  CAS  PubMed  Google Scholar 

  42. Miller E, Huppert A, Novikov I, et al. Estimation of infection prevalence and sensitivity in a stratified two-stage sampling design employing highly specific diagnostic tests when there is no gold standard. Stat Med. 2015;34(25);3349-61.

    Google Scholar 

  43. Morsbach F, Pfammatter T, Reiner CS, et al. Computed tomographic perfusion imaging for the prediction of response and survival to transarterial radioembolization of liver metastases. Invest Radiol. 2013;48:787–94.

    Article  PubMed  Google Scholar 

  44. Motosugi U, Ichikawa T, Koshiishi T, et al. Liver stiffness measured by magnetic resonance elastography as a risk factor for hepatocellular carcinoma: a preliminary case-control study. Eur Radiol. 2013;23:156–62.

    Article  PubMed  Google Scholar 

  45. Nassif A, Jia J, Keiser M, et al. Visualization of hepatic uptake transporter function in healthy subjects by using gadoxetic acid-enhanced MR imaging. Radiology. 2012;264:741–50.

    Article  PubMed  Google Scholar 

  46. Nava A, Mazza E, Furrer M, et al. In vivo mechanical characterization of human liver. Med Image Anal. 2008;12:203–16.

    Article  CAS  PubMed  Google Scholar 

  47. Nissen SE, Wolski K. Effect of rosiglitazone on the risk of myocardial infarction and death from cardiovascular causes. N Engl J Med. 2007;356:2457–71.

    Article  CAS  PubMed  Google Scholar 

  48. O’Brien MJ, Keating NM, Elderiny S, et al. An assessment of digital image analysis to measure fibrosis in liver biopsy specimens of patients with chronic hepatitis C. Am J Clin Pathol. 2000;114:712–8.

    Article  PubMed  Google Scholar 

  49. Okubo H, Mogami M, Ozaki Y, et al. Liver function test by gadolinium-ethoxybenzyl-diethylenetriaminepentaacetic acid-enhanced magnetic resonance imaging with consideration of intrahepatic regional differences. Hepatogastroenterology. 2013;60:1547–51.

    PubMed  Google Scholar 

  50. Pang JX, Zimmer S, Niu S, et al. Liver stiffness by transient elastography predicts liver-related complications and mortality in patients with chronic liver disease. PLoS One. 2014;9:e95776.

    Article  PubMed  PubMed Central  Google Scholar 

  51. Park SH, Lee JH, Lee SS, et al. CT colonography for detection and characterisation of synchronous proximal colonic lesions in patients with stenosing colorectal cancer. Gut. 2012;61:1716–22.

    Article  PubMed  Google Scholar 

  52. Parsons MW, Pepper EM, Chan V, et al. Perfusion computed tomography: prediction of final infarct extent and stroke outcome. Ann Neurol. 2005;58(5):672–9.

    Article  PubMed  Google Scholar 

  53. Pickhardt PJ, Nugent PA, Mysliwiec PA, Choi JR, Schindler WR. Location of adenomas missed by optical colonoscopy. Ann Intern Med. 2004;141(5):352–9.

    Article  PubMed  Google Scholar 

  54. Pooler BD, Kim DH, Weiss JM, et al. Colorectal polyps missed with optical colonoscopy despite previous detection and localization with CT colonography. Radiology. 2016;278(2):422–9.

    Article  PubMed  Google Scholar 

  55. Poynard T, Ingiliz P, Elkrief L, et al. Concordance in a world without a gold standard: a new non-invasive methodology for improving accuracy of fibrosis markers. PLoS One. 2008;3:1–8.

    Article  Google Scholar 

  56. Poynard T, De Ledinghen V, Zarski JP, et al. Relative performances of FibroTest, Fibroscan, and biopsy for the assessment of the stage of liver fibrosis in patients with chronic hepatitis C: a step toward the truth in the absence of a gold standard. J Hepatol. 2012;56:541–8.

    Article  PubMed  Google Scholar 

  57. Regev A, Berho M, Jeffers LJ, et al. Sampling error and intraobserver variation in liver biopsy in patients with chronic HCV infection. Am J Gastroenterol. 2002;97:2614–8.

    Article  PubMed  Google Scholar 

  58. Rex DK, Cutler CS, Lemmel GT, et al. Colonoscopic miss rates of adenomas determined by back-to-back colonoscopies. Gastroenterology. 1997;112:24–8.

    Article  CAS  PubMed  Google Scholar 

  59. Ronot M, Lambert S, Elkrief L, et al. Assessment of portal hypertension and high-risk oesophageal varices with liver and spleen three-dimensional multifrequency MR elastography in liver cirrhosis. Eur Radiol. 2014;24:1394–402.

    PubMed  Google Scholar 

  60. Selby JV, Friedman GD, Quesenberry Jr CP, et al. A case-control study of screening sigmoidoscopy and mortality from colorectal cancer. N Engl J Med. 1992;326:653–7.

    Article  CAS  PubMed  Google Scholar 

  61. Shaukat A, Oancea C, Bond JH, et al. Variation in detection of adenomas and polyps by colonoscopy and change over time with a performance improvement program. Clin Gastroenterol Hepatol. 2009;7:1335–40.

    Article  PubMed  Google Scholar 

  62. Shin SU, Lee JM, Yu MH, et al. Prediction of esophageal varices in patients with cirrhosis: usefulness of three-dimensional MR elastography with echo-planar imaging technique. Radiology. 2014;272:143–53.

    Google Scholar 

  63. Singh S, Venkatesh SK, Wang Z, et al. Diagnostic performance of magnetic resonance elastography in staging liver fibrosis: a systematic review and meta-analysis of individual participant data. Clin Gastroenterol Hepatol. 2015;13:440–51.

    Article  PubMed  Google Scholar 

  64. Singh S, Fujii LL, Murad MH, et al. Liver stiffness is associated with risk of decompensation, liver cancer, and death in patients with chronic liver diseases: a systematic review and meta-analysis. Clin Gastroenterol Hepatol. 2013;11:1573–84.

    Google Scholar 

  65. So A, Hsieh J, Li JY, et al. Quantitative myocardial perfusion measurement using CT perfusion: a validation study in a porcine model of reperfused acute myocardial infarction. Int J Cardiovasc Imaging. 2012;28:1237–48.

    Article  PubMed  Google Scholar 

  66. Stryker SJ, Wolff BG, Culp CE, et al. Natural history of untreated colonic polyps. Gastroenterology. 1987;93:1009–13.

    Article  CAS  PubMed  Google Scholar 

  67. Sun HY, Lee JM, Han JK, et al. Usefulness of MR elastography for predicting esophageal varices in cirrhotic patients. J Magn Reson Imaging. 2014;39:559–66.

    Article  PubMed  Google Scholar 

  68. Teng TY, Khor SN, Kailasam M, et al. Morning colonoscopies are associated with improved adenoma detection rates. Surg Endosc. 2016;30(5):1796–803.

    Article  PubMed  Google Scholar 

  69. Verloh N, Haimerl M, Zeman F, et al. Assessing liver function by liver enhancement during the hepatobiliary phase with Gd-EOB-DTPA-enhanced MRI at 3 Tesla. Eur Radiol. 2014;24:1013–9.

    Article  CAS  PubMed  Google Scholar 

  70. Waikar SS, Betensky RA, Emerson SC, et al. Imperfect gold standards for kidney injury biomarker evaluation. J Am Soc Nephrol. 2012;23:13–21.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  71. Walter SD, MacAskill P, Lord SJ, et al. Effect of dependent errors in the assessment of diagnostic or screening test accuracy when the reference standard is imperfect. Stat Med. 2012;31(11–12):1129–38.

    Article  CAS  PubMed  Google Scholar 

  72. Ward ST, Mohammed MA, Walt R, et al. An analysis of the learning curve to achieve competency at colonoscopy using the JETS database. Gut. 2014;63:1746–54.

    Article  PubMed  PubMed Central  Google Scholar 

  73. Yeung TP, Wang Y, He W, Project of Emilia-Romagna Region on Neuro-Oncology Study Group, et al. Survival prediction in high-grade gliomas using CT perfusion imaging. J Neurooncol. 2015;123:93–102.

    Article  CAS  PubMed  Google Scholar 

  74. Yoon JH, Lee JM, Paek M, et al. Quantitative assessment of hepatic function: modified look-locker inversion recovery (MOLLI) sequence for T1 mapping on Gd-EOB-DTPA-enhanced liver MR imaging. Eur Radiol. 2016;26(6):1775–82.

    Article  PubMed  Google Scholar 

  75. Yoshie T, Ueda T, Takada T, et al. Prediction of cerebral hyperperfusion syndrome after carotid artery stenting by CT perfusion imaging with acetazolamide challenge. Neuroradiology. 2016;58(3):253–9.

    Article  PubMed  Google Scholar 

  76. Zussman BM, Boghosian G, Gorniak RJ, et al. The relative effect of vendor variability in CT perfusion results: a method comparison study. AJR Am J Roentgenol. 2011;197:468–73.

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Radiology, University of Cambridge, Cambridge, UK

    David J. Lomas

  2. Department of Radiology, Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK

    Edmund Godfrey

Authors
  1. David J. Lomas
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Edmund Godfrey
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to David J. Lomas .

Editor information

Editors and Affiliations

  1. La Fe University and Polithecnic Hospital, University of Valencia, Valencia, Spain

    Luis Martí-Bonmatí

  2. La Fe University and Polithecnic Hospital, University of Valencia, Valencia, Spain

    Angel Alberich-Bayarri

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Lomas, D.J., Godfrey, E. (2017). Pearls and Pitfalls in Gold Standards and Biological Correlation. In: Martí-Bonmatí, L., Alberich-Bayarri, A. (eds) Imaging Biomarkers. Springer, Cham. https://doi.org/10.1007/978-3-319-43504-6_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-43504-6_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-43502-2

  • Online ISBN: 978-3-319-43504-6

  • eBook Packages: MedicineMedicine (R0)

Publish with us

Policies and ethics

Search

Navigation