Skip to main content

Advertisement

SpringerLink
Log in

Research Methodology Evaluating Complementary and Alternative Therapies

  • Published:
Drug information journal : DIJ / Drug Information Association Aims and scope Submit manuscript

Abstract

Complementary and alternative medicine (CAM) represents an opportunity to expand tools for assisting patients with health care issues, retain or increase market share by proactively responding to consumers, and increase our understanding of interventions outside of conventional medicine. CAM research is a flourishing area that is currently receiving a new focus as a result of the creation of recognized CAM research centers in university settings worldwide. Several botanical products, complex CAM interventions and individual approaches are now being tested with rigorous and well-controlled research. Adequate execution of clinical trials, however, represents a major challenge, particularly in medical fields such as pediatrics and CAM therapies such as acupuncture and herbal medicine.

The scientific community, industry, and consumers are joining efforts to provide reliable and objective information about the efficacy and safety of CAM therapies. Medical journals are publishing CAM-related issues regularly and there is concern about quality of clinical trials, reliability of results, placebo effect, and publication bias. The number of CAM clinical trials continues to grow although it is still very low compared with conventional medicine trials. There are major research methodology issues that need to be considered in CAM research that have not been completely and thoroughly evaluated. Nevertheless, ideas have been proposed and innovative projects are ongoing. The conduct of CAM research requires the commitment of the scientific community as well as substantial funding from governmental institutions and the pharmaceutical industry.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Malik IA, Khan NA, Khan W. Use of unconventional methods of therapy by cancer patients in Pakistan. Eur J Epidemiol. 2000;16(2):155–160.

    Article  CAS  PubMed  Google Scholar 

  2. Wootton JC. Sparber A. Surveys of complementary and alternative medicine: part I. General trends and demographic groups. J Altern Complement Med. 2001;7(2):195–208.

    Article  CAS  PubMed  Google Scholar 

  3. Thomas KJ, Nicholl JP, Coleman P. Use and expenditure on complementary medicine in England: a population based survey. Complement Ther Med. 2001;9(1):2–11.

    Article  CAS  PubMed  Google Scholar 

  4. Eisenberg DM, Davis RB, Ettner SL. Appel S, Wilkey S. Van Rompay M. et al. Trends in alternative medicine use in the United States, 1990–1997: Results of a follow-up national survey. JAMA. 1998;280(18):1569–1575.

    Article  CAS  PubMed  Google Scholar 

  5. Fisher P, Ward A. Complementary medicine in Europe. Br Med J. 1994;309(6947):107–111.

    Article  CAS  Google Scholar 

  6. MacLennan AH, Wilson DH. Taylor AW. Prevalence and cost of alternative medicine in Australia. Lancet. 1996; 347(9001):569–573.

    Article  CAS  PubMed  Google Scholar 

  7. Archer C. Research issues in complementary therapies. Complement Ther Nurs Midwifery. 1999;5(4):108–114.

    Article  CAS  PubMed  Google Scholar 

  8. Astin JA, Marie A, Pelletier KR, Hansen E. Haskell WL. A review of the incorporation of complementary and alternative medicine by mainstream physicians. Arch Intern Med. 1998;158(21):2303–2310.

    Article  CAS  PubMed  Google Scholar 

  9. Kessler RC, Davis RB, Foster DF, Van Rompay MI, Walters EE, Wilkey SA, et al. Long-term trends in the use of complementary and alternative medical therapies in the United States. Ann Intern Med. 2001;135(4):262–268.

    Article  CAS  PubMed  Google Scholar 

  10. Emst E. Research into complementary/alternative medicine: an attempt to dispel the myths. Int J Clin Pract. 2001;55(6):376–379.

    Google Scholar 

  11. Mills SY. The House of Lords report on complementary medicine: a summary. Complement Ther Med. 2001;9(1):34–39.

    Article  CAS  PubMed  Google Scholar 

  12. Nahin RL, Straus SE. Research into complementary and alternative medicine: problems and potential. Br Med J. 2001;20;322(7279):161–164.

    Article  CAS  Google Scholar 

  13. Muscat M. Straus gives state of the center, CAM on PUBMED unveiled. Altern Ther Health Med. 2001;7(2):23–26.

    CAS  PubMed  Google Scholar 

  14. Bensoussan A. Complementary medicine. Searching for the evidence. Aust Fam Physician. 2000;29(12):1129–1133

    CAS  PubMed  Google Scholar 

  15. Vickers A. Recent advances: complementary medicine. Br Med J. 2000;321(7262):683–686.

    Article  CAS  Google Scholar 

  16. Dougherty K, Touger-Decker R, O’Sullivan MJ. Personal and professional beliefs and practices regarding herbal medicine among the full time faculty of the Newark-based schools of the University of Medicine and Dentistry of New Jersey. Integrative Med. 2000;2(2):57–64.

    Article  CAS  Google Scholar 

  17. Haynes B. Can it work? Does it work? Is it worth it? The testing of healthcare interventions is evolving. Br Med J. 1999;319(7211):652–653.

    Article  CAS  Google Scholar 

  18. Barnes J, Abbot NC, Harkness EF, Ernst E. Articles on complementary medicine in the mainstream medical literature: an investigation of MEDLINE, 1966 through 1996. Arch Intern Med. 1999;159(15):1721–1725.

    Article  CAS  PubMed  Google Scholar 

  19. Vickers AJ. Bibliometric analysis of randomised controlled trials in complementary medicine. Complement Ther Med. 1998;(6):185–189.

    Google Scholar 

  20. Eisenberg DM, et al. Unconventional Medicine in the United States: Prevalence, Cost, Patterns of Usage. New Engl J Med. 1993;328:246–252

    Article  CAS  PubMed  Google Scholar 

  21. Beyerstein BL. Alternative medicine and common errors of reasoning. Acad Med. 2001;76(3):230–237.

    Article  CAS  PubMed  Google Scholar 

  22. Bostrom H. Placebo—the forgotten drug. Scand J Work Environ Health. 1997;23 Suppl 3:53–57.

    PubMed  Google Scholar 

  23. Vickers A. Methodological issues in complementary and alternative medicine research: a personal reflection on 10 years of debate in the United Kingdom. J Altern Complement Med. 1996;2(4):515–524.

    Article  CAS  PubMed  Google Scholar 

  24. Levin JS. Glass TA, Kushi LH, Schuck JR, Steele L, Jonas WB. Quantitative methods in research on complementary and alternative medicine. A methodological manifesto. NIH Office of Alternative Medicine. Med Care. 1997:35(11):1079–1094.

    Article  CAS  PubMed  Google Scholar 

  25. Enkin MW, Jadad AR. Using anecdotal information in evidence-based health care: heresy or necessity? Ann Oncol. 1998;9(9):963–966.

    Article  CAS  PubMed  Google Scholar 

  26. Redelmeier DA, Rozin P, Kahneman D. Understanding patients’ decisions. Cognitive and emotional perspectives. JAMA. 1993;270(1):72–76.

    Article  CAS  PubMed  Google Scholar 

  27. Benson K, Hartz AJ. A comparison of observational studies and randomized, controlled trials. N Engl J Med. 2000;342(25):1878–1886.

    Article  CAS  PubMed  Google Scholar 

  28. Gill P, Dowell AC, Neal RD, Smith N, Heywood P, Wilson AE. Evidence based general practice: a retrospective study of interventions in one training practice. Br Med J. 1996;312(7034):819–821.

    Article  CAS  Google Scholar 

  29. Sackett DL, Cook DJ. Can we learn anything from small trials? Ann N Y Acad Sci. 1993;703:25–31; discussion 31–2.:25–31.

    Article  CAS  PubMed  Google Scholar 

  30. Jadad A. Types of randomised controlled trials, In: Randomised Controlled Trials. A User’s Guide. Chapter 2. London: BMJ Books; 1998.

    Google Scholar 

  31. Jadad AR, Rennie D. The randomized controlled trial gets a middle-aged checkup. JAMA. 1998;279(4):319–320.

    Article  CAS  PubMed  Google Scholar 

  32. Gould AL. Another view of active-controlled trials. Control Clin Trials. 1991;12(4):474–485.

    Article  CAS  PubMed  Google Scholar 

  33. Resch K. Pragmatic randomised controlled trials for complex therapies. Forsch Komplementarmed. 1998; 5 Suppl SI: 136–139.:136–139.

    PubMed  Google Scholar 

  34. Abel U, Koch A. The role of randomization in clinical studies: myths and beliefs. J Clin Epidemiol. 1999;52(6):487–497.

    Article  CAS  PubMed  Google Scholar 

  35. Wilson GT. The clinical utility of randomized controlled trials. Int J Eat Disord. 1998;24(1):13–29.

    Article  CAS  PubMed  Google Scholar 

  36. Britton A, McKee M, Black N, McPherson K, Sanderson C, Bain C. Threats to applicability of randomised trials: exclusions and selective participation. J Health Serv Res Policy. 1999;4(2):112–121.

    Article  CAS  PubMed  Google Scholar 

  37. Herman J. Shortcomings of the randomized controlled trial: a view from the boondocks. J Eval Clin Pract. 1998;4(4):283–286.

    Article  CAS  PubMed  Google Scholar 

  38. Bottomley A. To randomise or not to randomise: methodological pitfalls of the RCT design in psychosocial intervention studies. Eur J Cancer Care. 1997; 6(3):222–230.

    Article  CAS  Google Scholar 

  39. Vijan S, Kent DM, Hayward RA. Are randomized controlled trials sufficient evidence to guide clinical practice in type II (non-insulin-dependent) diabetes mellitus? Diabetologia. 2000;43(1):125–130.

    Article  CAS  PubMed  Google Scholar 

  40. Clarke GN. Improving the transition from basic efficacy research to effectiveness studies: methodological issues and procedures. J Consult Clin Psychol. 1995;63(5):718–725.

    Article  CAS  PubMed  Google Scholar 

  41. Wells KB. Treatment research at the crossroads: the scientific interface of clinical trials and effectiveness research. Am J Psychiatry. 1999;156(1):5–10.

    Article  CAS  PubMed  Google Scholar 

  42. Hotopf M, Churchill R, Lewis G. Pragmatic randomised controlled trials in psychiatry. Br J Psychiatry. 1999;175:217–23.:217–223.

    Article  CAS  PubMed  Google Scholar 

  43. Hotopf M, Lewis G, Normand C. Putting trials on trial—the costs and consequences of small trials in depression: a systematic review of methodology. J Epidemiol Community Health. 1997:51(4):354–358.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  44. Hilsden RJ, Verhoef MJ. Complementary and alternative medicine: evaluating its effectiveness in inflammatory bowel disease. Inflamm Bowel Dis. 1998;4(4):318–323.

    Article  CAS  PubMed  Google Scholar 

  45. Vickers A. A basic introduction to medical research. Part I: What is research and why do it? Complement TherNurs Midwifery. 1995:1(3):85–88.

    Article  CAS  Google Scholar 

  46. Jacobson JS, Workman SB, Kronenberg F. Research on complementary and alternative therapies for cancer: issues and methodological considerations. J Am Med Womens Assoc. 1999;54(4):177–80, 183.

    CAS  Google Scholar 

  47. Walker LG, Anderson J. Testing complementary and alternative therapies within a research protocol. Eur J Cancer. 1999;35(11):1614–1618.

    Article  CAS  PubMed  Google Scholar 

  48. Rudolf MC, Lyth N, Bundle A, Rowland G, Kelly A, Bosson S et al. A search for the evidence supporting community paediatric practice. Arch Dis Child. 1999;80(3):257–261.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  49. Geddes JR, Game D, Jenkins NE. Peterson LA, Pottinger GR, Sackett DL. What proportion of primary psychiatric interventions are based on evidence from randomised controlled trials? Qual Health Care. 1996;5(4):215–217.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  50. Sackett DL, Wennberg JE. Choosing the best research design for each question. Br Med J. 1997;20-27:315(7123):1636.

    Article  CAS  Google Scholar 

  51. Vickers A, Cassileth B. Emst E, Fisher P, Goldman P, Jonas W, et al. How should we research unconventional therapies? A panel report from the Conference on Complementary and Alternative Medicine Research Methodology, National Institutes of Health. Int J Technol Assess Health Care. 1997;13(1):111–121.

    Article  CAS  PubMed  Google Scholar 

  52. Vickers A. The NIH Methodology Conference: the methodology debate in the United Kingdom during the past ten years. J Altern Complement Med. 1995;1(2):209–212.

    Article  CAS  PubMed  Google Scholar 

  53. Silverman WA, Chalmers I. Sir Austin Bradford Hill: an appreciation. Control Clin Trials. 1992;13(2):100–105.

    Article  CAS  PubMed  Google Scholar 

  54. Moher D. Schulz KF. Altman DG. Upage L. The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials. Lancet. 2001:357(9263):1191–1194.

    Article  CAS  PubMed  Google Scholar 

  55. White A, Ernst E. The case for uncontrolled clinical trials: a starting point for the evidence base for CAM. Complement Ther Med. 2001;9(2):111–116.

    Article  CAS  PubMed  Google Scholar 

  56. Guyatt G. Sackett D, Taylor DW, Chong J, Roberts R, Pugsley S. Determining optimal therapy—randomized trials in individual patients. N Engl J Med. 1986;314(14):889–892.

    Article  CAS  PubMed  Google Scholar 

  57. Cook DJ. Randomized trials in single subjects: the N of 1 study. Psychopharmacol Bull. 1996;32(3):363–367.

    CAS  PubMed  Google Scholar 

  58. Guyatt GH, Keller JL, Jaeschke R, Rosenbloom D, Adachi JD, Newhouse MT. The n-of-1 randomized controlled trial: clinical usefulness. Our three-year experience. Ann Intern Med. 1990;112(4):293–299.

    Article  CAS  PubMed  Google Scholar 

  59. Sackett DL, Haynes RB. Guyatt GH, Tugwell P. Clinical Epidemiology: A Basic Science for Clinical Medicine. 2nd ed. New York, NY: Little, Brown & Company; 1991.

    Google Scholar 

  60. Ernst E, Resch KL. The “optional cross-over design” for randomized controlled trials. Fundam Clin Pharmacol. 1995;9(5):508–511.

    Article  CAS  PubMed  Google Scholar 

  61. Chadwick D. Monotherapy comparative trials: equivalence and differences in clinical trials. Epilepsy Res. 2001;45(1–3):101–103.

    Article  CAS  PubMed  Google Scholar 

  62. Chadwick D. Better comparisons of antiepileptic drugs: what measures of efficacy? Pharm World Sci. 1997;19(5):214–216.

    Article  CAS  PubMed  Google Scholar 

  63. Bero LA, Jadad AR. How consumers and policymakers can use systematic reviews for decision making. Ann Intern Med. 1997;127(1):37–42.

    Article  CAS  PubMed  Google Scholar 

  64. Jadad AR. Randomised Controlled Trials: A User’s Guide. London, United Kingdom: BMJ Books; 1998.

    Google Scholar 

  65. Kemper KJ. Complementary and alternative medicine for children: does it work? Arch Dis Child. 2001;84(1):6–9.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  66. Eisenberg DM, Kesslcr RC, Van Rompay MI, Kaptchuk TJ, Wilkey SA, Appel S. et al. Perceptions about complementary therapies relative to conventional therapies among adults who use both: results from a national survey. Ann Intern Med. 2001;135(5):344–351.

    Article  CAS  PubMed  Google Scholar 

  67. Astin JA. Why patients use alternative medicine: results of a national study. JAMA. 1998;279:1548–1553.

    Article  CAS  PubMed  Google Scholar 

  68. Kemper KJ. Holistic pediatrics = good medicine. Pediatrics. 2000;105(1 Pt 3):214–218.

    CAS  PubMed  Google Scholar 

  69. Spigelblatt L, Laine-Ammara G, Pless IB, Guyver A. The use of alternative medicine by children. Pediatrics. 1994;94(6 Pt 1):811–814.

    CAS  PubMed  Google Scholar 

  70. Simpson N. Pearch A, Finlay F, Lenton S. The use of complementary medicine in pediatric outpatient clinics. Ambulatory Child Health. 1998;3:351–356.

    Google Scholar 

  71. Ottolini M, Hamburger E, Loprieto J. Alternative Medicine Use Among Children in the Washington DC Area. San Francisco, CA: Pediatric Academic Societies; 1999.

    Google Scholar 

  72. Kelly KM, Jacobson JS, Kennedy DD, Braudt SM, Mallick M, Weiner MA. Use of unconventional therapies by children with cancer at an urban medical center. J Pediatr Hematol Oncol. 2000;22(5):412–416.

    Article  CAS  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. División of Complementary & Alternative Medicine, Foresight Links Corporation, 25-270 North Centre Rd., London, Ontario, N6G 5E2, Canada

    Carmen Tamayo MD (Director)

  2. Faculty of Pharmacy, University of Toronto, Toronto, Ontario, Canada

    Heather Boon BScPhm, PhD (Assistant Professor)

  3. Department of Pediatrics, University of Arizona Health Sciences Center, Tucson, Arizona, USA

    Fayez Ghishan MD (Professor of Pediatrics and Physiology, Head, Director)

  4. Steele Memorial Children’s Research Center, Tucson, Arizona, USA

    Fayez Ghishan MD (Professor of Pediatrics and Physiology, Head, Director)

  5. McMaster University, Hamilton, Ontario, Canada

    Kien Trinh MD, BSc, MSc (Assistant Clinical Professor, Program Chair)

  6. Medical Acupuncture, McMaster University Health Sciences, Hamilton, Ontario, Canada

    Kien Trinh MD, BSc, MSc (Assistant Clinical Professor, Program Chair)

Authors
  1. Carmen Tamayo MD
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Heather Boon BScPhm, PhD
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Fayez Ghishan MD
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Kien Trinh MD, BSc, MSc
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Tamayo, C., Boon, H., Ghishan, F. et al. Research Methodology Evaluating Complementary and Alternative Therapies. Ther Innov Regul Sci 36, 535–548 (2002). https://doi.org/10.1177/009286150203600308

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1177/009286150203600308

Key Words

Search

Navigation