Skip to main content
Log in

Electronic Diaries

Appraisal and Current Status

  • Leading Article
  • Published:
Pharmaceutical Medicine Aims and scope Submit manuscript

Abstract

The recent explosion of technology has moved the field of patient reported outcomes into a new era. The use of paper-and-pencil questionnaires administered before and after treatment has been eclipsed by highly sophisticated random prompts for symptom ratings at multiple points throughout the day; a method known as ecological momentary assessment (EMA). During the last 25 years, research has demonstrated that retrospective ratings are subject to a variety of cognitive heuristics that can distort the report. Initially, this was addressed by adopting paper diary protocols involving multiple ratings in a day or across a week. However, advances in technology subsequently led to the use of electronic platforms for EMA assessment. A good deal of research has since been conducted to compare paper and electronic formats. Issues of compliance have been particularly problematic for paper diaries. Electronic technologies can be expensive and require expertise in programming and data management. Not all research questions will require intensive momentary assessment, and end-of-day ratings may be adequate for many applications. What is required of the investigator is familiarity with the strengths and weaknesses of the methods and platforms available, as well as a reasoned decision to select a particular methodology for the study question at hand.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Favill D, Rennick CF. A case of family periodic paralysis. Arch Neurol Psychiatry 1924; 11: 674–9

    Article  Google Scholar 

  2. Csikszentmihalyi M, Larsen R. Validity and reliability of the experience-sampling method. J Nervous Mental Dis 1987; 175: 526–36

    Article  CAS  Google Scholar 

  3. Barker R. Habitats, environments and human behavior: studies in the ecological psychology and ecobehavioral science of the Midwest Psychological Field Station: 1947–1972. San Francisco (CA): Jossey-Bass, 1978

    Google Scholar 

  4. Delespaul P, De Vries MW. The daily life of ambulatory chronic mental patients. J Nervous Mental Dis 1987; 175 (9): 537–44

    Article  CAS  Google Scholar 

  5. Stone AA, Reed BR, Neale JM. Changes in daily event frequency precede episodes of physical symptoms. J Human Stress 1987; 13 (2): 70–4

    Article  PubMed  CAS  Google Scholar 

  6. Stone AA, Neale JM. Effects of severe daily events on mood. J Pers Soc Psychol 1984 Jan; 46 (1): 137–44

    Article  PubMed  CAS  Google Scholar 

  7. Stone A, Shiffman S. Ecological momentary assessment (EMA) in behavioral medicine. Ann Behav Med 1994; 16: 199–202

    Google Scholar 

  8. Bradburn N, Rips L, Shevell S. Answering autobiographical questions: the impact of memory and inference on surveys. Science 1987; 236: 157–61

    Article  PubMed  CAS  Google Scholar 

  9. Schwarz N. Retrospective and concurrent self-reports: the rationale for real-time data capture. In: Stone AA, Shiffman S, Atienza AA, et al., editors. The science of real-time data capture. New York: Oxford University Press, 2007

    Google Scholar 

  10. Gorin AA, Stone AA. Recall biases and cognitive errors in retrospective self-reports: a call for momentary assessments. In: Baum A, Revenson T, Singer J, editors. Handbook of health psychology. Mahwah (NJ): Erlbaum, 2001: 405–13

    Google Scholar 

  11. Robinson M, Clore G. Episodic and semantic knowledge in emotional self-report: evidence for two judgment processes. J Pers Soc Psychol 2002; 83: 198–215

    Article  PubMed  Google Scholar 

  12. Stone AA, Broderick JE, Schwartz JE, et al. Intensive momentary reporting of pain with an electronic diary: reactivity, compliance, and patient satisfaction. Pain 2003 Jul; 104 (1–2): 343–51

    Article  PubMed  Google Scholar 

  13. Hufford MR, Shields AL, Shiffman S, et al. Reactivity to ecological momentary assessment: an example using undergraduate problem drinkers. Psychol Addict Behav 2002 Sep; 16 (3): 205–11

    Article  PubMed  Google Scholar 

  14. Fredrickson B. Extracting meaning form past affective experiences: the importance of peaks, ends, and specific emotions. Cognition Emotion 2000; 14 (4): 577–606

    Article  Google Scholar 

  15. Redelmeier DA, Kahneman D. Patients’ memories of painful medical treatments: real-time and retrospective evaluations of two minimally invasive procedures. Pain 1996; 66 (1): 3–8

    Article  PubMed  CAS  Google Scholar 

  16. Redelmeier D, Katz J, Kahneman D. Memories of colonoscopy: a randomized trial. Pain 2003; 104: 187–94

    Article  PubMed  Google Scholar 

  17. Stone A, Broderick J, Kaell A, et al. Does the peak-end phenomenon observed in laboratory pain studies apply to real-world pain in rheumatoid arthritics? J Pain 2000; 1 (3): 212–7

    PubMed  CAS  Google Scholar 

  18. Stone AA, Schwartz JE, Broderick JE, et al. Variability of momentary pain predicts recall of weekly pain: a consequence of the peak (or salience) memory heuristic. Pers Soc Psychol Bull 2005; 31 (10): 1340–6

    Article  PubMed  Google Scholar 

  19. Eich E, Reeves JL, Jaeger B, et al. Memory for pain: relation between past and present pain intensity. Pain 1985; 23 (4): 375–80

    Article  PubMed  CAS  Google Scholar 

  20. Collins L, Graham J, Hansen W, et al. Agreement between retrospective accounts of substance use and earlier reported substance use. Appl Psychol Measurement 1985; 9: 301–9

    Article  Google Scholar 

  21. Robinson M, Clore G. Belief and feeling: evidence for an accessibility model of emotional self-report. Psychol Bull 2002; 128 (6): 934–60

    Article  PubMed  Google Scholar 

  22. Linton SJ, Melin L. The accuracy of remembering chronic pain. Pain 1982; 13: 281–5

    Article  PubMed  CAS  Google Scholar 

  23. Ross M. The relation of implicit theories to the construction of personal histories. Psychol Rev 1989; 96: 341–57

    Article  Google Scholar 

  24. Broderick J, Schwartz J, Shiffman S, et al. Signaling does not adequately improve diary compliance. Ann Behav Med 2003; 26 (2): 139–48

    Article  PubMed  Google Scholar 

  25. Stone A, Shiffman S, Schwartz J, et al. Patient compliance with paper and electronic diaries. Control Clin Trials 2003; 24 (2): 182–99

    Article  PubMed  Google Scholar 

  26. Broderick JE, Stone AA. Paper and electronic diaries: too early for conclusions on compliance rates and their effects: comment on Green, Rafaeli, Bolger, Shrout, and Reis (2006). Psychol Meth 2006 Mar; 11 (1): 106–11; discussion 23-5

    Article  Google Scholar 

  27. Green AS, Rafaeli E, Bolger N, et al. Paper or plastic? Data equivalence in paper and electronic diaries. Psychol Meth 2006; 11 (1): 87–105

    Article  Google Scholar 

  28. Tennen H, Affleck G, Coyne JC, et al. Paper and plastic in daily diary research: comment on Green, Rafaeli, Bolger, Shrout, and Reis (2006). Psychol Meth 2006 Mar; 11 (1): 112–8; discussion 23-5

    Article  Google Scholar 

  29. Dale O, Hagen KB. Despite technical problems personal digital assistants out-perform pen and paper when collecting patient diary data. J Clin Epidemiol 2007 Jan; 60 (1): 8–17

    Article  PubMed  Google Scholar 

  30. Turner CF, Ku L, Rogers SM, et al. Adolescent sexual behavior, drug use, and violence: increased reporting with computer survey technology. Science 1998 May 8; 280 (5365): 867–73

    Article  PubMed  CAS  Google Scholar 

  31. Anhoj J, Moldrup C. Feasibility of collecting diary data from asthma patients through mobile phones and SMS (short message service): response rate analysis and focus group evaluation from a pilot study. J Med Internet Res 2004 Dec 2; 6 (4): e42

    Article  PubMed  Google Scholar 

  32. Weiler K, Christ AM, Woodworth GG, et al. Quality of patient-reported outcome data captured using paper and interactive voice response diaries in an allergic rhinitis study: is electronic data capture really better? Ann Allergy Asthma Immunol 2004 Mar; 92 (3): 335–9

    Article  PubMed  Google Scholar 

  33. Lauritsen K, Degl’Innocenti A, Hendel L, et al. Symptom recording in a randomised clinical trial: paper diaries vs. electronic or telephone data capture. Control Clin Trials 2004 Dec; 25 %(6): 585–97

    Article  Google Scholar 

  34. Levin E, Levin A. Evaluation of spoken dialogue technology for real-time health data collection. J Med Internet Res 2006; 8 (4): e30

    Article  PubMed  Google Scholar 

  35. Focht BC, Ewing V, Gauvin L, et al. The unique and transient impact of acute exercise on pain perception in older, overweight, or obese adults with knee osteoarthritis. Ann Behav Med 2002; 24 (3): 201–10

    Article  PubMed  Google Scholar 

  36. Honkoop PC, Sorbi MJ, Godaert GL, et al. High-density assessment of the IHS classification criteria for migraine without aura: a prospective study. Cephalalgia 1999 May; 19 (4): 201–6

    Article  PubMed  CAS  Google Scholar 

  37. Liszka-Hackzell JJ, Martin DP. An analysis of the relationship between activity and pain in chronic and acute low back pain. Anesth Analg 2004 Aug; 99 (2): 477–81

    Article  PubMed  Google Scholar 

  38. Cohen LH, Gunthert KC, Butler AC, et al. Daily affective reactivity as a prospective predictor of depressive symptoms. J Pers 2005 Dec; 73 (6): 1687–713

    Article  PubMed  Google Scholar 

  39. Tennen H, Affleck G, Zautra A. Depression history and coping with chronic pain: a daily process analysis. Health Psychol 2006 May; 25 (3): 370–9

    Article  PubMed  Google Scholar 

  40. Shiffman S, Gwaltney CJ, Balabanis MH, et al. Immediate antecedents of cigarette smoking: an analysis from ecological momentary assessment. J Abnorm Psychol 2002 Nov; 111 (4): 531–45

    Article  PubMed  Google Scholar 

  41. Bolger N, Davis A, Rafaeli E. Diary methods: capturing life as it is lived. Ann Rev Psychol 2003; 54: 579–616

    Article  Google Scholar 

  42. Feinn R, Tennen H, Cramer J, et al. Measurement and prediction of medication compliance in problem drinkers. Alcohol Clin Exp Res 2003 Aug; 27 (8): 1286–92

    Article  PubMed  Google Scholar 

  43. Palermo TM, Valenzuela D, Stork PP. A randomized trial of electronic versus paper pain diaries in children: impact on compliance, accuracy, and acceptability. Pain 2004 Feb; 107 (3): 213–9

    Article  PubMed  Google Scholar 

  44. Booth CM, Clemons M, Dranitsaris G, et al. Chemotherapy-induced nausea and vomiting in breast cancer patients: a prospective observational study. J Support Oncol 2007 Sep; 5 (8): 374–80

    PubMed  Google Scholar 

  45. Nyholm D, Kowalski J, Aquilonius SM. Wireless real-time electronic data capture for self-assessment of motor function and quality of life in Parkinson’s disease. Mov Disord 2004 Apr; 19 (4): 446–51

    Article  PubMed  Google Scholar 

  46. Hufford M. Special methodological challenges and opportunities in ecological momentary assessment. In: Stone AA, Shiffman S, Autienza A, et al., editors. The science of real-time data capture: self-reports in health research. New York: Oxford University Press, 2007

    Google Scholar 

  47. Palmblad M, Tiplady B. Electronic diaries and questionnaires: designing user interfaces that are easy for all patients to use. Qual Life Res 2004 Sep; 13 (7): 1199–207

    Article  PubMed  Google Scholar 

  48. Stone AA, Shiffman S. Capturing momentary, self-report data: a proposal for reporting guidelines. Ann Behav Med 2002; 24 (3): 236–43

    Article  PubMed  Google Scholar 

  49. Affleck G, Zautra A, Tennen H, et al. Multilevel daily process designs for consulting and clinical psychology: a preface for the perplexed. J Consult Clin Psychol 1999; 67 (5): 746–54

    Article  PubMed  CAS  Google Scholar 

  50. Schwartz JE, Stone AA. The analysis of real-time momentary data: a practical guide. In: Stone AA, Shiffman S, Atienza AA, et al., editors. The science of real-time data capture. New York: Oxford University Press, 2007

    Google Scholar 

  51. Shrier LA, Shih MC, Beardslee WR. Affect and sexual behavior in adolescents: a review of the literature and comparison of momentary sampling with diary and retrospective self-report methods of measurement. Pediatrics 2005 May; 115 (5): e573–81

    Article  PubMed  Google Scholar 

  52. Carpenter JS, Monahan PO, Azzouz F. Accuracy of subjective hot flush reports compared with continuous sternal skin conductance monitoring. Obstet Gynecol 2004 Dec; 104 (6): 1322–6

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

The writing of this paper was supported in part by an investigator-initiated grant from the National Institutes of Health (1 U01-AR052170-01; Arthur A. Stone, principal investigator). The NIH has neither been involved in the design or interpretation of our research, nor in the preparation or review of this paper.

Conflict of interest disclosure: the author has a financial interest in invivodata, inc., Pittsburgh, a company providing electronic data services to the pharmaceutical community. There were no other contributors to this paper.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Joan E. Broderick.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Broderick, J.E. Electronic Diaries. Pharm Med 22, 69–74 (2008). https://doi.org/10.1007/BF03256686

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF03256686

Keywords

Navigation