Abstract
Depression is the leading cause of disability worldwide and is one of the most common mental health issues being addressed within primary care settings. Mobile apps, which can be used to help people manage their depressive symptoms, are rapidly developing. However, many challenges exist for clinicians and providers to simply select an appropriate app for use within target populations. The objectives of this article are as follows: (1) to describe the search processes that were used to identify depression-related mobile apps and (2) to describe the review process that was implemented to inform and evaluate the identified depression-related mobile health apps for use with our target population. A research team consisting of information technology researchers, primary and psychiatric care providers, and health care researchers completed two mobile app searches to identify depression-related apps which could be used for further exploration within an underserved integrated primary care setting. Sixteen mobile apps were narrowed down to 4 mobile apps, through a series of steps involving screening, collaboration of the interprofessional team, information technology expertise input, and mobile app evaluation tools. This article described the steps a research team used to search, screen, and assess mental health mobile apps for integrated primary care patients with depression. This step-by-step guide focused on depression-related apps; however, similar steps and principles identified in this guide can be applied to other health apps.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
App Advisor Expert Panel. (n.d.) Retrieved August 1, 2019 from https://www.psychiatry.org/psychiatrists/practice/mental-health-apps/app-advisor-expert-panel
App Evaluation Model. (n.d.). Retrieved February 14, 2020 from https://www.psychiatry.org/psychiatrists/practice/mental-health-apps/app-evaluation-model
App Mobile Evaluation Form. (n.d.). Retrieved July 20, 2019 from https://app.smartsheet.com/b/form/0f6b39c460ca421081a249ed4d6f03d0
Boudreaux, E. D., Waring, M. E., Hayes, R. B., Sadasivam, R. S., Mullen, S. M., & Pagoto, S. P. (2014). Evaluating and selecting mobile health apps: strategies for healthcare providers and healthcare organizations. Translational Behavioral Medicine, 4(4), 363–371 https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4286553/. Accessed 15 Oct 2019.
Carlo, A. D., Ghomi, R. H., Renn, B. N., & Areán, P. A. (2019). By the numbers: ratings and utilization of behavioral health mobile applications. NPJ Digital Medicine, 2(54) https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6572775/, 54. Accessed 20 May 2020.
Chan, S., Torous, J., Hinton, L., & Yellowlees, P. (2015). Towards a framework for evaluating mobile mental health apps. Telemedicine and e-Health, 21(12), 1038–1041.
Chandrashekar, P. (2018). Do mental health mobile apps work: evidence and recommendations for designing high-efficacy mental health mobile apps. mHealth, 4(6). https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5897664/. Accessed 5 May 2019.
Clark, D. M. (2018). Realizing the mass public benefit of evidence-based psychological therapies: the IAPT program. Annual Reviews, 14, 159–183 https://www.annualreviews.org/doi/full/10.1146/annurev-clinpsy-050817-084833.
Ferguson, C., & Jackson, D. (2017). Selecting, appraising, recommending and using mobile applications(apps) in nursing. Journal of Clinical Nursing. https://doi.org/10.1111/jocn.13834.
Henson, P., David, G., Albright, K., & Torous, J. (2019). Deriving a practical framework for the evaluation of health apps. The Lancet Digital Health, 1(2), e52–e54.
Huguet, A., Rao, S., McGrath, P., Wozney, L., Wheaton, M., Conrod, J., & Rozario, S. (2016). A systematic review of cognitive behavioral therapy and behavioral activation apps for depression. PLoS One, 11(5), e0154248. https://doi.org/10.1371/journal.pone.0154248.
Kayyali, R., Peletidi, A., Ismail, M., Hashim, Z., Bandeira, P., & Bonnah, J. (2017). Awareness and use of mHealth apps: a study from England. Pharmacy (Basel), 5(2), 33–46. https://doi.org/10.3390/pharmacy5020033.
Lee, J., & Kim, J. (2018). Method of app selection for healthcare providers based on consumer needs. CIN: Computers, Informatics, Nursing, 36(1), 45–54. https://doi.org/10.1097/CIN.0000000000000399.
Lee, J., & Kim, J. (2019). Can menstrual health apps selected based on users’ needs change health-related factors? A double-blind randomized controlled trial. Journal of the American Medical Informatics Association, 26(7), 655–666. https://doi.org/10.1093/jamia/ocz019.
Marshall, J. M., Dunstan, D. A., & Bartik, W. (2020). Apps with maps—anxiety and depression Mobile apps with evidence-based frameworks: systematic search of major app stores. JMIR Mental Health, 7(6), e16525.
Martin, W., Sarro, F., Jia, Y., Zhang, Y., & Harman, M. (2017). A survey of app store analysis for software engineering. IEEE Transactions on Software Engineering, 43(9), 817–847. https://doi.org/10.1109/TSE.2016.2630689.
Masterson Creber, R. M., Maurer, M. S., Reading, M., Hiraldo, G., Hickey, K. T., & Iribarren, S. (2016). Review and analysis of existing mobile phone apps to support heart failure symptom monitoring and self-care management using the Mobile Application Rating Scale (MARS). JMIR mHealth and uHealth, 4(2), e74 https://mhealth.jmir.org/2016/2/e74.
Neary, M., & Schueller, S. M. (2018). State of the field of mental health apps. Cognitive and Behavioral Practice, 25(4), 531–537.
Nouri, R., R Niakan Kalhori, S., Ghazisaeedi, M., Marchand, G., & Yasini, M. (2018). Criteria for assessing the quality of mHealth apps: a systematic review. Journal of the American Medical Informatics Association, 25(8), 1089–1098.
O’Loughlin, K., Neary, M., Adkins, E., & Schueller, S. (2019). Reviewing the data security and privacy policies of mobile apps for depression. Internet Interventions, 15, 110–115. https://doi.org/10.1016/j.invent.2018.12.001.
Powell, A. C., Torous, J., Chan, S., Raynor, G. S., Shwarts, E., Shanahan, M., & Landman, A. B. (2016). Interrater reliability of mHealth app rating measures: analysis of top depression and smoking cessation apps. JMIR mHealth and uHealth, 4(1), e15.
Research2Guidance (2017). MHealth economics 2017 – current status and future trends in mobile Health (pp. 2–26). Retrieved from https://research2guidance.com/product/mhealth-economics-2017-current-status-and-future-trends-in-mobile-health/
Schueller, S., Neary, M., O’Loughlin, K., & Adkins, E. (2018). Discovery of and interest in health apps among those with mental health needs: survey and focus group study. Journal of Medical Internet Research, 20(6), e10141. https://doi.org/10.2196/10141.
Shen, N., Levitan, M. J., Johnson, A., Bender, J. L., Hamilton-Page, M., Jadad, A. A. R., & Wiljer, D. (2015). Finding a depression app: a review and content analysis of the depression app marketplace. JMIR mHealth and uHealth, 3(1), e16.
Singh, K., Drouin, K., Newmark, L., Lee, J., Faxvaag, A., Rozenblum, R., … Bates, D. (2016). Many mobile health apps target high-need, high-cost populations, but gaps remain. Health Affairs, 35(12), 2310–2318. https://doi.org/10.1377/hlthaff.2016.0578.
Stoyanov, S., Hlides, L., Kavanaugh, D., Zelenko, O., Tjondronegoro, D., & Mani, M. (2015). Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR mHealth and uHealth, 3(1), e27. https://doi.org/10.2196/mhealth.3422.
Stoyanov, S. R., Hides, L., Kavanagh, D. J., & Wilson, H. (2016). Development and validation of the user version of the Mobile Application Rating Scale (uMARS). MIR Mhealth Uhealth, 4(2), e72. https://mhealth.jmir.org/2016/2/e72. https://doi.org/10.2196/mhealth.5849.
Tiongson, J. (2015). Mobile app marketing insights: how consumers really find and use your apps. Retrieved from https://www.thinkwithgoogle.com/consumer-insights/mobile-app-marketing-insights/
Torous, J. B., Chan, S. R., Gipson, S. Y. M. T., Kim, J. W., Nguyen, T. Q., Luo, J. et al. (2018). A hierarchical framework for evaluation and informed decision making regarding smartphone apps for clinical care. Psychiatric Services, 69(5), 498–500.
Torous, J., Kumaravel, A., Myrick, K. J., Hoffman, L., & Druss, B. G. (2019). Hands-on with smartphone apps for serious mental illness: an interactive tutorial for selecting, downloading, discussing, and engaging in apps. San Francisco: Symposium conducted at the American Psychiatric Association Annual Meeting.
U.S. Food and Drug Administration. (2017) Office of Medical Products and Tobacco, Center for Devices and Radiological Health. Software as a medical device (SAMD): clinical evaluation - guidance for industry and Food and Drug Administration Staff (Docket Number: FDA-2016-D-2483). Retrieved from https://www.fda.gov/regulatory-information/search-fda-guidance-documents/software-medical-device-samd-clinical-evaluation-guidance-industry-and-food-and-drug-administration. Accessed 29 Aug 2019.
U.S. Food and Drug Administration. (2019). Device software functions including mobile medical applications. Retrieved from https://www.fda.gov/medical-devices/digital-health/device-software-functions-including-mobile-medical-applications. Accessed 29 Aug 2019.
Vantola, C. L. (2014). Mobile devices and apps for health care professionals: uses and benefits. Pharmacy and Therapeutics, 39(5), 356–364 https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4029126/. Accessed 5 May 2019.
World Health Organization. (2017). “Depression: let’s talk” says WHO, as depression tops list of causes of ill health. World Health Organization. https://www.who.int/news-room/detail/30-03-2017%2D%2Ddepression-let-s-talk-says-who-as-depression-tops-list-of-causes-of-ill-health. Accessed 5 May 2019.
Funding
The research reported in this publication was supported by the Nebraska Tobacco Settlement Biomedical Research Development Fund (NTSBRDF).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
On behalf of all the authors, the corresponding author states that the work completed within this submission was congruent with our affiliated compliance and ethical standards. We obtained IRB approval for the purposes of our funded grant proposal; however, the findings provided in this manuscript do not contain the human subject data collected with informed consent; therefore, it is our assumption that the IRB and consent forms are not applicable to the content submitted.
Conflict of Interest
The authors declare that they have no conflict of interest.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Emerson, M.R., Watanabe-Galloway, S., Dinkel, D. et al. Lessons Learned in Selection and Review of Depression Apps for Primary Care Settings. J. technol. behav. sci. 6, 42–53 (2021). https://doi.org/10.1007/s41347-020-00156-5
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s41347-020-00156-5