Abstract
Over 30 % of Korean population suffers from chronic diseases, and the management cost of this portion of the population is estimated to be more than 7 % of the gross domestic product and is expected to continue to increase with the aging of society. The u-healthcare (ubiquitous healthcare)-based home healthcare service has been emerging as a solution to this issue. Clinical decision support system (CDSS) is software that provides professional medical knowledge to help people make medical decisions, and is required for the efficient operation of u-healthcare as a core technology. U-healthcare-based CDSS is meant to improve accessibility of medical information for the public, but it at the same time carries a substantial risk of misuse. Hence, a certain level of standards and specifications is required to guarantee the quality of u-healthcare-based CDSS to protect public health. In this context, this project aimed to develop technologies to evaluate reliabilities of u-healthcare-based CDSS dealing with diabetes mellitus and hypertension. This study created a Test Toolkit to evaluate random CDSS with a function to confirm results obtained from CDSS performance evaluation technologies. Results of CDSS were obtained based on screening test items. The design descriptions are defined as (1) creation of test scenario to test CDSS, (2) grading function using returned answers to CDSS, and (3) confirmation of test result. The functions of the Test Toolkit are divided into two types. (1) Test scenarios and the answers to the scenarios are created by reading and fabricating standard scenarios from the DB based on test items input by the evaluator. (2) Appraisal CDSS creates a file of result values using a given test scenario file, and then a CDSS evaluation report, classified by test item, is formed by comparing answers to those found in (1). It should be noted that functions (1) and (2) are completely independent. Conclusively, researchers developed a toolkit to evaluate clinical reliabilities and software stabilities of CDSS for healthcare free from misjudgments caused by human factors and to speed up overall evaluation processes tremendously and efficiently. This toolkit will ensure proper usage of CDSS by the public for health benefits.
Similar content being viewed by others
References
Ministry of Health and Welfare (2010). Administrative publication 11–1351159-000027-10. National Health Statistics 2009.
Ministry of Health and Welfare (2012). 2010–2020 Healthcare expenditure mid-to-long term prospects. Republic of Korea.
Kailas, A., & Ingram, M. A. (2009). Wireless aspects of telehealth. Wireless Personal Communication, 51, 673–686.
Oleshchuk, V., & Fensli, R. (2011). Remote patient monitoring within a future 5G infrastructure. Wireless Personal Communication, 57, 431–439.
Samsung Economics Research Institute (2007). The beginning of u-healthcare diffusion. Republic of Korea.
Dinesen, B., & Toft, E. (2009). Telehomecare challenge collaboration among healthcare professionals. Wireless Personal Communication, 51, 711–724.
Boye, N. (2009). The citizen as co-producer of health: The need for “Infusion of Medicine into Technology” in future application of information and communication technology in health. Wireless Personal Communications, 51, 739–751.
Hunt, D. L., Haynes, R. B., Hanna, S. E., & Smith, K. (1998). Effects of computer-based clinical decision support systems on physician performance and patient outcomes: A systematic review. JAMA, 280(15), 1339–1346.
Johnston, M. E., Langton, K. B., Haynes, R. B., & Mathieu, A. (1994). Effects of computer-based clinical decision support systems on clinician performance and patient outcome: A critical appraisal of research. Annals of Internal Medicine, 120(2), 135–142.
Lawrence, S., & Giles, C. L. (1999). Accessibility of information on the web. Nature, 400(6740), 107–109.
Miller, R. A. (1994). Medical diagnostic decision support systems-past, present, and future: A threaded bibliography and brief commentary. Journal of American Medical Informatics Association, 1(1), 8–27.
Shortliffe, E. H. (1990). Medical informatics: Computer applications in health care. MA: Addison Wesley.
Musen, M. A. (1997). Modelling of decision support. In J. H. V. Bemmel & M. A. Musen (Eds.), Handbook of medical informatics. Houten: Bohn Stafleu Van Loghum.
Korea Food and Drug Administration (2007). Administrative Publication 11–1470000-001483-01. Guidelines for medical software validation. Republic of Korea.
Ahn, J. T., Son, J., Lim, C. S., Ahn, J. C., Lee, H. S., Kang, J., Park, G. H., Cha, J., & Park, K. (2013). Study on the evaluation technology for effectiveness and safety of clinical decision support system for the management of chronic adult disease. The 1st International Conference on Digital Policy and Management, 35–37.
Sintchenko, V., Westbrook, J., Tipper, S., Mathie, M., & Coiera, E. (2003). Electronic decision support activities in different healthcare settings in Australia. Electronic Decision Support for Australia’s Health Sector (Appendix A).
The Korean Society of Hypertension (2005). Practice guideline for hypertension in Korea. Republic of Korea.
The Korean Diabetes Association (2011). Clinical practice guidelines for diabetes in Korea. Republic of Korea.
IEC 60601-1-4 Consol. Ed. 1.1 (incl. am1) (2000). Bilingual, Medical electrical equipment—part 1–4: General requirements for safety—collateral standard: Programmable electrical medical systems. USA.
Acknowledgments
This study was performed with the support of the research project of the Korea Food and Drug Administration (KFDA), Grant Number: 08142 Medical Equipment 365 (Research on performance evaluation guidelines of u-healthcare-based CDSS).
Author information
Authors and Affiliations
Corresponding author
Additional information
Joon Tae Ahn and Gil Hong Park contributed equally to this work.
Rights and permissions
About this article
Cite this article
Ahn, J.T., Park, G.H., Son, J. et al. Development of Test Toolkit of Hard Review to Evaluate a Random Clinical Decision Support System for the Management of Chronic Adult Diseases. Wireless Pers Commun 79, 2469–2484 (2014). https://doi.org/10.1007/s11277-014-1835-7
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11277-014-1835-7