Abstract: Objectives: To evaluate the potential of a novel system using outlier detection screening algorithms and to identify medication related risks in an inpatient setting.
Methods: In the first phase of the study, we evaluated the transferability of models refined at another medical center using a different electronic medical record system (EMR) on 3 years of historical data (2017-2019), extracted from the local EMR system. Following the retrospective analysis, the system's models were fine-tuned to the specific local practice patterns. In the second, prospective phase of the study, the system was fully integrated in the local EMR and after a short run-in period was activated live. All alerts generated by the system, in both phases, were analyzed by a clinical team of physicians and pharmacists for accuracy and clinical relevance.
Results: In the retrospective phase of the study, 226,804 medical orders were analyzed, generating a total of 2731 alerts (1.2% of medical orders). Of the alerts analyzed, 69% were clinically relevant alerts and 31% were false alerts. In the prospective phase of the study, 399 alerts were generated by the system (1.6% of medical orders). The vast majority of the alerts (72%) were considered clinically relevant, and 41% of the alerts caused a change in prescriber behavior (i.e. cancel/modify the medical order).
Conclusion: In an inpatient setting of a 600 bed computerized decision support system (CDSS) -naïve medical center, the system generated accurate and clinically valid alerts with low alert burden enabling physicians to improve daily medical practice.
(© 2022. The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature.)
References: Velo GP, Minuz P. Medication errors: prescribing faults and prescription errors. Br J Clin Pharmacol. 2009;67:624–8. (PMID: 10.1111/j.1365-2125.2009.03425.x)
Weetman T, Aronson J, Maxwell S. How to reduce prescribing errors. Lancet. 2009:374:1945.
Gandhi TK, Weingart SN, Seger AC, et al. Outpatient prescribing errors and the impact of computerized prescribing. J Gen Intern Med. 2005;20:837–41. (PMID: 10.1111/j.1525-1497.2005.0194.x)
Hoffman S, Podgurski A. Drug-drug interaction alerts: emphasizing the evidence. J Health Law Policy. 2012;5:2012–22.
Devine EB, Hansen RN, Wilson-Norton JL, et al. The impact of computerized provider order entry on medication errors in a multispecialty group practice. J Am Med Inform Assoc. 2010. 17:78–84. (PMID: 10.1197/jamia.M3285)
Jani YH, Ghaleb MA, Marks SD, et al. Electronic prescribing reduced prescribing errors in a pediatric renal outpatient clinic. J Pediatr. 2008;152:214–8. (PMID: 10.1016/j.jpeds.2007.09.046)
Kaushal R, Kern LM, Barron Y, et al. Electronic prescribing improves medication safety in community-based office practices. J Gen Intern Med. 2010.25:530–6. (PMID: 10.1007/s11606-009-1238-8)
Aronson JK. Medication errors: what they are, how they happen, and how to avoid them. QJM. 2009;102:513–21. (PMID: 10.1093/qjmed/hcp052)
McCoy AB, Thomas EJ, Krousel-Wood M, et al. Clinical decision support alert appropriateness: a review and proposal for improvement. J Am Med Inform Assoc. 2017;24:281–87.
Rozenblum R, Rodriguez-Monguio R, Volk LA, et al. Using a machine learning system to identify and prevent medication prescribing errors: A clinical and cost analysis evaluation. Jt Comm J Qual Patient Saf. 2020;46:3–10.
Segal G, Segev A, Brom A, et al. Reducing drug prescription errors and adverse drug events by application of a probabilistic, machine-learning based clinical decision support system in an inpatient setting. J Am Med Inform Assoc. 2019;26:1560–65. (PMID: 10.1093/jamia/ocz135)
Adelman JS, Kalkut GE, Schechter CB, et al. Understanding and preventing wrong-patient electronic orders: a randomized controlled trial. J Am Med Inform Assoc. 2013;20:305–10. (PMID: 10.1136/amiajnl-2012-001055)
Leviatan I, Oberman B, Zimlichman E, et al. Associations of physicians’ prescribing experience, work hours, and workload with prescription errors. J Am Med Inform Assoc. 2021;28:1074–80. (PMID: 10.1093/jamia/ocaa219)
Syrowatka A, Song W, Amato MG, et al. Key use cases for artificial intelligence to reduce the frequency of adverse drug events: a scoping review.Lancet Digit Health. 2022;4:e137–48. (PMID: 10.1016/S2589-7500(21)00229-6)
Schiff GD, Volk LA, Volodarskaya M, et al. Screening for medication errors using an outlier detection system. J Am Med Inform Assoc. 2017;24:281–87. (PMID: 10.1093/jamia/ocw171)
Straichman YZ, Kurnik D, Matok I, et al.Prescriber response to computerized drug alerts for electronic prescriptions among hospitalized patients. Int J Med Inform. 2017;107:70–75. (PMID: 10.1016/j.ijmedinf.2017.08.008)
Carroll AE. Averting Alert Fatigue to Prevent Adverse Drug Reactions. JAMA. 2019;322:601. (PMID: 10.1001/jama.2019.11710)
Processing Request
No Comments.