Centre for Health Systems & Safety Research, Australian Institute of Health Innovation, Macquarie University, Sydney Australia and St Vincent's Clinical School, Faculty of Medicine, UNSW, Sydney, Australia.
School of Medical Science, Faculty of Medicine, UNSW, Sydney, Australia.
BMC Med Inform Decis Mak. 2018 Oct 5;18(1):83. doi: 10.1186/s12911-018-0666-y.
Recently, attention has shifted to improving the design of computerized alerts via the incorporation of human factors design principles. The Instrument for Evaluating Human Factors Principles in Medication-Related Decision Support Alerts (I-MeDeSA) is a tool developed in the United States to guide improvements to alert design and facilitate selection of electronic systems with superior design. In this study, we aimed to determine the reliability, ease of use and usefulness of I-MeDeSA for assessing drug-drug interaction (DDI) alerts in an Australian context.
Using the I-MeDeSA, three reviewers independently evaluated DDI alert interfaces of seven electronic systems used in Australia. Inter-rater reliability was assessed and reviewers met to discuss difficulties in using I-MeDeSA and the tool's usefulness.
Inter-rater reliability was high (Krippendorff's alpha = 0.76), however, ambiguous wording and the inclusion of conditional items impacted ease of use. A number of items were not relevant to Australian implementations and as a result, most systems achieved an I-MeDeSA score of less than 50%.
The I-MeDeSA proved to be reliable, but item wording and structure made application difficult. Future studies should investigate potential modifications to the I-MeDeSA to improve ease of use and increase applicability to a variety of system configurations.
最近,人们开始关注通过纳入人为因素设计原则来改进计算机化警报的设计。《药物相关决策支持警报中人为因素设计原则评估工具》(I-MeDeSA)是在美国开发的一种工具,旨在指导改进警报设计,并促进选择具有优越设计的电子系统。在这项研究中,我们旨在确定 I-MeDeSA 在评估澳大利亚情境下药物相互作用(DDI)警报时的可靠性、易用性和有用性。
使用 I-MeDeSA,三名评审员独立评估了澳大利亚使用的七种电子系统的 DDI 警报界面。评估了评分者间的可靠性,并且评审员们还讨论了在使用 I-MeDeSA 时遇到的困难以及该工具的有用性。
评分者间的可靠性很高(Krippendorff 的 alpha 值为 0.76),但是,措辞含糊和包含条件项影响了易用性。有一些项目与澳大利亚的实施情况不相关,因此,大多数系统的 I-MeDeSA 得分都低于 50%。
I-MeDeSA 被证明是可靠的,但项目措辞和结构使应用变得困难。未来的研究应调查对 I-MeDeSA 进行潜在修改的方法,以提高易用性并增加其适用于各种系统配置的能力。