Zheng Kai, Padman Rema, Johnson Michael P, Diamond Herbert S
H. John Heinz III School of Public Policy and Management, Carnegie Mellon University, Department of Medicine, Pittsburgh, PA 15213-3890, USA.
Int J Med Inform. 2005 Aug;74(7-8):535-43. doi: 10.1016/j.ijmedinf.2005.03.007. Epub 2005 Apr 21.
Evaluation studies of clinical decision support systems (CDSS) have tended to focus on assessments of system quality and clinical performance in a laboratory setting. Relatively few studies have used field trials to determine if CDSS are likely to be used in routine clinical settings and whether reminders generated are likely to be acted upon by end-users. Moreover, such studies when performed tend not to identify distinct user groups, nor to classify user feedback.
To assess medical residents' acceptance and adoption of a clinical reminder system for chronic disease and preventive care management and to use expressed preferences for system attributes and functionality as a basis for system re-engineering.
Longitudinal, correlational study using a novel developmental trajectory analysis (DTA) statistical method, followed by a qualitative analysis based on user satisfaction surveys and field interviews.
An ambulatory primary care clinic of an urban teaching hospital offering comprehensive healthcare services. 41 medical residents used a CDSS over 10 months in their daily practice. Use of this system was strongly recommended but not mandatory.
A group-based, semi-parametric statistical modeling method to identify distinct groups, with distinct usage trajectories, followed by qualitative instruments of usability and satisfaction surveys and structured interviews to validate insights derived from usage trajectories.
Quantitative analysis delineates three types of user adoption behavior: "light", "moderate" and "heavy" usage. Qualitative analysis reveals that clinicians of distinct types tend to exhibit views of the system consistent with their demonstrated adoption behavior. Drawbacks in the design of the CDSS identified by users of all types (in different ways) motivate a redesign based on current physician workflows.
We conclude that this mixed methodology has considerable promise to provide new insights into system usability and adoption issues that may benefit clinical decision support systems as well as information systems more generally.
临床决策支持系统(CDSS)的评估研究往往集中在实验室环境下对系统质量和临床性能的评估。相对较少的研究采用实地试验来确定CDSS是否可能在常规临床环境中使用,以及生成的提醒是否可能被最终用户采纳。此外,此类研究在进行时往往没有识别出不同的用户群体,也没有对用户反馈进行分类。
评估住院医师对慢性病和预防保健管理临床提醒系统的接受度和采用情况,并将对系统属性和功能的明确偏好作为系统重新设计的基础。
采用新颖的发展轨迹分析(DTA)统计方法进行纵向、相关性研究,随后基于用户满意度调查和实地访谈进行定性分析。
一家提供全面医疗服务的城市教学医院的门诊初级保健诊所。41名住院医师在日常实践中使用CDSS达10个月。强烈推荐但不强制使用该系统。
采用基于组的半参数统计建模方法来识别具有不同使用轨迹的不同群体,随后使用可用性和满意度调查以及结构化访谈等定性工具来验证从使用轨迹中得出的见解。
定量分析描绘了三种类型的用户采用行为:“轻度”、“中度”和“重度”使用。定性分析表明,不同类型的临床医生倾向于表现出与他们所展示的采用行为一致的系统观点。所有类型的用户(以不同方式)识别出的CDSS设计缺陷促使基于当前医生工作流程进行重新设计。
我们得出结论,这种混合方法很有希望为系统可用性和采用问题提供新的见解,这可能对临床决策支持系统以及更广泛的信息系统有益。