Department of Biomedical Informatics, University of Utah, Salt Lake City, UT, USA.
Department of Psychiatry, UC San Diego ACTRI Dissemination and Implementation Science Center, UC San Diego, La Jolla, CA, USA; Dissemination and Implementation Science Center, Altman Clinical and Translational Research Institute, UC San Diego, La Jolla, CA, USA.
J Biomed Inform. 2022 Mar;127:104014. doi: 10.1016/j.jbi.2022.104014. Epub 2022 Feb 12.
Our objective was to develop an evaluation framework for electronic health record (EHR)-integrated innovations to support evaluation activities at each of four information technology (IT) life cycle phases: planning, development, implementation, and operation.
The evaluation framework was developed based on a review of existing evaluation frameworks from health informatics and other domains (human factors engineering, software engineering, and social sciences); expert consensus; and real-world testing in multiple EHR-integrated innovation studies.
The resulting Evaluation in Life Cycle of IT (ELICIT) framework covers four IT life cycle phases and three measure levels (society, user, and IT). The ELICIT framework recommends 12 evaluation steps: (1) business case assessment; (2) stakeholder requirements gathering; (3) technical requirements gathering; (4) technical acceptability assessment; (5) user acceptability assessment; (6) social acceptability assessment; (7) social implementation assessment; (8) initial user satisfaction assessment; (9) technical implementation assessment; (10) technical portability assessment; (11) long-term user satisfaction assessment; and (12) social outcomes assessment.
Effective evaluation requires a shared understanding and collaboration across disciplines throughout the entire IT life cycle. In contrast with previous evaluation frameworks, the ELICIT framework focuses on all phases of the IT life cycle across the society, user, and IT levels. Institutions seeking to establish evaluation programs for EHR-integrated innovations could use our framework to create such shared understanding and justify the need to invest in evaluation.
As health care undergoes a digital transformation, it will be critical for EHR-integrated innovations to be systematically evaluated. The ELICIT framework can facilitate these evaluations.
我们的目的是开发一个评估框架，用于支持电子健康记录（EHR）集成创新的评估活动，涵盖信息技术（IT）生命周期的四个阶段：规划、开发、实施和运营。
该评估框架是基于对健康信息学和其他领域（人机工程学、软件工程和社会科学）现有评估框架的回顾、专家共识以及在多个 EHR 集成创新研究中的实际测试而开发的。
所得到的评估 IT 生命周期（ELICIT）框架涵盖了四个 IT 生命周期阶段和三个测量层次（社会、用户和 IT）。ELICIT 框架建议了 12 个评估步骤：（1）商业案例评估；（2）利益相关者需求收集；（3）技术需求收集；（4）技术可接受性评估；（5）用户可接受性评估；（6）社会可接受性评估；（7）社会实施评估；（8）初始用户满意度评估；（9）技术实施评估；（10）技术可移植性评估；（11）长期用户满意度评估；（12）社会结果评估。
有效的评估需要在整个 IT 生命周期中，跨学科领域建立共享的理解和协作。与以前的评估框架相比，ELICIT 框架侧重于 IT 生命周期的所有阶段，涵盖社会、用户和 IT 层面。寻求为 EHR 集成创新建立评估计划的机构可以使用我们的框架来建立这种共识，并证明投资评估的必要性。
随着医疗保健行业经历数字化转型，系统地评估 EHR 集成创新将变得至关重要。ELICIT 框架可以促进这些评估。
