George Pradeep Paul, Zhabenko Olena, Kyaw Bhone Myint, Antoniou Panagiotis, Posadzki Pawel, Saxena Nakul, Semwal Monika, Tudor Car Lorainne, Zary Nabil, Lockwood Craig, Car Josip
Health Services and Outcomes Research, National Healthcare Group, Singapore, Singapore.
Joanna Briggs Institute, University of Adelaide, Adelaide, Australia.
J Med Internet Res. 2019 Feb 25;21(2):e13269. doi: 10.2196/13269.
Globally, online and local area network-based (LAN) digital education (ODE) has grown in popularity. Blended learning is used by ODE along with traditional learning. Studies have shown the increasing potential of these technologies in training medical doctors; however, the evidence for its effectiveness and cost-effectiveness is unclear.
This systematic review evaluated the effectiveness of online and LAN-based ODE in improving practicing medical doctors' knowledge, skills, attitude, satisfaction (primary outcomes), practice or behavior change, patient outcomes, and cost-effectiveness (secondary outcomes).
We searched seven electronic databased for randomized controlled trials, cluster-randomized trials, and quasi-randomized trials from January 1990 to March 2017. Two review authors independently extracted data and assessed the risk of bias. We have presented the findings narratively. We mainly compared ODE with self-directed/face-to-face learning and blended learning with self-directed/face-to-face learning.
A total of 93 studies (N=16,895) were included, of which 76 compared ODE (including blended) and self-directed/face-to-face learning. Overall, the effect of ODE (including blended) on postintervention knowledge, skills, attitude, satisfaction, practice or behavior change, and patient outcomes was inconsistent and ranged mostly from no difference between the groups to higher postintervention score in the intervention group (small to large effect size, very low to low quality evidence). Twenty-one studies reported higher knowledge scores (small to large effect size and very low quality) for the intervention, while 20 studies reported no difference in knowledge between the groups. Seven studies reported higher skill score in the intervention (large effect size and low quality), while 13 studies reported no difference in the skill scores between the groups. One study reported a higher attitude score for the intervention (very low quality), while four studies reported no difference in the attitude score between the groups. Four studies reported higher postintervention physician satisfaction with the intervention (large effect size and low quality), while six studies reported no difference in satisfaction between the groups. Eight studies reported higher postintervention practice or behavior change for the ODE group (small to moderate effect size and low quality), while five studies reported no difference in practice or behavior change between the groups. One study reported higher improvement in patient outcome, while three others reported no difference in patient outcome between the groups. None of the included studies reported any unintended/adverse effects or cost-effectiveness of the interventions.
Empiric evidence showed that ODE and blended learning may be equivalent to self-directed/face-to-face learning for training practicing physicians. Few other studies demonstrated that ODE and blended learning may significantly improve learning outcomes compared to self-directed/face-to-face learning. The quality of the evidence in these studies was found to be very low for knowledge. Further high-quality randomized controlled trials are required to confirm these findings.
在全球范围内,基于在线和局域网的数字教育(ODE)越来越受欢迎。ODE将混合式学习与传统学习相结合。研究表明,这些技术在培训医生方面的潜力不断增加;然而,其有效性和成本效益的证据尚不清楚。
本系统评价评估了基于在线和局域网的ODE在提高执业医生的知识、技能、态度、满意度(主要结果)、实践或行为改变、患者结局以及成本效益(次要结果)方面的有效性。
我们检索了7个电子数据库,以查找1990年1月至2017年3月期间的随机对照试验、整群随机试验和半随机试验。两位综述作者独立提取数据并评估偏倚风险。我们以叙述方式呈现了研究结果。我们主要将ODE与自主学习/面对面学习以及混合式学习与自主学习/面对面学习进行了比较。
共纳入93项研究(N = 16,895),其中76项比较了ODE(包括混合式)与自主学习/面对面学习。总体而言,ODE(包括混合式)对干预后知识、技能、态度、满意度、实践或行为改变以及患者结局的影响并不一致,大多介于两组无差异到干预组干预后得分更高之间(效应大小从小到中,证据质量从极低到低)。21项研究报告干预组知识得分更高(效应大小从小到中,证据质量极低),而20项研究报告两组知识无差异。7项研究报告干预组技能得分更高(效应大小中,证据质量低),而13项研究报告两组技能得分无差异。1项研究报告干预组态度得分更高(证据质量极低),而4项研究报告两组态度得分无差异。4项研究报告干预后医生对干预的满意度更高(效应大小中,证据质量低),而6项研究报告两组满意度无差异。8项研究报告ODE组干预后实践或行为改变更大(效应大小从小到中,证据质量低),而5项研究报告两组实践或行为改变无差异。1项研究报告患者结局改善更大,而其他3项研究报告两组患者结局无差异。纳入的研究均未报告干预的任何意外/不良影响或成本效益。
实证证据表明,ODE和混合式学习在培训执业医生方面可能等同于自主学习/面对面学习。其他少数研究表明,与自主学习/面对面学习相比,ODE和混合式学习可能显著提高学习效果。这些研究中关于知识的证据质量被发现非常低。需要进一步开展高质量的随机对照试验来证实这些发现。