Department of Research in Biomedicine and Health, Center for Evidence-Based Medicine, University of Split School of Medicine, Šoltanska 2, 21000, Split, Croatia.
Computer Science Department, Universitat de València, Valencia, Spain.
Sci Rep. 2023 Oct 23;13(1):18044. doi: 10.1038/s41598-023-45359-x.
of Findings (SoF) tables concisely present the main findings of evidence synthesis of health evidence, but how users navigate it to understand and interpret the presented information is not clear. We quantified the interaction of medical students with an SoF table while answering a knowledge quiz. Read&Learn tool was used to measure the number of target and non-target table cells visited for each question and the time spent on these cells. Students positively identified target elements for quiz questions and answered simpler questions, but struggled with critical thinking and understanding study outcomes. The question on outcomes with the largest improvement post-intervention had the fewest correct answers, the longest interaction with table cells and the most opened cells before answering. Students spent a median of 72% of the time reading target table cells. A heatmap of the interactions showed that they were mostly answer-oriented. Further development of the tool and metrics is needed to use the tool and the metrics to study the cognitive processes during the assessment of health evidence.
结果(SoF)表简明地呈现了健康证据综合的主要发现,但用户如何通过它来理解和解释所呈现的信息尚不清楚。我们量化了医学生在回答知识测验时与 SoF 表的交互情况。Read&Learn 工具用于测量每个问题目标和非目标表格单元格的访问次数,以及在这些单元格上花费的时间。学生对测验问题的目标元素进行了积极的识别,并回答了更简单的问题,但在批判性思维和理解研究结果方面存在困难。干预后结果问题的改善最大,但正确答案最少,与表格单元格的交互时间最长,回答前打开的单元格最多。学生阅读目标表格单元格的时间中位数为 72%。交互的热图显示,它们主要是面向答案的。需要进一步开发工具和指标,以使用工具和指标来研究在评估健康证据期间的认知过程。