Yoo Soojeong, Ramalhinho João, Dowrick Thomas, Somasundaram Murali, Gurusamy Kurinchi, Davidson Brian, Clarkson Matthew J, Blandford Ann
Wellcome ESPRC Centre for Interventional and Surgical Sciences, University College London, London, United Kingdom.
UCL Interaction Centre, University College London, London, United Kingdom.
Comput Graph. 2024 Apr;119:None. doi: 10.1016/j.cag.2024.01.008.
Obtaining feedback from time-constrained end-users is a major challenge in evaluating novel systems for specialised applications. The performance and feedback of engineers and surgeons was evaluated through an experiment where participants were asked to identify tumour locations within an anatomically realistic silicon liver model across three different conditions of an Augmented Reality (AR) prototype system (Baseline, Split AR and Full AR). Our findings show that engineers and surgeons share some similarities in their performance, feedback and behaviour, particularly when reliance on the AR system is high for both groups. However, engineers typically focus more on accuracy of the image alignment and are more accurate in their responses when supported by AR. Senior surgeons typically perform faster and use AR as supplementary information, while the performance of junior surgeons is more closely aligned to the performance of engineers. We conclude that engineers could be involved in preliminary evaluations of a surgical system or in evaluations of systems which are aimed at training junior surgeons, but that it is essential to involve surgeons in later evaluations, where ecological validity is a more important consideration.
从时间紧张的终端用户那里获取反馈，是评估针对特定应用的新型系统时面临的一项重大挑战。通过一项实验评估了工程师和外科医生的表现及反馈，在该实验中，要求参与者在增强现实（AR）原型系统的三种不同条件（基线、分体式AR和全AR）下，在一个解剖结构逼真的硅质肝脏模型中识别肿瘤位置。我们的研究结果表明，工程师和外科医生在表现、反馈和行为方面存在一些相似之处，尤其是当两组对AR系统的依赖程度都很高时。然而，工程师通常更关注图像对齐的准确性，并且在AR的支持下回答更准确。资深外科医生通常操作更快，并将AR用作补充信息，而初级外科医生的表现则更接近工程师的表现。我们得出结论，工程师可以参与手术系统的初步评估或针对培训初级外科医生的系统评估，但在后期评估中让外科医生参与至关重要，因为在后期评估中生态效度是一个更重要的考虑因素。
