Rosen J, Richards C, Hannaford B, Sinanan M
Department of Electrical Engineering, University of Washington, Seattle 98195, USA.
Stud Health Technol Inform. 2000;70:279-85.
A crucial process in surgical education is to evaluate the level of surgical skills. For laparoscopic surgery, skill evaluation is traditionally preformed subjectively by experts grading a video of a procedure performed by a student. By its nature, this process is preformed using fuzzy criteria. The objective of the current study was to develop and assess a skill scale using Discrete Hidden Markov Models (DHMM). Ten surgeons (5 Novice Surgeons--NS; 5 Expert Surgeons--ES) performed a cholecystectomy and Nissen fundoplication in a porcine model. An instrumented laparoscopic grasper equipped with a three-axis force/torque sensor was used to measure the forces/torques at the hand/tool interface synchronized with a video of the tool operative maneuvers. A synthesis of frame-by-frame video analysis and a vector quantization algorithm, defined force/torque signatures for 14 types of tool/tissue interactions. From each step of the surgical procedures, two DHMM were developed representing the performance of 3 surgeons randomly selected from the 5 in the ES and NS groups. The data obtained by the remaining 2 surgeons in each group were used for evaluating the performance scale. The final result was a surgical performance index which represented a ratio of statistical similarity between the examined surgeon's DHMM and the DHMM of NS and ES. The difference between the performance index value, for a surgeon under study, and the NS/ES boundary, was considered to indicate the level of expertise in the surgeon's own group. Using this index, 87.5% of the surgical procedures were correctly classified into the NS and ES groups. The 12.5% of the procedures that were misclassified were preformed by the ES and classified as NS. However, in these cases the performance index values were very close to the NS/ES boundary. Preliminary data suggest that a performance index based on DHMM and force/torque signatures provides an objective means of distinguishing NS from ES. In addition this methodology can be further applied to evaluate haptic virtual reality surgical simulators for improving realism in surgical education.
外科手术教育中的一个关键过程是评估手术技能水平。对于腹腔镜手术,传统上技能评估是由专家对学生手术过程的视频进行主观评分。从本质上讲,这个过程是使用模糊标准进行的。本研究的目的是开发并评估一种使用离散隐马尔可夫模型(DHMM)的技能量表。十位外科医生(5名新手外科医生——NS;5名专家外科医生——ES)在猪模型上进行了胆囊切除术和尼森胃底折叠术。使用配备三轴力/扭矩传感器的仪器化腹腔镜抓钳来测量与工具操作动作视频同步的手/工具界面处的力/扭矩。通过逐帧视频分析和矢量量化算法的综合,定义了14种工具/组织相互作用的力/扭矩特征。从手术过程的每个步骤中,开发了两个DHMM,分别代表从ES组和NS组的5名医生中随机选择的3名医生的表现。每组中其余2名医生获得的数据用于评估表现量表。最终结果是一个手术表现指数,它代表了被检查外科医生的DHMM与NS和ES的DHMM之间的统计相似度之比。所研究外科医生的表现指数值与NS/ES边界之间的差异被认为表明了该外科医生在其自身组中的专业水平。使用这个指数,87.5%的手术过程被正确分类到NS组和ES组。12.5%被错误分类的手术过程是由ES医生进行的,但被分类为NS。然而,在这些情况下,表现指数值非常接近NS/ES边界。初步数据表明,基于DHMM和力/扭矩特征的表现指数提供了一种区分NS和ES的客观方法。此外,这种方法可以进一步应用于评估触觉虚拟现实手术模拟器,以提高手术教育的真实感。