Friedman C P, Helm K P, Trier W C, Croom R D, Davis W A
Office of Educational Development (OED), University of North Carolina, School of Medicine (UNC), Chapel Hill 27599-7530.
Acad Med. 1991 Aug;66(8):471-3. doi: 10.1097/00001888-199108000-00011.
This study explored the rank list generated by a process of evaluating applicants for a surgery residency; the process is a revision of an older process (pre-1982) used for that purpose. The study's aim was to learn whether the new process is more predictive of residents' performances in their first year than was the process it replaced and whether the rough rankings computed directly from ratings of applicants are more predictive than the final rankings determined in a meeting by the department faculty, who modify the rough rankings. The 1982-1986 rankings and performances of 32 first-year residents at the University of North Carolina at Chapel Hill School of Medicine were studied and compared with the rankings and performances of 77 applicants from 1976 and 1978-1979 under the previous system. Correlation analyses revealed that for the applicants studied, the rough rankings in the new and the previous systems were equally predictive of performances as measured by rating scales, but that the new system was more predictive of performances on the surgery in-training examination. However, all correlations were small. Finally, the rough rankings obtained under the new system were more predictive of the residents' later performances than were the faculty's final rankings.
本研究探讨了通过评估外科住院医师申请人过程所生成的排名列表;该过程是用于此目的的旧流程(1982年前)的修订版。该研究的目的是了解新流程是否比其所取代的流程更能预测住院医师第一年的表现,以及直接根据申请人评分计算出的粗略排名是否比由系里教员在会议上确定的最终排名更具预测性,系里教员会对粗略排名进行修改。对北卡罗来纳大学教堂山分校医学院32名一年级住院医师1982 - 1986年的排名和表现进行了研究,并与1976年以及1978 - 1979年77名申请人在先前系统下的排名和表现进行了比较。相关性分析表明,对于所研究的申请人而言,新系统和先前系统中的粗略排名在通过评分量表衡量表现方面具有同等的预测性,但新系统在外科住院医师培训考试中的表现预测性更强。然而,所有相关性都较小。最后,新系统下获得的粗略排名比教员的最终排名更能预测住院医师后来的表现。