Clinical Competence Assessed Using Simulation: Development of a Standardized Tool to Assess Nutrition-Focused Physical Exam Skill Competence for Registered Dietitian Nutritionists.

OBJECTIVE

This study details development and testing of a tool designed to evaluate clinical competence by registered dietitian nutritionists (RDNs) on the nutrition-focused physical exam (NFPE). The process demonstrated in this study can be adapted for assessment of other clinical skills in competency-based education programs, such as Accreditation Council on Education in Nutrition and Dietetics' Future Model of Dietetics Education.

DESIGN AND SETTING

The tool was tested for content validity, then used to assess the videotaped performance of the NFPE with standardized patients in a simulated clinical environment.

PARTICIPANTS

Seven expert raters assessed the relevance of the tool's items for content validity. For other tests, the tool was used by 3 dietetics faculty to score a group of 18 RDNs.

VARIABLES AND ANALYSIS

Content validity was tested using the item-level Content Validity Index. Interrater reliability and internal consistency of the tool were calculated and assessed.

RESULTS

The interrater reliability results indicated excellent agreement between raters, both overall (kappa statistic = 0.86; 95% confidence interval, 0.86-0.87; P < 0.001) and on individual items. Cronbach α statistic was calculated at α = .91, indicating excellent internal consistency.

CONCLUSIONS

The tool represents an instrument that can assess competence in the NFPE among RDNs and may be used as a template for development of other competency-based education assessment tools.