Zuckerman I H, Mulhearn D M, Metge C J
School of Pharmacy, University of Maryland, Baltimore 21201, USA.
J Am Pharm Assoc (Wash). 1999 Jan-Feb;39(1):45-9. doi: 10.1016/s1086-5802(16)30415-6.
To assess inter- and intrarater reliability among 23 pharmacist and physician retrospective drug utilization reviewers and to assess interrater reliability after a reviewer training session.
Exploratory study.
Maryland Medicaid's retrospective drug utilization review (DUR) program.
23 physician and pharmacist retrospective drug utilization reviewers.
None.
Profiles rated as "intervention indicated" or "intervention not indicated." Cochran's Q test, overall percent agreement, and the unweighted kappa statistic were used in the analysis of review consistency.
Intrarater reliability showed substantial consistency among the 23 reviewers; the percent agreement was 82.9% with kappa = 0.66. Interrater reliability, however, was poor, with an overall agreement of 69.6% and kappa = 0.16. Interrater reliability was also poor after a one-hour reviewer training session (agreement 81.8%, kappa = -0.19).
The implicit review process used in the retrospective DUR program that we evaluated was unreliable. Since reliability is a necessary but not sufficient condition for validity of an indicator of inappropriate drug use, the validity of the DUR implicit review process is in question.
