Applied Behaviour Analysis Programme, Department of Psychology (Tamaki Campus), University of Auckland, New Zealand.
J Appl Behav Anal. 2011 Fall;44(3):571-86. doi: 10.1901/jaba.2011.44-571.
The quality of measurement systems used in almost all natural sciences other than behavior analysis is usually evaluated through calibration study rather than relying on interobserver agreement. We demonstrated some of the basic features of calibration using observer-measured rates of free-operant responding from 10 scripted 10-min calibration samples on video. Five novice and 5 experienced observers recorded (on laptop computers) response samples with a priori determined response rates ranging from 0 to 8 responses per minute. Observer records were then compared with these predetermined reference values using linear regression and related graphical depiction. Results indicated that all of the observers recorded rates that were accurate to within ±0.4 responses per minute and 5 were accurate to within ±0.1 responses per minute, indicating that continuous recording of responding on computers can be highly accurate and precise. Additional research is recommended to investigate conditions that affect the quality of direct observational measurement of behavior.
除了行为分析之外，几乎所有自然科学领域使用的测量系统的质量通常都是通过校准研究来评估的，而不是依赖于观察者之间的一致性。我们使用从视频中记录的 10 个脚本化的 10 分钟校准样本中观察到的自由操作反应率，展示了校准的一些基本特征。5 名新手观察者和 5 名有经验的观察者使用预先确定的反应率（从每分钟 0 到 8 次反应）记录了反应样本。然后，观察者的记录通过线性回归和相关图形描述与这些预定的参考值进行比较。结果表明，所有观察者记录的反应率都在每分钟 0.4 次以内，5 次在每分钟 0.1 次以内，这表明在计算机上连续记录反应可以非常准确和精确。建议进行更多的研究，以调查影响行为的直接观察测量质量的条件。
