Population Research and Outcome Studies, Department of Medicine, University of Adelaide, Level 3, 122 Frome St, Adelaide, South Australia 5000, Australia.
BMC Med Res Methodol. 2012 Jul 26;12:108. doi: 10.1186/1471-2288-12-108.
Accurate monitoring of health conditions and behaviours, and health service usage in the population, using an effective and economical method is important for planning and evaluation. This study examines the reliability of questions asked in a telephone survey by conducting a test/retest analysis of a range of questions covering demographic variables, health risk factors and self-reported chronic conditions among people aged 16 years and over.
A Computer Assisted Telephone Interviewing (CATI) survey on health issues of South Australians was re-administered to a random sub-sample of 154 respondents between 13-35 days (mean 17) after the original survey. Reliability between questions was assessed using Cohen's kappa and intraclass correlation coefficients.
Demographic questions (age, gender, number of adults and children in the household, country of birth) showed extremely high reliability (0.97 to 1.00). Health service use (ICC = 0.90 95% CI 0.86-0.93) and overall health status (Kappa = 0.60 95% CI 0.46-0.75) displayed moderate agreement. Questions relating to self-reported risk factors such as smoking (Kappa = 0.81 95% CI 0.72-0.89) and alcohol drinking (ICC 0.75 = 95% CI 0.63-0.83) behaviour showed good to excellent agreement, while questions relating to self-reported risk factors such as time spent walking for physical activity (ICC 0.47 = 95% CI 0.27-0.61), fruit (Kappa(w) = 0.60 95% CI 0.45-0.76) and vegetable consumption (Kappa(w) = 0.50 95% CI 0.32-0.69) showed only moderate agreement. Self-reported chronic conditions displayed substantial to almost perfect agreement (0.72 to 1.00) with the exception of moderate agreement for heart disease (Kappa = 0.82 95% CI 0.57-0.99).
These results show the questions assessed to be reliable in South Australia for estimating health conditions and monitoring health related behaviours using a CATI survey.
使用有效且经济的方法准确监测人群的健康状况和行为以及卫生服务利用情况,对于规划和评估至关重要。本研究通过对一系列涵盖人口统计学变量、健康风险因素和自我报告的慢性疾病的问题进行测试/重测分析,来检验电话调查中提出的问题的可靠性。
对南澳大利亚州的健康问题进行了计算机辅助电话访谈(CATI)调查,然后在原始调查后 13-35 天(平均 17 天)对随机抽取的 154 名受访者的一个随机子样本重新进行了调查。使用 Cohen's kappa 和组内相关系数评估问题之间的可靠性。
人口统计学问题(年龄、性别、家庭中成年人和儿童的数量、出生国家)显示出极高的可靠性(0.97 至 1.00)。卫生服务使用(ICC=0.90 95%CI 0.86-0.93)和总体健康状况(Kappa=0.60 95%CI 0.46-0.75)显示出中等一致性。自我报告的风险因素(如吸烟(Kappa=0.81 95%CI 0.72-0.89)和饮酒(ICC 0.75=95%CI 0.63-0.83)行为等方面的问题显示出良好到优秀的一致性,而自我报告的风险因素(如身体活动时的步行时间(ICC 0.47=95%CI 0.27-0.61)、水果(Kappa(w)=0.60 95%CI 0.45-0.76)和蔬菜摄入量(Kappa(w)=0.50 95%CI 0.32-0.69)等方面的问题仅显示出中等一致性。自我报告的慢性疾病显示出实质性到近乎完美的一致性(0.72 至 1.00),除了心脏病(Kappa=0.82 95%CI 0.57-0.99)中度一致。
这些结果表明,在澳大利亚南部使用 CATI 调查评估健康状况和监测与健康相关的行为时,评估的问题是可靠的。