Survey conditioning in self-reported mental health service use: randomized comparison of alternative instrument formats.

OBJECTIVE

To test the effect of survey conditioning (whether observed survey responses are affected by previous experience in the same survey or similar surveys) in a survey instrument used to assess mental health service use.

DATA SOURCES

Primary data collected in the National Latino and Asian American Study, a cross-sectional household survey of Latinos and Asian Americans residing in the United States.

STUDY DESIGN

Study participants are randomly assigned to a Traditional Instrument with an interleafed format placing service use questions after detailed questions on disorders, or a Modified Instrument with an ensemble format screening for service use near the beginning of the survey. We hypothesize the ensemble format to be less susceptible to survey conditioning than the interleafed format. We compare self-reported mental health services use measures (overall, aggregate categories, and specific categories) between recipients of the two instruments, using 2x2 chi(2) tests and logistic regressions that control for key covariates.

DATA COLLECTION

In-person computer-assisted interviews, conducted in respondent's preferred language (English, Spanish, Mandarin Chinese, Tagalog, or Vietnamese).

PRINCIPAL FINDINGS

Higher service use rates are reported with the Modified Instrument than with the Traditional Instrument for all service use measures; odds ratios range from 1.41 to 3.10, all p-values <.001. Results are similar across ethnic groups and insensitive to model specification.

CONCLUSIONS

Survey conditioning biases downward reported mental health service use when the instrument follows an interleafed format. An ensemble format should be used when it is feasible for measures that are susceptible to survey conditioning.