Methods Effects in Factorial Surveys: An Analysis of Respondents' Comments, Interviewers' Assessments, and Response Behavior

Sauer C, Auspurg K, Hinz T, Liebig S, Schupp J (2014) SOEPpapers; 629.
Berlin: DIW.

Download
OA
Working Paper | Published | English
Author
; ; ; ;
Abstract
This paper describes the implementation of a factorial survey within the SOEP-Pretest of 2008 and investigates (1) respondents' comments about the vignettes, (2) interviewers' assessments of respondents comprehension and willingness to answer, and (3) response behavior regarding response time, use of the answering scale, and consistency of evaluations by different age groups and educational background. The respondents evaluated 24 vignettes consisting of ten dimensions that described full-time employees and their gross earnings. The evaluation task was to assess whether the given earnings were just or unjust, and if they were rated as unjust, respondents had to specify the amount of injustice on an 100-point rating scale. In regard to respondents' comments, the critique mentioned most frequently by respondents referred to the content (unrealistic descriptions) and the number of the vignettes. The analysis of the interviewers' assessments of respondents' comprehension and willingness to answer revealed less comprehension and willingness to answer for older and less well educated respondents, although these differences were similar to those found for the complete questionnaire. The analysis of the response behavior revealed no di erences of response time between the groups. Analyses of response consistency show that one should consider hints for simplifying heuristics: such heuristics can lead to an artificially high response consistency. The implications of the findings are discussed.
Publishing Year
PUB-ID

Cite this

Sauer C, Auspurg K, Hinz T, Liebig S, Schupp J. Methods Effects in Factorial Surveys: An Analysis of Respondents' Comments, Interviewers' Assessments, and Response Behavior. SOEPpapers. Vol 629. Berlin: DIW; 2014.
Sauer, C., Auspurg, K., Hinz, T., Liebig, S., & Schupp, J. (2014). Methods Effects in Factorial Surveys: An Analysis of Respondents' Comments, Interviewers' Assessments, and Response Behavior (SOEPpapers, 629). Berlin: DIW.
Sauer, C., Auspurg, K., Hinz, T., Liebig, S., and Schupp, J. (2014). Methods Effects in Factorial Surveys: An Analysis of Respondents' Comments, Interviewers' Assessments, and Response Behavior. SOEPpapers, 629, Berlin: DIW.
Sauer, C., et al., 2014. Methods Effects in Factorial Surveys: An Analysis of Respondents' Comments, Interviewers' Assessments, and Response Behavior, SOEPpapers, no.629, Berlin: DIW.
C. Sauer, et al., Methods Effects in Factorial Surveys: An Analysis of Respondents' Comments, Interviewers' Assessments, and Response Behavior, SOEPpapers, vol. 629, Berlin: DIW, 2014.
Sauer, C., Auspurg, K., Hinz, T., Liebig, S., Schupp, J.: Methods Effects in Factorial Surveys: An Analysis of Respondents' Comments, Interviewers' Assessments, and Response Behavior. SOEPpapers, 629. DIW, Berlin (2014).
Sauer, Carsten, Auspurg, Katrin, Hinz, Thomas, Liebig, Stefan, and Schupp, Jürgen. Methods Effects in Factorial Surveys: An Analysis of Respondents' Comments, Interviewers' Assessments, and Response Behavior. Berlin: DIW, 2014. SOEPpapers. 629.
Main File(s)
Access Level
OA Open Access
Last Uploaded
2014-02-26 19:59:52

This data publication is cited in the following publications:
This publication cites the following data publications:

Export

0 Marked Publications

Open Data PUB

Search this title in

Google Scholar