Quantifying effects of item response bias: Theory and implications for survey design

PhD Seminar
Image of the campus woudestein, showcasing the flags of the School's and Institutes
Speaker
Date
Wednesday 22 Mar 2023, 13:00 - 14:00
Type
Seminar
Room
M1-04
Building
Van der Goot Building
Add to calendar
Image of the campus woudestein, showcasing the flags of the School's and Institutes

Item response data are often plagued by biases stemming from content-responsive faking (such as malingering or socially desirable responding) or content nonresponsitivity (particularly careless responding).

While there is consensus that response biases can jeopardize the validity of survey measures through a variety of psychometric issues, their exact effects are yet to be statistically quantified. Leveraging robustness theory, we study the statistical properties of response biases in survey data.

Bias curves and breakdown values

In particular, we derive bias curves and breakdown values of survey measures, with a focus on correlational measures due to their key role in factor analyses and structural equation models. Furthermore, we study how the adverse effects of survey biases can be mitigated by survey design, for instance through the number of answer categories, number of items in a measure, and construct reliability. We find that already low prevalence of response biases can render survey measures fundamentally invalid.

In addition, we show how comparatively short survey measures with a balanced number of reverse-coded items can enhance the robustness of survey measures against response biases.

See also

Peer Perceptions and Students’ Investments in Schoolwork

Fanny Landaud (CY Cergy Paris University)
 Boy in black hoodie sitting on chair in a classroom looking at the teacher in front

2024 Annual Conference of the European Society for Population Economics

The 37th Annual Conference of the European Society for Population Economics (ESPE), hosted by Erasmus University Rotterdam.
ESE - Theil Building

Compare @count study programme

  • @title

    • Duration: @duration
Compare study programmes