Quantifying effects of item response bias: Theory and implications for survey design

PhD Seminar
Campus Woudestein, showcasing the flags of the School's and Institutes.

Item response data are often plagued by biases stemming from content-responsive faking (such as malingering or socially desirable responding) or content nonresponsitivity (particularly careless responding).

Speaker
Max Welz
Date
Wednesday 22 Mar 2023, 13:00 - 14:00
Type
Seminar
Room
M1-04
Building
Van der Goot Building
Add to calendar

While there is consensus that response biases can jeopardize the validity of survey measures through a variety of psychometric issues, their exact effects are yet to be statistically quantified. Leveraging robustness theory, we study the statistical properties of response biases in survey data.

Bias curves and breakdown values

In particular, we derive bias curves and breakdown values of survey measures, with a focus on correlational measures due to their key role in factor analyses and structural equation models. Furthermore, we study how the adverse effects of survey biases can be mitigated by survey design, for instance through the number of answer categories, number of items in a measure, and construct reliability. We find that already low prevalence of response biases can render survey measures fundamentally invalid.

In addition, we show how comparatively short survey measures with a balanced number of reverse-coded items can enhance the robustness of survey measures against response biases.

See also

Private Equity and the Organisation of Firms

Stefan Obernberger (Eramus School of Economics)
2 people sitting at a table with a laptop, smartphone and coffee

Expertise at Work: New Technologies, New Skills, and Worker Impacts

Anna Salamons (Tilburg University)
Hand writing with a red whitemarker on a whiteboard

Four disciplines, one concept: Accountability in a multidisciplinary context

Book launch event for the Handbook of Accountability Research
Handbook of Accountability Research

Compare @count study programme

  • @title

    • Duration: @duration
Compare study programmes