- Author
- Year
- 2008
- Title
- Measurement invariance versus selection invariance: Is fair selection possible?
- Journal
- Psychological Methods
- Volume | Issue number
- 13 | 2
- Pages (from-to)
- 75-98
- Number of pages
- 24
- Document type
- Article
- Faculty
- Faculty of Social and Behavioural Sciences (FMG)
- Institute
- Psychology Research Institute (PsyRes)
- Abstract
-
This article shows that measurement invariance (defined in terms of an invariant measurement model in different groups) is generally inconsistent with selection invariance (defined in terms of equal sensitivity and specificity across groups). In particular, when a unidimensional measurement instrument is used and group differences are present in the location but not in the variance of the latent distribution, sensitivity and positive predictive value will be higher in the group at the higher end of the latent dimension, whereas specificity and negative predictive value will be higher in the group at the lower end of the latent dimension. When latent variances are unequal, the differences in these quantities depend on the size of group differences in variances relative to the size of group differences in means. The effect originates as a special case of Simpson’s paradox, which arises because the observed score distribution is collapsed into an accept-reject dichotomy. Simulations show the effect can be substantial in realistic situations. It is suggested that the effect may be partly responsible for overprediction in minority groups as typically found in empirical studies on differential academic performance. A methodological solution to the problem is suggested, and social policy implications are discussed.
- URL
- go to publisher's site
- Link
- Link
- Language
- Undefined/Unknown
- Permalink
- http://hdl.handle.net/11245/1.294099
Disclaimer/Complaints regulations
If you believe that digital publication of certain material infringes any of your rights or (privacy) interests, please let the Library know, stating your reasons. In case of a legitimate complaint, the Library will make the material inaccessible and/or remove it from the website. Please Ask the Library, or send a letter to: Library of the University of Amsterdam, Secretariat, Singel 425, 1012 WP Amsterdam, The Netherlands. You will be contacted as soon as possible.