Preprints are early versions of research articles that have not been peer reviewed. They should not be regarded as conclusive and should not be reported in news media as established information.
Download file
Download file
2 files

Improving Cross-Cultural Comparability of Measures on Gender and Age Stereotypes by Means of Piloting Methods

Download all (1.56 MB)
posted on 2023-03-03, 10:13 authored by Natalja MenoldNatalja Menold, Patricia Hadler, Cornelia Neuert


The study addresses the effects of piloting methods on the reliability and cross-cultural comparability of the measurement of stereotypes. A gender roles instrument from the European Values Study, an ageism instrument, and children stereotypes from the International Social Survey Program were piloted in German and American English and revised based on findings from cognitive interviews, web probing, and expert reviews involving national experts or additionally cross-cultural experts. The original and each piloted version were randomly assigned to respondents in Germany and the U.S. using an online survey and quota samples. The original gender roles and children stereotypes instruments did not face configural invariance and reliability was insufficiently low. The results show that piloting methods can increase insufficient reliability. Measurement invariance could be improved by piloting methods, but effects varied by the type of revisions implemented. Cross-cultural expert reviews and web probing provided more consistent results than other methods. A combination of methods would be optimal to improve reliability and measurement invariance. 


A part of the work of the corresponding author was supported by the German Research Foundation (ME 3538/10-1).


Corresponding author email

Lead author country

  • Germany

Human Participants

  • Yes

Ethics statement

written informed consent was obtained

Terms agreed

  • Yes, I agree to Advance terms


Log in to write your comment here...