Following those assessments, invariance was calculated through multigroup confirmatory factor analysis, which helped indicate whether the questions are interpreted similarly by sub-groups of the sample. Scales that perform well in the confirmatory factor analysis and reliability analyses may not provide valid and reliable measures of the construct for all demographic subgroups, especially those traditionally marginalized. Invariance testing helps us understand if a given measure is being interpreted in the same way across different cultural backgrounds and other types of demographics, which allows researchers to make more accurate comparisons across groups.
Researchers have a responsibility to ensure reliability with the construct being tested to study the populations and sub-groups in their study, and it is especially important when investigating traditionally marginalized groups who were not likely to have been represented in the original scale development process. This study is a great step for assessment of existing scales, but it does require additional research so that more groups can be included to support scale development and selection. The next steps could include further demographic characteristics for these scales and an evaluation of further scales not included in the study with confirmatory factor analysis and measurement invariance to specify their issues and identify solutions. Additionally, NEFE is in the process of collaborating with the panel to produce a consensus paper sharing recommendations emerging from this project and a set of methodological studies to address specific topics raised during the project.