Alignment Optimization in International Large-Scale Assessments: A Scoping Review and Future Directions

Andrés Sandoval-Hernández, Diego Carrasco, Nurullah Eryilmaz

Research output: Contribution to journalArticlepeer-review

Abstract

This scoping review critically examines the application of alignment optimization in international large-scale assessments (ILSAs) to address measurement invariance challenges, a fundamental issue for ensuring valid cross-national comparisons in educational research. By systematically analyzing 18 empirical studies across prominent ILSAs—including PISA, TALIS, TIMSS, and ICCS—this review synthesizes evidence on the effectiveness of alignment optimization in enhancing cross-national comparability across diverse cultural and linguistic contexts. While alignment optimization demonstrates promise in achieving approximate measurement invariance, findings reveal significant variability in its performance, particularly for constructs influenced by cultural and linguistic diversity. The review identifies key limitations, such as high non-invariance rates for culturally sensitive constructs and inconsistencies in reporting standards, which hinder the method's reliability and generalizability. The study contributes to the theoretical and methodological discourse on educational measurement by proposing targeted recommendations for advancing alignment optimization, including the integration of hybrid approaches, improved reporting protocols, and the exploration of underrepresented cultural contexts. These insights are critical for refining the robustness of cross-national comparisons in ILSAs, ultimately supporting more equitable and reliable educational assessments globally. By addressing these challenges, this review lays the groundwork for future research to enhance the validity and applicability of alignment optimization in international educational research, offering significant implications for policy and practice.
Original languageEnglish
Article number16
Number of pages25
JournalEducational Methods & Psychometrics
Volume3
Issue number16
Early online date10 Feb 2025
DOIs
Publication statusE-pub ahead of print - 10 Feb 2025

Data Availability Statement

The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.

Acknowledgements

We also extend my thanks to the colleagues and experts associated with the IEA for their invaluable insights and encouragement throughout the research process.

Funding

This research was supported by funding from the International Association for the Evaluation of Educational Achievement (IEA) Research and Development (R&D) funding program. We are deeply grateful to the IEA for providing the financial resources and institutional support that made this work possible. Their commitment to advancing educational research has been instrumental in enabling this study.

Keywords

  • Alignment Optimization
  • nternational Large-Scale Assessments (ILSAs)
  • Measurement Invariance
  • Cross-National Comparability,
  • educational assessments

Fingerprint

Dive into the research topics of 'Alignment Optimization in International Large-Scale Assessments: A Scoping Review and Future Directions'. Together they form a unique fingerprint.

Cite this