Bridging local needs and global standards: a socio-cognitive validation study of Japan's EIKEN Pre-2 Plus test

The development of locally contextualised English proficiency tests that maintain global standards is a critical challenge in Asian language testing contexts. Japan's EIKEN Foundation exemplifies this through the development of EIKEN Grade Pre-2 Plus, designed to fill the proficiency gap between existing EIKEN Grades 2 and Pre-2 examinations.
The EIKEN test suite, with over 4 million annual candidates, spans Grade 5 (A1) to Grade 1 (C1). Research shows progression from Grade Pre-2 to Grade 2 takes 18.8 months on average, which makes goal-setting and sustaining motivation challenging for the main candidate group of junior and senior high school students. The new Grade Pre-2 Plus enables the test suite to function more effectively within the local education system by providing yearly targets throughout secondary studies.
This study addresses how locally-developed assessments can achieve contextual appropriateness while ensuring international credibility through rigorous validation. Employing a socio-cognitive framework approach, six international language testing experts conducted a comprehensive review and analysis of extensive test materials from EIKEN Grades 2, Pre-2 Plus, and Pre-2, including sample question booklets across all skills, test specifications, item writer guidelines, candidate performance samples, and rating scales. The analysis focused on features of context validity (i.e. content features), cognitive validity (i.e. cognitive processes), and scoring validity.
The expert review confirmed that Grade Pre-2 Plus exam successfully occupies the intended intermediate position, demonstrating appropriate difficulty calibration. Context validity analysis revealed test content appropriately reflects real-world language use for Japanese learners of English while maintaining CEFR alignment. Cognitive validity analysis indicated test items engage intended cognitive processes at target proficiency levels. Scoring validity highlighted robust assessment procedures, statistically corroborated by post-test validation.
This study demonstrates how systematic expert reviews can support locally-relevant tests which still strive to meet international standards. The findings suggest comprehensive validation frameworks can provide crucial quality assurance for glocalised test development initiatives in Asia and beyond. The study offers a fully worked example of how a socio-cognitive framework approach can effectively contribute to the validation process.