Skip to search boxSkip to navigationSkip to main content

Establishing test form and individual task comparability: a case study of a semi-direct speaking test

  • Cyril Weir
    ,
  • Jessica R.W. Wu
Research Output: Contribution to journal Article Peer-review

Abstract

Examination boards are often criticized for their failure to provide evidence of comparability across forms, and few such studies are publicly available. This study aims to investigate the extent to which three forms of the General English Proficiency Test Intermediate Speaking Test (GEPTS-I) are parallel in terms of two types of validity evidence: parallel-forms reliability and content validity. The three trial test forms, each containing three different task types (read-aloud, answering questions and picture description), were administered to 120 intermediate-level EFL learners in Taiwan. The performance data from the different test forms were analysed using classical procedures and Multi-Faceted Rasch Measurement (MFRM). Various checklists were also employed to compare the tasks in different forms qualitatively in terms of content. The results showed that all three test forms were statistically parallel overall and Forms 2 and 3 could also be considered parallel at the individual task level. Moreover, sources of variation to account for the variable difficulty of tasks in Form 1 were identified by the checklists. Results of the study provide insights for further improvement in parallel-form reliability of the GEPTS-I at the task level and offer a set of methodological procedures for other exam boards to consider. © 2006 Edward Arnold (Publishers) Ltd.

Publication Information

Output type

Research Output: Contribution to journal Article Peer-review

Original language

English

Pages from-to (Number of pages)

Pages 167-197

Journal (Volume, Issue Number)

Language Testing (Volume 23, Issue 2)

Publication milestones

  • Published - 01/04/2006

Publication status

Published - 01/04/2006

ISSN

0265-5322

External Publication IDs

  • handle.net: 10547/623672
  • Scopus: 33646243570

Access to documents

Publication metrics