Skip to search boxSkip to navigationSkip to main content

Researching the comparability of paper-based and computer-based delivery in a high-stakes writing test

Research Output:
Contribution to journal
Article
 Peer-review

Open access

Abstract

International language testing bodies are now moving rapidly towards using computers for many areas of English language assessment, despite the fact that research on comparability with paper-based assessment is still relatively limited in key areas. This study contributes to the debate by researching the comparability of a highstakes EAP writing test (IELTS) in two delivery modes, paper-based (PB) and computer-based (CB). The study investigated 153 test takers' performances and their cognitive processes on IELTS Academic Writing Task 2 in the two modes, and the possible effect of computer familiarity on their test scores. Many-Facet Rasch Measurement (MFRM) was used to examine the difference in test takers' scores between the two modes, in relation to their overall and analytic scores. By means of questionnaires and interviews, we investigated the cognitive processes students employed under the two conditions of the test. A major contribution of our study is its use - for the first time in the computer-based writing assessment literature - of data from research into cognitive processes within realworld academic settings as a comparison with cognitive processing during academic writing under test conditions. In summary, this study offers important new insights into academic writing assessment in computer mode.

Publication Information

Output type

Research Output:
Contribution to journal
Article
 Peer-review

Original language

English

Pages from-to (Number of pages)

Pages 32-48

Journal (Volume, Issue Number)

Assessing Writing (Volume 36)

Publication milestones

  • Accepted/In press - 25/03/2018
  • Published - 07/04/2018

Publication status

Published - 07/04/2018

ISSN

1075-2935

Publication IDs

  • handle.net: 10547/622715
  • Scopus: 85045086058

Access to documents

Publication metrics

Metrics

Download statistics
Download count
11