The impact of delivery mode on test scores, test takers’ processes and experience: computer-based vs tablet-based IELTS writing

Delivery mode of language tests relates to context validity of a test as how the test is administered affects the environment in which test takers perform the task and hence also influences their processes of completing the test task. In response to the digitalisation of academic writing in higher education (HE), the study aims to examine the validity argument evidence for two electronic delivery modes of the IELTS Academic Writing Task 2, that is, computer and tablet, in relation to three aspects: test scores and text quality features of writing performance, writing processes and test takers’ experience between completing the test on a computer and on a tablet. To address these goals, we examined whether and, if so, in what way, test takers’ performance is impacted by delivery mode. We also investigated the cognitive processes of L2 test takers performing the IELTS Academic Writing Task 2 on a computer and on a tablet, informed by models of writing (Kellogg, 1996; Shaw & Weir, 2007). Test takers’ experience and their overall perception of using a tablet to complete a writing test task was surveyed. Based on the findings, recommendations for the provision of a tablet-delivery mode in high-stakes assessment are provided.