Project Details
Description
Funded by the Steel Trust, the team developed and validated the Bedfordshire Academic Reading and Reading-into-Writing Test (BART) to provide a diagnostic assessment of all incoming students' academic reading abilities.
This project focused on the development of diagnostic tests of academic reading and writing for newly arriving students. The project was prompted by shifts in the demographic makeup of UK university populations. The widening participation agenda and the recruitment of significant numbers of international students mean that students arrive with diverse educational backgrounds and varying levels of academic skills. If students are to succeed in their academic studies and maximise the personal benefit from their studies, universities must identify those students, both domestic & international, who need support with academic reading and writing. Such identification needs to take place at the earliest possible opportunity following entry to the university to ensure they are offered the best chance of addressing any problem areas.
This project focused on the development of diagnostic tests of academic reading and writing for newly arriving students. The project was prompted by shifts in the demographic makeup of UK university populations. The widening participation agenda and the recruitment of significant numbers of international students mean that students arrive with diverse educational backgrounds and varying levels of academic skills. If students are to succeed in their academic studies and maximise the personal benefit from their studies, universities must identify those students, both domestic & international, who need support with academic reading and writing. Such identification needs to take place at the earliest possible opportunity following entry to the university to ensure they are offered the best chance of addressing any problem areas.
Key findings
The project developed and piloted multiple versions of BART and BART-W. The tests are relatively short, less than 2 hours to take both papers, and the marking of papers is quick and efficient with robust and straightforward marking schemes. The reading test can be marked automatically online as soon as students complete it. The reading-into-writing test can be marked by course leaders/lecturers.
The tests categorise students into three groups: Needs comprehensive support / Needs some support / Needs no support in academic reading and academic reading-into-writing skills. The test scores are diagnostic in nature, and the scores identify students needing comprehensive support / some support or no support, with the scores in each sub-category indicating where any deficit lies.
For example, reading scores indicate:
1. ability to read carefully to extract an accurate understanding of the text
2. ability to connect information across texts: intertextual skills
3. ability to read quickly and selectively for main ideas
The Reading-into-Writing scores indicate writing ability relating to:
1. Relevance and adequacy of content (coverage of key points)
2. Organisation (cohesion and coherence)
3. Language (choice and control of lexis, grammar)
The tests categorise students into three groups: Needs comprehensive support / Needs some support / Needs no support in academic reading and academic reading-into-writing skills. The test scores are diagnostic in nature, and the scores identify students needing comprehensive support / some support or no support, with the scores in each sub-category indicating where any deficit lies.
For example, reading scores indicate:
1. ability to read carefully to extract an accurate understanding of the text
2. ability to connect information across texts: intertextual skills
3. ability to read quickly and selectively for main ideas
The Reading-into-Writing scores indicate writing ability relating to:
1. Relevance and adequacy of content (coverage of key points)
2. Organisation (cohesion and coherence)
3. Language (choice and control of lexis, grammar)
| Status | Finished |
|---|---|
| Effective start/end date | 5/06/16 → 1/06/20 |
Fingerprint
Explore the research topics touched on by this project. These labels are generated based on the underlying awards/grants. Together they form a unique fingerprint.
-
Use of keystroke logging to collect cognitive validity evidence for integrated writing tests
Chan, S., 1 Oct 2024, Language Test Validation in a Digital Age. UK: Cambridge University Press, (Studies in Language Testing; no. 52).Research output: Chapter in Book/Report/Conference proceeding › Chapter › peer-review
Open AccessFile3 Downloads (Pure) -
Placing construct definition at the heart of assessment: research, design and a priori validation
Latimer, N. & Chan, S., 1 Apr 2020, Lessons and Legacy: A Tribute to Professor Cyril J Weir (1950–2018). Cambridge: Cambridge University Press, p. 105-131 (Studies in language testing; no. 50).Research output: Chapter in Book/Report/Conference proceeding › Chapter › peer-review
-
Developing an academic literacy test for university students
Latimer, N., 27 Mar 2019.Research output: Contribution to conference › Paper › peer-review
Open AccessFile4 Downloads (Pure)