Advanced Search

Journal Navigation

Journal Home

Subscriptions

Archive

Contact Us

Table of Contents

Sign In to gain access to subscriptions and/or personal tools.
Language Testing
This Article
Right arrow Full Text (PDF)
Right arrow References
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Add to Saved Citations
Right arrow Download to citation manager
Right arrowRequest Permissions
Right arrow Request Reprints
Right arrow Add to My Marked Citations
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Right arrow Citing Articles via Scopus
Google Scholar
Right arrow Articles by Pollitt, A.
Right arrow Articles by Hutchinson, C.
Right arrow Search for Related Content
Social Bookmarking
 Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati   Add to Twitter  
What's this?

Calibrating graded assessments: Rasch partial credit analysis of performance in writing

Alastair Pollitt

University of Edinburgh

Carolyn Hutchinson

University of Edinburgh

Language tests have until now followed one or other of two strategies, focusing either on the difficulty of the questions or on the quality of the performance, but never on both. This article describes the use of the partial credit form of the Rasch model in the analysis and calibration of a set of writing tasks. Qualitative assessments of components of writing competence are rescaled to take into account the empirical difficulty of each grade in each assessment, in order to pro vide more generalisable measures of writing ability.

To exploit this kind of test analysis in assessing language production, it is necessary that the tasks be carefully controlled and that the assessment scales and criteria be adapted to suit the specific demands of each task. The analysis shows the pattern of grade difficulties across task competents and this pattern is dis cussed in some detail. For these tasks at least, it appears that the difficulty of minimally engaging with a task is highly task specific whereas the difficulty of achieving competence in the task depends more on competence in the compo nents of writing skill.

Language Testing, Vol. 4, No. 1, 72-92 (1987)
DOI: 10.1177/026553228700400107


Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati   Add to Twitter Twitter    What's this?


This article has been cited by other articles:


Home page
Language TestingHome page
Guoxing Yu
Students' voices in the evaluation of their written summaries: Empowerment and democracy for test takers?
Language Testing, October 1, 2007; 24(4): 539 - 572.
[Abstract] [PDF]


Home page
Language TestingHome page
Y. Sawaki
Construct validation of analytic rating scales in a speaking assessment: Reporting a score profile and a composite
Language Testing, July 1, 2007; 24(3): 355 - 390.
[Abstract] [PDF]


Home page
Language TestingHome page
L. F. Bachman, B. K. Lynch, and M. Mason
Investigating variability in tasks and rater judgements in a performance test of foreign language speaking
Language Testing, July 1, 1995; 12(2): 238 - 257.
[Abstract] [PDF]


Home page
Language TestingHome page
J. Read
The development of a new measure of L2 vocabulary knowledge
Language Testing, December 1, 1993; 10(3): 355 - 371.
[Abstract] [PDF]


Home page
Language TestingHome page
T.F. McNamara
Test dimensionality: IRT analysis of an ESP listening test1
Language Testing, December 1, 1991; 8(2): 139 - 159.
[Abstract] [PDF]


Home page
Language TestingHome page
T.F. McNamara
Item Response Theory and the validation of an ESP test for health professionals
Language Testing, June 1, 1990; 7(1): 52 - 76.
[Abstract] [PDF]


Home page
Language TestingHome page
B. Spolsky
Test review: Griffin, P.E., Adams, R.J., Martin, L. and Tomlinson, B. 1986: Proficiency in English as a second language. (1) The development of an interview test for adult migrants. (2) The administration and creation of a test. (3) An interview test of English as a second language. Ministry of Education (Schools Division), Victoria
Language Testing, June 1, 1988; 5(1): 120 - 124.
[PDF]