|
Sign In to gain access to subscriptions and/or personal tools.
|
Calibrating graded assessments: Rasch partial credit analysis of performance in writing
Alastair Pollitt
University of Edinburgh
Carolyn Hutchinson
University of Edinburgh
Language tests have until now followed one or other of two strategies, focusing either on the difficulty of the questions or on the quality of the performance, but never on both. This article describes the use of the partial credit form of the Rasch model in the analysis and calibration of a set of writing tasks. Qualitative assessments of components of writing competence are rescaled to take into account the empirical difficulty of each grade in each assessment, in order to pro vide more generalisable measures of writing ability.
To exploit this kind of test analysis in assessing language production, it is necessary that the tasks be carefully controlled and that the assessment scales and criteria be adapted to suit the specific demands of each task. The analysis shows the pattern of grade difficulties across task competents and this pattern is dis cussed in some detail. For these tasks at least, it appears that the difficulty of minimally engaging with a task is highly task specific whereas the difficulty of achieving competence in the task depends more on competence in the compo nents of writing skill.
Language Testing, Vol. 4, No. 1,
72-92 (1987)
DOI: 10.1177/026553228700400107

CiteULike Complore Connotea Del.icio.us Digg Reddit Technorati Twitter What's this?
This article has been cited by other articles:

|
 |

|
 |
 
Guoxing Yu
Students' voices in the evaluation of their written summaries: Empowerment and democracy for test takers?
Language Testing,
October 1, 2007;
24(4):
539 - 572.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
Y. Sawaki
Construct validation of analytic rating scales in a speaking assessment: Reporting a score profile and a composite
Language Testing,
July 1, 2007;
24(3):
355 - 390.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
L. F. Bachman, B. K. Lynch, and M. Mason
Investigating variability in tasks and rater judgements in a performance test of foreign language speaking
Language Testing,
July 1, 1995;
12(2):
238 - 257.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
J. Read
The development of a new measure of L2 vocabulary knowledge
Language Testing,
December 1, 1993;
10(3):
355 - 371.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
T.F. McNamara
Test dimensionality: IRT analysis of an ESP listening test1
Language Testing,
December 1, 1991;
8(2):
139 - 159.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
T.F. McNamara
Item Response Theory and the validation of an ESP test for health professionals
Language Testing,
June 1, 1990;
7(1):
52 - 76.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
B. Spolsky
Test review: Griffin, P.E., Adams, R.J., Martin, L. and Tomlinson, B. 1986: Proficiency in English as a second language. (1) The development of an interview test for adult migrants. (2) The administration and creation of a test. (3) An interview test of English as a second language. Ministry of Education (Schools Division), Victoria
Language Testing,
June 1, 1988;
5(1):
120 - 124.
[PDF]
|
 |
|
|
|