This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Buck, G. Articles by Tatsuoka, K. Search for Related Content Social Bookmarking                         What's this?

Application of the rule-space procedure to language testing: examining attributes of a free response listening test

Educational Testing Service, gbuck{at}ets.org

Kikumi Tatsuoka

Educational Testing Service

This study uses the rule-space methodology to explore the cognitive and linguistic attributes that underlie performance on an open-ended, short-answer, listening comprehension test. This is the first application of the methodology to language testing. The rule-space methodology is an adaptation of statistical pattern recognition techniques applied to the problem of diagnosing the cognitive attributes (knowledge, skills, abilities, strategies, etc.) underlying test performance. The methodology provides diagnostic information about the individual test-takers on each of these attributes. Based on a literature search, attribute candidates were identified which seemed likely to explain performance on the listening test. Two rule-space analyses were carried out, and the final attribute list had 15 attributes, with 14 interactions. With this, 96% of the test-takers were successfully classified into their respective latent knowledge states, and given scores on each attribute. This result suggests that the rule-space methodology can be used to identify attributes underlying performance on language tests. The study also provided useful information about the listening construct.

Language Testing, Vol. 15, No. 2, 119-157 (1998)
DOI: 10.1177/026553229801500201


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This article has been cited by other articles:

				E. E. Jang Cognitive diagnostic assessment of L2 reading comprehension ability: Validity arguments for Fusion Model application to LanguEdge assessment Language Testing, January 1, 2009; 26(1): 031 - 73. [Abstract] [PDF]

				M.-Y. Song Do divisible subskills exist in second language (L2) comprehension? A structural equation modeling approach Language Testing, October 1, 2008; 25(4): 435 - 464. [Abstract] [PDF]

				K. K. Tatsuoka, J. E. Corter, and C. Tatsuoka Patterns of Diagnosed Mathematical Content and Process Skills in TIMSS-R Across a Sample of 20 Countries American Educational Research Journal, January 1, 2004; 41(4): 901 - 926. [Abstract] [PDF]

				G. Brindley and H. Slatyer Exploring task difficulty in ESL listening assessment Language Testing, October 1, 2002; 19(4): 369 - 394. [Abstract] [PDF]