Advanced Search

Journal Navigation

Journal Home

Subscriptions

Archive

Contact Us

Table of Contents

Sign In to gain access to subscriptions and/or personal tools.
Language Testing
This Article
Right arrow Full Text (PDF)
Right arrow References
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Add to Saved Citations
Right arrow Download to citation manager
Right arrowRequest Permissions
Right arrow Request Reprints
Right arrow Add to My Marked Citations
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Right arrow Citing Articles via Scopus
Google Scholar
Right arrow Articles by Deville, C.
Right arrow Articles by Chalhoub-Deville, M.
Right arrow Search for Related Content
Social Bookmarking
 Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati   Add to Twitter  
What's this?

Modified scoring, traditional item analysis and Sato's caution index used to investigate the reading recall protocol

Craig Deville

The Ohio State University, 116 E. Woodruff Avenue, Apt E, Columbus, Ohio 43201

Micheline Chalhoub-Deville

The Ohio State University, 116 E. Woodruff Avenue, Apt E, Columbus, Ohio 43201

The written recall protocol is increasingly being used in second language reading research as a measure of comprehension. Although the recall protocol is an essay-like instrument, the total score derived is based entirely on summing the discrete propositions correctly recalled. Consequently, item and reliability analyses comparable to those run on multiple-choice tests can and should be performed on recall protocols and on other integrative measures. The purpose of this study is to demonstrate how modified scoring, item and internal consistency analyses, along with Sato's caution indices, can be used to evaluate the quality of the recall protocol as a reading comprehen sion measure. Issues concerning the assumptions underlying classical local independence are discussed with regard to the reading recall protocol and other integrative measures. Results indicate that the procedures can be applied and can yield interpretable results. These results need to be replicated using other texts and other weighting systems. Only when recall protocols are routinely subjected to item and reliability analyses comparable to those performed on other measures, can the instrument be considered a viable alternative.

Language Testing, Vol. 10, No. 2, 117-131 (1993)
DOI: 10.1177/026553229301000202


Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati   Add to Twitter Twitter    What's this?


This article has been cited by other articles:


Home page
Language TestingHome page
Guoxing Yu
Reading to summarize in English and Chinese: A tale of two languages?
Language Testing, October 1, 2008; 25(4): 521 - 551.
[Abstract] [PDF]


Home page
Language TestingHome page
Guoxing Yu
Students' voices in the evaluation of their written summaries: Empowerment and democracy for test takers?
Language Testing, October 1, 2007; 24(4): 539 - 572.
[Abstract] [PDF]


Home page
Language TestingHome page
J. Sherman
The effect of question preview in listening comprehension tests
Language Testing, July 1, 1997; 14(2): 185 - 213.
[Abstract] [PDF]