This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Allan, A. I.C.G. Search for Related Content Social Bookmarking                         What's this?

Begging the questionnaire: instrument effect on readers' responses to a self-report checklist

This study investigates the validity of having English as a second language (ESL) test-takers select from a checklist the strategies they believe they use when answering multiple-choice reading comprehension questions. Five groups of tertiary-level ESL male and female students studied the same reading passage and questions, and four groups each sequentially used a different version of a self-report checklist of reading strategies. The checklist was manipulated to establish whether it exercised an effect on users. The most popular strategy, established empirically, was first repositioned on, then removed from, the checklist. It was observed that students then selected an alternative from the modified list rather than volunteer in an open category information about how they had arrived at their answers. A similar finding was noted when the next most popular strategy was also removed from the list. The fifth group responded without the aid of the checklist, and were asked to explain their answering strategies in their own words. This group tended to use words and phrases different from those on the checklist. It was concluded that self-report checklists exercise an instrument effect on users' behaviour and thus can invalidate the data collected. Implications are suggested for test-item validation.

Language Testing, Vol. 12, No. 2, 133-156 (1995)
DOI: 10.1177/026553229501200201


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This article has been cited by other articles:

				D. Allison Investigating learners' course diaries as explorations of language Language Teaching Research, January 1, 1998; 2(1): 24 - 47. [Abstract] [PDF]