This Article Abstract Free Full Text (Free PDF) Free Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Ockey, G. J. Search for Related Content Social Bookmarking                         What's this?

Construct implications of including still image or video in computer-based listening tests

University of New Mexico, USA, ockey{at}unm.edu

Over the past decade, listening comprehension tests have been converting to computer-based tests that include visual input. However, little research is available to suggest how test takers engage with different types of visuals on such tests. The present study compared a series of still images to video in academic computer-based tests to determine how test takers engage with these two test modes. The study, which employed observations, retrospective reports and interviews, used data from university-level non-native speakers of English. The findings suggest that test takers engage differently with these two modes of delivery. Specifically, while test takers engaged minimally and similarly with the still images, there was wide variation in the ways and degree to which they engaged with the video stimulus. Implications of the study are that computer-based tests of listening comprehension could include still images with only minimally altering the construct that is measured by audio-only listening tests, but the utilization of video in such computer-based tests may require a rethinking of the listening construct.

References

• Bachman L.F. and Palmer, A.S. 1996: Language testing in practice. Oxford: Oxford University Press.
• Blau, E. 1991: More on comprehensible input: The effect of pauses and hesitation markers on listening comprehension, ERIC DOC. NO. ED340 234.
• Buck, G. 1991: The testing of listening comprehension: An introspective study. Language Testing 8: 67—91.[Abstract/Free Full Text]
• ——— 2001: Assessing listening. Cambridge: Cambridge University Press.
• Chaudron, C. and Richards, J. 1986: The effects of discourse markers on the comprehension of lectures. Applied Linguistics 7: 113—27.[CrossRef]
• Choi, I-C., Kim, K. and Boo, J. 2003: Comparability of a paper-based language test and a computer-based language test. Language Testing 20: 295—320.[Abstract/Free Full Text]
• Chung, U.K. 1994: The effect of audio, a single picture, multiple pictures, or video on second language listening comprehension. Unpublished doctoral dissertation, University of Illinois at Urbana-Champaign.
• Coniam, D. 2000: The use of audio or video comprehension as an assessment instrument in the certification of English language teachers: A case study. System 29: 1—14.
• Dodd, B. and Campbell, R. 1987: Hearing by eye: The psychology of lip-reading. London: Lawrence Erlbaum.
• Dunkel, P. and Davis, A. 1994: The effects of rhetorical signaling cues on the recall of English lecture information by speakers of English as a second or native language. In Flowerdew, J., editor, Academic Listening: Research Perspectives, Cambridge: Cambridge University Press, 55—74.
• Eisenstein, M. and Berkowitz, D. 1981: The effect of phonological variation on adult learner comprehension. Studies in Second Language Acquisition 4: 75—80.
• Ericsson, K. and Simon, H. 1993: Protocol analysis. Cambridge, MA: MIT Press.
• Ets n.d.: Retrieved 18 October 2006, from http://www.ets.org.
• Flowerdew, J. 1994: Research of relevance to second language lecture comprehension — an overview. In Flowerdew, J., editor, Academic listening: research perspectives, Cambridge: Cambridge University Press, 7—29.
• Freedle, R. and Kostin, I. 1999: Does the text matter in a multiple-choice test of comprehension? The case for the construct validity of TOEFL's minitalks. Language Testing 16: 2—32.[Medline] [Order article via Infotrieve]
• Ginther, A. 2002: Context and content visuals and performance on listening comprehension stimuli. Language Testing 19: 133—67.[Abstract/Free Full Text]
• Green, A. 1998: Studies in language testing 5: Verbal protocol analysis in language testing research (ed. M. Milanovic). Cambridge: Cambridge University Press.
• Griffiths, R. 1992: Speech rate and listening comprehension: Further evidence of the relationship. TESOL Quarterly 26: 385—91.[CrossRef]
• Gruba, P. 1989: A comparison study of audio and video presentation modes in tests of ESL listening comprehension. Unpublished MA thesis, University of California, Los Angeles.
• ——— 1999: The role of digital video media in second language listening comprehension. Unpublished doctoral dissertation, University of Melbourne.
• Hadar, U. 1989: Speech production: Role of head movements. Language and Communication 9: 245—57.[CrossRef]
• Hansen, C. and Jensen, C. 1994: Evaluating lecture comprehension. In Flowerdew, J., editor, Academic listening: Research perspectives, Cambridge: Cambridge University Press, 241—68.
• Henricksen, L. 1984: Sandhi variation: A filter of input for learners of ESL. Language Learning 34: 103—26.[CrossRef]
• Kasten, K. 1995: The effect of mode of presentation in the testing of listening comprehension. Unpublished MA thesis, Hong Kong Polytechnic University.
• Kellerman, S. 1992: I see what you mean: The role of kinesic behaviour in listening and implications for foreign and second language learning. Applied Linguistics 13: 239—58.[Abstract]
• Kennedy, G. 1978: The testing of listening comprehension. RELC monograph series. Singapore: Singapore University Press.
• Kintsch, W. 1998: Comprehension. Cambridge: Cambridge University Press.
• Lado, R. 1961: Language testing: The construction and use of foreign language tests. London: Longman.
• Lynch, T. 1998: Theoretical perspectives on listening. Annual Review of Applied Linguistics 18: 3—19.
• McGurk, H. and MacDonald. J. 1976: Hearing lips and seeing voices. Nature 264: 746—48.[CrossRef][Medline] [Order article via Infotrieve]
• McNeill, D. 1985: So you think gestures are non-verbal? Psychological Review 92: 350—71.[CrossRef]
• Riseborough, M. 1981: Physiographic gestures as decoding facilitators: Three experiments exploring a neglected facet of communication. Journal of Non-Verbal Behavior 5: 172—83.[CrossRef]
• Scheflen, A. 1964: The significance of posture in communication systems. Psychiatry 27: 316—31.[Medline] [Order article via Infotrieve]
• Stanley, J. 1978: Teaching listening comprehension: An interim report on a project to use uncontrolled language data as a source material for training foreign students in listening comprehension. TESOL Quarterly 12: 285—95.[CrossRef]
• Sweller, J. 1988: Cognitive load during problem solving: Effects on learning. Cognitive Science 12: 257—85.[CrossRef]
• Vandergrift, L. 2003: Orchestrating strategy use: Toward a model of the skilled second language listener. Language Learning 53: 463—96.[CrossRef]
• Voss, B. 1979: Hesitation phenomena as sources of perceptual errors for non-native speakers. Language and Speech 22: 129—44.[Medline] [Order article via Infotrieve]
• Wu, Y. 1998: What do tests of listening comprehension test? A retrospection study of EFL test-takers performing a multiple-choice task. Language Testing 15: 21—44.[Medline] [Order article via Infotrieve]

Language Testing, Vol. 24, No. 4, 517-537 (2007)
DOI: 10.1177/0265532207080771


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This Article Abstract Free Full Text (Free PDF) Free Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Ockey, G. J. Search for Related Content Social Bookmarking                         What's this?