This Article Abstract Free Full Text (Free PDF) Free Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Dávid, G. Search for Related Content Social Bookmarking                         What's this?

Investigating the performance of alternative types of grammar items

Eötvös Loránd University, david.soproni{at}t-online.hu

Some educational contexts almost mandate the application of multiple-choice (MC) testing techniques, even if they are deplored by many practitioners in the field. In such contexts especially, research into how well these types of item perform and how their performance may be characterised is both appropriate and desirable. The focus of this paper is on a modified type of MC item dubbed "multitrak", which was used to test grammar in the Hungarian national admissions test for English between 1993 and 2004. Multitrak items were evaluated in relation to three better-known MC item types and were shown to provide more information about candidates in the ability range represented by Levels B2 and C1 on the Common European Framework of Reference (CEFR), as well as allowing a focus on more difficult content than the other item types in the study.

References

• Alderson, J. C. 1990: Language testing in the 1990s: How far have we come? How much further have we to go? In Anivan, S., editor, Current developments in language testing. Singapore: SEAMEO Regional Language Centre , 1-26.
• Alderson, J. C., Clapham, C. and Wall, D. 1995: Language test construction and evaluation. Cambridge: Cambridge University Press .
• Alderson, J. C., Nagy, E. and Öveges, E. 2000: English language education in Hungary. Part II. Examining Hungarian learners’ achievements in English. Budapest: The British Council .
• Babin, E. H., Cordes, C. V. and Nichols, H. H. 1987: TOEFL Test of English as a Foreign Language. New York-Budapest: Arco-Akadémiai Kiadó .
• Bachman, L. F. 1990: Fundamental considerations in language testing. Oxford: Oxford University Press .
• Bygate, M., Tonkyn, A. and Williams, E., editors, 1994: Grammar and the language teacher. Hemel Hempstead: Prentice-Hall .
• Batstone, R. 1994: Grammar. Oxford: Oxford University Press .
• Carroll, J. B. 1980: Testing communicative performance: an interim study. Oxford: Pergamon Press .
• Cohen, A. D. 1984: On taking language tests: What the students report . Language testing 1/1, 70-81 .
• Council of Europe 2001: Common European framework of reference for languages: learning, teaching, assessment. Cambridge: Cambridge University Press .
• Dávid, G. 2000: The use of multitrak items and a small-group oral in the context of the Hungarian higher education. Unpublished PhD thesis, University of Glamorgan, Wales.
• Fowler, W. S. and Coe, N. 1987: Nelson quickcheck placement tests. New edition. Walton-on-Thames: Thomas Nelson .
• Halliday, M. A. K. 1985: An introduction to functional grammar. London: Edward Arnold .
• Heaton, J. B. 1988: Writing English language tests. London: Longman .
• Henning, G. 1987: A guide to language testing: development, evaluation and research. New York: Newbury House .
• Hughes, A. 1989: Testing for language teachers. Cambridge: Cambridge University Press .
• Hymes, D. H. 1972: On communicative competence. In Pride, J. B. and Holmes, J., editors, Sociolinguistics: selected readings. Harmondsworth, Middlesex: Penguin , 269-293.
• Leech, G. N. 1983: The principles of pragmatics. London: Longman .
• Linacre, J. M. 1998: A user’s guide to Facets and Facform. [Software manual] Chicago: Mesa Press .
• Linacre, J. M. 1999: Facets: Rasch measurement computer program. Version 3.22 [Computer software] Chicago: Mesa Press .
• Linacre, J. M. and Wright, B. 1994: A user’s guide to Bigsteps. [Software manual] Chicago: Mesa Press .
• Linacre, J. M. and Wright, B. 1995: Bigsteps. Version 2.57. Rasch-Model Computer Program. [Computer software] Chicago: Mesa Press .
• McNamara, T. 1996: Measuring second language performance. Harlow: Longman .
• Messick, S. 1995: Validity of psychological assessment . American Psychologist 50, 741-749 .[CrossRef]
• Messick, S. 1996: Validity and washback in language testing . Language Testing 13, 241-256 .[Abstract/Free Full Text]
• Morrow, K. 1979: Communicative Language Testing: Revolution or Evolution? In Brumfit, C. J. and K. Johnson, editors, The communicative approach to language teaching. Oxford: Oxford University Press , 143-157.
• North, B. 2000: The development of a common framework scale of language proficiency. New York: Peter Lang .
• North, B. and Schneider, G. 1998: Scaling descriptors for language proficiency scales . Language Testing 15, 217-263 .[Abstract/Free Full Text]
• OFFI 1993: A felsöktatási intézmények jelentései a felvételikröl -1993. Mimeo . A compilation of feedback from universities and colleges about the 1993 entrance exams, prepared by the ministry.
• Osterlind, S. J. 1998: Constructing test items: multiple-choice, constructed-response, performance, and other formats. Norwell, MA: Kluwer .
• Pike, L. W. 1979: An evaluation of alternative item formats for testing English as a foreign language. TOEFL Research Report 2. Princeton, NJ: Educational Testing Service .
• Popham, W. J. 1981: Modern educational measurement. Englewood Cliffs, NJ: Prentice-Hall .
• Purpura, J. E. 2004: Assessing grammar. Cambridge: Cambridge University Press .
• Rea-Dickins, P. 1987: The relationship between grammatical abilities and aspects of communicative competence: with special reference to the testing of grammar. Unpublished PhD thesis, University of Lancaster, UK.
• Rea-Dickins, P. 1991: What makes a grammar test communicative? In Alderson J. C. and North, B., editors, Language testing in the 1990s: the communicative legacy. London: Macmillan , 112-131.
• Rea-Dickins, P. 1997: The testing of grammar in a foreign language. In Clapham, C. M. and Corson, D., editors, Language testing and assessment. Vol. 7 of Encyclopedia of language and education. Dordrecht, The Netherlands: Kluwer , 87-97.
• Tonkyn, A. 1994: Introduction: Grammar and the Language Teacher. In Bygate, M., Tonkyn, A. and Williams, E., editors, Grammar and the language teacher. Hemel Hempstead: Prentice-Hall , 1-14.
• Tsui, A. B. M. 1994: English conversation. Oxford: Oxford University Press .
• Weir, C. J. 1990: Communicative Language Testing. Hemel Hempstead: Prentice-Hall .

Language Testing, Vol. 24, No. 1, 65-97 (2007)
DOI: 10.1177/0265532207071512


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This Article Abstract Free Full Text (Free PDF) Free Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Dávid, G. Search for Related Content Social Bookmarking                         What's this?