Validity Argument in Language Testing: Case Studies of Validation Research

Description

Language tests play pivotal roles in education, research on learning, and gate-keeping decisions. The central concern for language testing professionals is how to investigate whether or not tests are appropriate for their intended purposes. This book introduces an argument-based validity framework to help with the design of research that investigates the validity of language test interpretation and use. The book presents the principal concepts and technical terms, then shows how they can be implemented successfully in practice through a variety of validation studies. It also demonstrates how argument-based validity intersects with technology in language testing research and highlights the use of validity argument for identifying research questions and interpreting the results of validation research. Use of the framework helps researchers in language testing to communicate clearly and consistently about technical issues with each other and with researchers of other types of tests.

Carol A. Chapelle is Distinguished Professor in the Department of English, Iowa State University. She received the 2012 Cambridge-International Language Testing Association Lifetime Achievement Award and the 2015 Distinguished Scholarship and Service Award from the American Association for Applied Linguistics. She is co-editor of the Cambridge Applied Linguistics series and is founding editor of the Encyclopedia of Applied Linguistics. Erik Voss is Lecturer in Applied Linguistics & TESOL at Teachers College, Columbia University. He is a member of the International Language Testing Association's (ILTA) executive board and has co-authored the book, Flipping Academic English Language Learning: Experiences from an American University (2019).

'Most research building on the framework of validity arguments has been driven by large-scale standardized testing practices. Carol and Erik invite us to listen in the case narratives of validity arguments from classrooms, local institutions, and technology-rich assessment platforms.' Eunice Jang, Professor, Ontario Institute for Studies in Education, University of Toronto 'This book is both tightly focused on the principles of argument-based language test validation and yet wide-ranging in its attention to different contexts in which validation is undertaken, including the use of technology in test development, delivery, and scoring. After a cogent introduction to the theory of validity argument, each chapter focuses on one or two aspects of the procedure so that by the end, readers have a clear understanding of this complex but highly effective approach to language test validation. Danny Douglas, Professor Emeritus, Applied Linguistics, Iowa State University 'Most research building on the framework of validity arguments has been driven by large-scale standardized testing practices. Carol and Erik invite us to listen in the case narratives of validity arguments from classrooms, local institutions, and technology-rich assessment platforms.' Eunice Jang, Professor, Ontario Institute for Studies in Education, University of Toronto 'Validity Argument in Language Testing is a much-needed resource for researchers, graduate students, and practitioners learning the intricacies of the argument-based approach to validation in language testing. The highly experienced editors have drawn together a successful combination of theoretical grounding and example studies focusing on various aspects of the approach. The book will be a valuable resource for many generations of language assessors.' Ute Knoch, Director of the Language Testing Research Centre and Associate Professor in Language Assessment, University of Melbourne 'This volume provides important insights into the utility of an argument-based approach to validity. Case studies representing a range of tests, contexts and validation methods provide fertile ground to explore the benefits, and limits, of an argument-based approach. This collection will appeal to anyone keen to learn about the application of validity theory in concrete language testing situations.' Luke Harding, Professor in English Language and Linguistics, Lancaster University