Theoretical and empirical considerations in investigating washback : a study of ESL/EFL learners
Date
2018-01-19
Authors
Saif, Shahrzad
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
Researchers' and educators' recognition of the positive/negative effects of tests on teaching and learning activities goes back at least four decades. However, this phenomenon, referred to as “washback” in the applied linguistic literature, has been examined empirically by only a few studies in the field of language testing. Even fewer have based their investigation into washback on an a priori theory outlining the scope and design of the study.
This study examines washback as a phenomenon relating those factors that directly affect the test to those areas most likely to be affected by the test. The goals of the study are: (i) to investigate the existence and nature of the washback phenomenon, (ii) to identify the areas directly/indirectly affected by washback, and (iii) to examine the role of test context, construct, task, and status in promoting beneficial washback.
Theoretically, this study conceptualizes washback based on the current theory of validity proposed by Messick (1989, 1996). It is defined as a phenomenon related to the consequential aspect of the test's construct validity and thus achievable, to a large extent, through the test's design and administration. Given this assumption, a conceptual and methodological framework is proposed that identifies “needs”, “means”, and “consequences” as the major focus areas in the study of washback. While the model recognizes tests of language abilities as instrumental in bringing about washback effects, it highlights an analysis of the needs and objectives of the learners (and of the educational system) and their relationship with the areas influenced by washback as the starting point for any study of washback. Areas most likely to be affected by the test as well as major variables that can potentially promote or hinder the occurrence of washback, are also delineated by the model.
This theoretical framework is examined empirically in this study through a long-term multi-phase investigation conducted in different educational contexts (EFL/ESL), at different levels of proficiency (advanced/intermediate), with different tasks (oral/written) and different groups of subjects. The stages in the experimental part of the study correspond to the different phases of the theoretical framework underlying the investigation. The approach to data collection is both quantitative and qualitative.
The results of the study indicate that positive washback can in fact occur if test constructs and tasks are informed by the needs of both the learners and the educational context for which they are intended. The extent, directness, and depth of washback, however, are found to vary in different areas likely to be influenced by washback. The areas most influenced by washback are found to be those related to immediate classroom contexts: (i) teachers' choice of materials, (ii) teaching activities, (iii) learners' strategies, and (iv) learning outcomes. The study also reveals that non-test-related forces and factors operative in a given educational system might prevent or delay beneficial washback from happening. Based on the theoretical assumption underlying the definition of washback adopted in this study, such consequences which cannot be traced back to the construct of the test are outside the limits of a washback study.
Description
Keywords
English language, Study and teaching, Foreign speakers, Textbooks for foreign speakers