Gathering evidence for construct validity : a case for large scale educational assessment
Date
2003
Authors
Walt, Nancy Jane
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
The purpose of this study was to identify and evaluate the validity evidence related to British Columbia's Reading Comprehension Assessment . To gather validity evidence, the framework outlined in the Standards for Education and Psychological Testing ( 1999) was utilized. The methods included both qualitative procedures (document analysis, personal interviews) and quantitative procedures (reliability analyses, classical and item response theory analyses, factor analyses, and correlational analyses). It was determined that the methods employed in this study were generally adequate for providing a sampling of validity related evidence. Overall, it was found that the evidence supporting assessment score interpretation was mixed; however, the evidence was deemed to be more positive than negative. Of substantial interest was the lack of support for the reporting of sub-domain reading scores.