Validating the performance standards in the 2005 and 2006 national primary school achievement tests in Mathematics and Language Arts

Show full item record

Title: Validating the performance standards in the 2005 and 2006 national primary school achievement tests in Mathematics and Language Arts
Author: De Lisle, Jerome
Abstract: Performance standards are informed expectations of student achievement levels in a population. These expectations are based on knowledge or skills in the curriculum (content standards) or on the content and demands of test items. Arguably, performance standards for national assessments of educational achievement are required to evaluate quality and equity within an education system. In 2005, performance standards were introduced into the reporting system for the Trinidad and Tobago primary school national assessments. The critical question was the meaningfulness and usefulness of these performance standards; an issue that relates to validity. Validation considers the legitimacy and defensibility of procedures. Evidence for the validity of standards may come from three different sources: procedural, internal, and external. This paper analysed these three sources of validity evidence for the performance standards established in the 2005 and 2006 national assessments. Following recent trends, the study makes significant use of qualitative data obtained from the judges in evaluating the cognitive processes and perceptions associated with judging and setting standards in situ. This type of data was obtained from journals and responses to open-ended questions in a questionnaire administered to participants during the standard-setting process. The 2005 data suggest that while some evidence was strongly supportive of procedural validity, problems in logistics and management of the process proved noteworthy limitations. Targets of improvement for future standard-setting exercises should focus on addressing these deficiencies. Additionally, future evaluations of the process should include additional quantitative information necessary to judge the internal and external validity
URI: http://hdl.handle.net/2139/6732
Date: 2008


Files in this item

Files Size Format View
Icon Cross-Campus Conference Proceedings 2007.pdf 6.891Mb PDF Thumbnail

This item appears in the following Collection(s)

Show full item record

Search UWISpace


Advanced Search

Browse

My Account