TL;DR
Turn the school run and nap time into listening time
- Thousands of audiobooks, podcasts and originals
- Listen on your phone, tablet or Echo — also offline
- Cancel anytime
Requests to rescore Texas students’ STAAR tests have nearly tripled this year, rising from 21,620 to 64,489. Schools are increasingly questioning computer-graded open-ended responses, prompting more manual reviews and score adjustments.
Texas schools have submitted more than 64,000 rescoring requests for STAAR exams this spring, nearly tripling the previous year’s total, as educators grow increasingly skeptical of automated grading for open-ended responses.
The Texas Education Agency (TEA) began using an automated scoring engine in December 2023 to evaluate open-ended questions on the STAAR, including reading and English tests. This change has led to a sharp increase in rescoring requests, with 2,758 requests in spring 2024 compared to 21,620 last year, representing a more than threefold rise.
Of the scores adjusted during rescoring, the majority were initially graded by computers—58%—with humans reviewing and regrading these responses. TEA officials report that more than 13,300 scores improved after review, highlighting ongoing concerns about the accuracy of machine grading. The automated system was developed using thousands of responses previously scored by humans, aiming to replicate human judgment without learning from responses, as clarified by TEA officials.
School districts such as Cypress-Fairbanks, Dallas, Katy, and Northside have actively submitted rescoring requests, especially for students near performance cutoffs. The process is designed to be cost-effective and faster than full manual grading, with TEA automatically rescoring responses within one point of the next performance level at no charge.
Critics and educators express frustration over the reliance on automated scoring, citing trust issues and the potential impact on student outcomes, especially for those on the cusp of promotion or graduation. The controversy has prompted increased awareness and discussion among district leaders about the reliability of computer grading systems.
Implications of Increased Rescoring for Texas Education
The surge in rescoring requests underscores growing concerns about the accuracy of automated grading systems for open-ended assessments. This has implications for student outcomes, school accountability, and public trust in standardized testing processes. As scores influence district ratings and individual student progress, questions about the fairness and reliability of machine grading could lead to policy reevaluations and increased scrutiny of automated assessment methods.
Additionally, the increase in manual rescoring reflects a potential trust deficit between educators and automated systems, which may influence future testing and grading policies. The controversy also raises broader questions about the role of artificial intelligence and automation in high-stakes assessments, especially when human judgment is considered the gold standard.
As an affiliate, we earn on qualifying purchases.
Background on Texas STAAR Automated Scoring System
The TEA introduced automated scoring for open-ended STAAR responses in December 2023, aiming to reduce costs and accelerate result delivery. The system was trained on thousands of previously human-graded responses to mimic human scoring, but its accuracy has been questioned, especially after a spike in students receiving zeros on writing prompts in initial computer-graded exams.
Prior to this, the state relied solely on human graders, but the increased number of constructed responses and the need for faster results prompted the shift to automation. The initial criticism centered on perceived inaccuracies, leading to a policy allowing districts to request rescoring of responses that are within one point of the next performance level, at no cost.
According to TEA officials, the hybrid approach—combining machine scoring with human review—strives to balance efficiency with accuracy. Still, the recent rise in rescoring requests indicates ongoing doubts among educators about the system’s reliability.
The controversy has prompted broader debate about the future of automated scoring in high-stakes testing, with some districts advocating for more human oversight and others emphasizing cost and efficiency benefits.
“The traction of superintendents talking to each other — and media continuing to talk about it — made more districts aware that not only can they do this process, but actually they should, and they need to.”
— Allison Matney, director of the Texas Center for School Accountability
Uncertainties About Automated Scoring Accuracy and Future Policies
It is not yet clear how widespread the issues with automated scoring are beyond the current rescoring requests, or whether TEA will implement further safeguards. The long-term reliability of the system remains under review, and officials have not announced any major policy changes in response to the surge in rescoring.
Questions also remain about the potential for bias or inconsistency in machine grading, especially across diverse student responses. The impact of rescoring on final grades and district accountability ratings is still being assessed, and the full scope of the problem is yet to be determined.
Next Steps in Addressing Automated Scoring Concerns
TEA is expected to review the current automated scoring system’s performance and may consider increasing human oversight or refining the algorithm to improve accuracy. Districts are likely to continue submitting rescoring requests, especially for students near performance thresholds.
Further investigations into the causes of scoring discrepancies and potential policy adjustments are anticipated in the coming months. The agency may also increase transparency around scoring methodologies and error rates to rebuild trust among educators and the public.
Key Questions
Why are schools requesting rescoring of STAAR exams?
Schools are requesting rescoring because they question the accuracy of the automated system, especially for open-ended responses, and want human review to ensure fair and correct scores.
How many responses have been rescored this year compared to last?
Rescoring requests have increased from 21,620 last year to 64,489 this spring, nearly tripling the volume of reviews conducted by Texas schools.
Does automated scoring affect student grades or graduation eligibility?
Yes, rescoring can impact whether students meet performance levels required for promotion or graduation, especially for those near cutoff scores.
What are the main concerns about automated scoring?
The primary concerns include accuracy, potential bias, lack of transparency, and the trustworthiness of machine grading for high-stakes assessments.
Source: rss
Columbus Day / Indigenous Peoples' Day Picks
long weekend sales
As an affiliate, we earn on qualifying purchases.
