Communications of the ACM
Flawed Algorithms Are Grading Millions of Students' Essays
Credit: Motherboard
Every year, millions of students sit down for standardized tests that carry weighty consequences. National tests serve as gatekeepers to higher education, while state assessments can determine everything from whether a student will graduate to federal funding for schools and teacher pay.
Traditional paper-and-pencil tests have given way to computerized versions. And increasingly, the grading process — even for written essays — has also been turned over to algorithms.
Natural language processing artificial intelligence systems — often called automated essay scoring engines — are now either the primary or secondary grader on standardized tests in at least 21 states, according to a survey conducted by Motherboard.
But research from psychometricians and AI experts, as well as documents obtained by Motherboard, show that these tools are susceptible to a flaw that has repeatedly sprung up in the AI world: bias against certain demographic groups. And as an experiment demonstrated, some of the systems can be fooled by nonsense essays with sophisticated vocabulary.
From Motherboard
View Full Article
No entries found