This is a case where the machines are very, very stupid.”Ĭritics of “robo-graders” are also worried that students might learn how to game the system, that is, give the algorithms exactly what they are looking for, and thereby receive undeservedly high scores. It’s so scary that it works….Machines are very brilliant for certain things and very stupid on other things. Perelman observes, “”It makes absolutely no sense,” shaking his head. When Perelman submits a nonsense essay to the GRE computer, the algorithm gives the essay a near perfect score. Smith details how one critic, Les Perelman at MIT, has created an essay-generating program, the BABEL generator, that creates nonsense essays designed to trick the algorithmic “robo-graders” for the Graduate Record Exam (GRE). Needless to say, despite support for “robo-graders”, there are critics of automated essay assessments. But…the computer scoring has proven “spot-on” and Utah now lets machines be the sole judge of the vast majority of essays.” Cyndee Carter, assessment development coordinator for the Utah State Board of Education reports “…the state began very cautiously, at first making sure every machine-graded essay was also read by a real person. Peter Foltz, a research professor at the University of Colorado, Boulder observes, “We have artificial intelligence techniques which can judge anywhere from 50 to 100 features…We’ve done a number of studies to show that the (essay) scoring can be highly accurate.” Smith also notes that Utah, which once had humans review students’ essays after they had been graded by a machine, now relies on the machines almost exclusively. Smith reports that Utah and Ohio currently use computers to read and grade students’ essays and that soon, Massachusetts will follow suit. In her recent article for NPR, “ More States Opting To ‘Robo-Grade’ Student Essays By Computer” Tovia Smith discusses how so-called “robo-graders” (i.e., computer algorithms) are increasingly being used to grade students’ essays on state standardized tests. (See links to previous blog posts, below) Two recent articles treat the effects of AI on the assessment of students and the hiring of employees. We’ve previously written about the rise of artificial intelligence and the current and anticipated effects of AI upon employment.
0 kommentar(er)
