Update. More examples of this fear coming true.
AI Detection Tools Falsely Accuse International Students of Cheating
https://themarkup.org/machine-learning/2023/08/14/ai-detection-tools-falsely-accuse-international-students-of-cheating
Discussion
Loading...
Update. More examples of this fear coming true.
AI-Written Homework Is Rising. So Are False Accusations.
https://www.thedailybeast.com/ai-written-homework-is-rising-so-are-false-accusations
Update. How often might this fear come true? A new study "found that [an] #AI text detector erroneously identified up to 8% of the known real [human-written] abstracts as AI-generated text."
https://www.sciencedirect.com/science/article/pii/S2153353923001566
Update. Here's another study showing that tools to detect #AI-written text are easy to fool with "simple techniques to manipulate the AI generated content." But this one goes a step further and makes the right recommendation for teachers and schools. "GenAI tools and detectors…cannot currently be recommended for determining academic integrity violations due to accuracy limitations and the potential for false accusation."
https://educationaltechnologyjournal.springeropen.com/articles/10.1186/s41239-024-00487-w
Update. More evidence that this fear has come true.
https://www.bloomberg.com/news/features/2024-10-18/do-ai-detectors-work-students-face-false-cheating-accusations
"Even…a small error rate can quickly add up, given the vast number of student assignments each year, with potentially devastating consequences for students who are falsely flagged."
Update. This fear has come true to such an extent that students who write well without #AI assistance now feel pressure to use AI to "humanize" their writing and avoid the charge of AI-assisted #plagiarism. #Grrr.
https://www.nbcnews.com/tech/internet/college-students-ai-cheating-detectors-humanizers-rcna253878
@petersuber
This is all very unfortunate. It feels like the only reliable way to assess student’s ability to write a good essay is to put them all in a room with no tech other than pen and paper (i.e. an exam). This however misses testing other skills such as their ability to research a topic, and puts them under more extreme time pressure. Thoughts?
1 more replies (not shown)
@petersuber
This is all very unfortunate. It feels like the only reliable way to assess student’s ability to write a good essay is to put them all in a room with no tech other than pen and paper (i.e. an exam). This however misses testing other skills such as their ability to research a topic, and puts them under more extreme time pressure. Thoughts?