AI Detection Tools: Can They be Trusted?

68% of teachers in the U.S. regularly use AI detection tools on their student’s work, according to a survey done by the Center for Democracy and Technology. In recent times, AI has been a concern in schools. Due to this, AI detection schools have quickly risen in popularity. They can help alert teachers to students engaging in academic dishonesty via AI, which has become an issue as of late. But, the issue arises when AI detection tools are wrong. Can we really trust AI detectors?

I tested out three AI detectors by inputting the prologue of Romeo and Juliet, which was written around 360 years prior to the initial invention of AI, and about 430 years prior to AI such as ChatGPT being released and becoming easy for widespread personal use. ZeroGPT, one of the most popular AI detectors, flagged the text as AI written all three times that I checked it. I also tested various AI detectors on unedited texts written by ChatGPT, the AI detectors I used did fairly well at detecting the use of AI. However, when I just asked ChatGPT to sound more human, the AI detectors suddenly started detecting far lower percentages of AI usage, despite the fact that it was still entirely written by AI and unedited. While the AI detectors were sometimes right, they still had flaws and false positives just in my minor amount of testing. Many teachers believe AI detectors to be flawless and trust them 100%. This can be due to the teachers not fully understanding how this technology works. So how does it work?

AI detectors are simply AI meant to determine if a piece of text sounds like AI. They’re not some sort of magical tool. We all have surely heard stories about AI just making up fake sources and studies that never happened; so why do we trust AI detectors so much? Even the people behind large AI detection tools admit that it’s flawed. Turnitin, an AI detection software used by many schools, said that “[their] sentence-level false positive rate is around 4%.” When the AI detectors I used properly detected AI, it was all pieces of text that I think anyone could look at and determine that it was AI. Why? Because no one talks like that. Students using AI know this, and so they often edit their AI-written schoolwork to slightly reword things to sound human.

I do think that AI detectors can be a useful tool for teachers, but they shouldn’t be blindly trusted. Especially not when you risk a false accusation of academic fraud being placed on a student’s record.

Some students appreciate the possible useful capability of these tools. “I don’t have any personal experience with AI detection but I think it could be a useful tool for people. I know a lot of people really don’t like the idea of AI, and teachers could easily use it to pick out any cheaters,” said Finn Graziano, a senior at WHS.

Other students were more critical of the AI detection tools. “I like the idea of using AI as a tool, but it shouldn’t be something we depend on all the time because it’s literally a robot,” shared WHS sophomore, Ginny Henry. They then addressed AI detectors, “AI detectors are whatever, it gives teachers more time I guess. But, they are still stupid. I have mixed feelings about AI.” Patton Parkinson, a junior at WHS, said, ”It sucks, not gonna lie. Because you can type out an essay and it’ll say it’s AI. Then you get a zero, like what? And then if someone uses AI it says it’s 100% human-written.”