AI Detection and Grammarly
Hi everyone, We have faculty using the AI report and are appreciating that feature. An interesting question came up recently: the report showed 64% AI-generated text, but the student claimed he had only used Grammarly, which also helps to improve phrasing. Has anyone else experienced an AI report picking up on Grammarly, and is there a way of distinguishing between a "grammar help" tool and other generative AI?
Second, will the AI report be visible to students soon? Faculty assumed that students could see it, but the report is only visible to faculty in our LMS.
Thanks,
Jennifer Douglas, American Public University System
134 replies
-
If an essay is flagged with 50% or over for AI, wouldn't that pretty much toss out the "false positive" theory? I get 20% or less can be less reliable, but 50%?
-
Also don't forget there is Grammarly premium for desktop and browser use. Many folks use this application or similar writing tools if they have dyslexia or chronic fatigue that can affect concentration. Grammarly premium significantly changes sentence structure or whole paragraphs.
-
It helps if you think of the percentage as only one data point to have a discussion with students; ideally, that would take place during drafting, rather than submission. Two resources I'd suggest for this are this one on approaching a student when you think AI misuse has occurred or discussion starters for that situation.
-
a foremost authority on AI detection is Atheer Mahir. He has a copious thread on this subject on his Linkedin profile
-
I have just joined this network and have reviewed the posts below. I have had some instance where TII has flagged students as having 50% AI generated content. However, some students are adamant they did not use AI or Grammarly/Quillbot. Are they just lying to me or are there any other possibilities as to why their work might be flagged? I had a student initially get flagged at 58%. They made numerous edits to the essay (as seen via google docs) and the resubmission still got flagged at 60%. I am having trouble understanding what might be the issue and would love some guidance.
-
I have a similar case with a student who claims to have translated their work from their native language into English. Is this likely to have produced a high indicator? ChatGPT does a great job of translation...better than google translate
-
Two of my own papers in progress tested positive for AI even though I used the basic Grammarly functions in editing the drafts. I did not use Grammarly's AI function. I'm not sure how I can trust Turnitin when it shows a false positive for me, much less send the paper out for review if it's going to come back as a false positive at a journal. This needs to be fixed. I certainly cannot use this to give a student a failing grade if it's going to open me to any legal repercussions.
-
I don’t even glance at anything that is UNDER 50% AI detected. If it’s OVER 50%, they have to redo it.
-
I do not rate Tii AI check at all. It is easy to make a 100% AI written document into a 0% AI written, simply by changing half a dozen words (max). Lancaster have turned it off.
-
Hi.
I'm just joining this thread as I have a student whose work has turned up 50% or above on MULTIPLE assignments, and I now also have in-class evidence of his work that clearly shows a discrepancy in voice and usage. English is not his native language and he admits to using Grammarly extensively--spending even more time "editing" his work than writing it. To me, this is not developing his own voice but merely becoming an adept 'sound-mixer'. His work is so incredibly academic-sounding that it's quite inaccessible to his high-school peers. I am compelled to have him complete all work in class without an internet-accessible computer or by hand. After he submits this AI-unassisted version, he can revise.
Note that our school uses TurnItIn and AI-detection does not always work for his work. I have cut and pasted it into ChatGPTZero instead (I have multiple samples in just a few weeks.)
Does TurnItIn use ChatGPTZero-type tools?
-
This just happened to one of the essays I was grading - The student said she used Grammarly
-
Are students required to cite AI if they used Grammarly gen AI and asked it to "improve it"? This is an option on Grammarly now. The result is similar content-wise but often re-written for clarity and such. Will this get flagged on Turnitin or other plagiarism/AI detectors? I'm not sure what qualifies as plagiarism (assuming the student did not cite AI) in terms of using AI as an academic tool. Particularly I want to know if this is acceptable for the International Baccalaureate in writing portions of Arts exams. Is it acceptable if AI is cited for editing/paraphrasing? Is it not acceptable to use AI at all?
Please reply with your thoughts! I realize this is a tricky situation since AI is so new these days and we are all trying to adapt to these recent developments. Thanks!