3

ChatGTP and other AI

While AI text generation is nothing new, the recently released ChatGTP is pretty sophisticated in providing responses to a variety of prompts. In my department, we generated responses to prompts we use and put some results through the turnitin similarity detector. The AI response had almost no match (5%), and the content that did match was pretty generic phrasing related to the topic.

Since these AI platforms generate content in response to specific prompts, they content is dynamic -- sort of. Is there a way to account for this in the turnitin.com platform? What suggestions -- short of in class, paper-pencil responding -- do y'all have for combatting these new tools?

7 replies

null
    • Customer Engagement Specialist, Turnitin
    • Gill_Rowell
    • 1 yr ago
    • Reported - view

    Chris Begeman I would be interested in what you and others are seeing at your institutions in terms of AI-generated text. This is certainly a fast-moving area that we at Turnitin are exploring the impact of globally. This blog post from Eric Wang our Head of AI might be a good starting point.

      • Nicole_Guertin
      • 1 yr ago
      • Reported - view

      Gill Rowell We are hearing lots of students talking about the AI writing platform (our AP Language teacher even used it as a seminar topic) and parents sharing their observations of students "playing" with the features as entertainment, but as Chris Begeman says, cheating of this kind is not detectable so far, so aside from my gut instinct that a particular student is using it because the writing submitted is suddenly quite different from what I've received all year, I have no proof. Definitely interested in Turn It In's efforts to address what feels like a new Wild West for writing instruction! Thanks :)

      • Customer Engagement Specialist, Turnitin
      • Gill_Rowell
      • 1 yr ago
      • Reported - view

      Nicole Guertin It's certainly a hot topic at the moment! I'm sharing a recent blog post from Chris Caren our CEO which outlines our roadmap as we move into 2023. 

    • Jonas_Larsson
    • 1 yr ago
    • Reported - view

    Our experience (from a highly ranked UK university) is that the use of AI is increasing rapidly and Turnitin is entirely unable to detect it - ironically Turnitin often yields very low or even zero similarity scores to text that has been AI generated or modified, which is how we have seen this rising. Some online tools like GPTZero can spot this but they can't be deployed at scale at the moment and even if they could, I would fully expect AI bots to adapt over time to make detection difficult or impossible. Our approach - and I suspect many universities will follow suit - is to move away from online assessments altogether and go back to face to face, in-person handwritten exams. This of course means Turnitin's business model will collapse (the risk of plagiarism essentially goes away with in person exams) so if they want to survive they need to act very quickly on this. In my institution (where I'm chair of exams) I expect us to move away from online exams and coursework within the next academic year, as the availability of AI basically undermines all sense of academic integrity. I certainly hope Turnitin will come up with something more impressive than the above blog post, which seems to suggest they have no idea and no plan of how to deal with this.

      • Customer Engagement Specialist, Turnitin
      • Gill_Rowell
      • 1 yr ago
      • Reported - view

      Jonas Larsson Apologies for the delay in responding to you, and at the risk of sharing another blog post, I hope that this message from our Chief Product Officer will help to assure you that we are in the midst of developing a user experience that can guide educators to identify
      and evaluate work with traces of AI-assisted writing.  

      I would also strongly encourage you (and other educators viewing this message) to sign up to help shape how our technology evolves in this area.

      One final note, in lieu of technologies to detect AI-assisted writing, the following resources developed by our Teaching and Learning Innovations team may be of use from a pedagogical point of view. 

      • Senior Lecturer Nursing, CPD Lead Mental Health
      • Daniela_Collins
      • 1 yr ago
      • Reported - view

      Jonas Larsson, I completely agree. Face-to-face assessments and exams will be the only way to ensure student's knowledge and skills are tested authentically. This is especially important in professional courses such as nursing science where essential medical and nursing knowledge is core to the future role of a registered nurse. The impact of plagiarism in electronic essays (and most courses now have 80% + of the course provision with the summative/final course assessment in a written electronic format) - while studying and submitting potentially plagiarised course work that is not easily detectable can lead to students completing the theory part of a professional course without being thoroughly examined. If this continues it will lead to future healthcare professionals qualifying (for the theory part of the course) with no solid knowledge and skills, and at the end of this, it will be patients and the public who are using healthcare services that will be impacted negatively. It is unsafe to allow a course to be heavily reliant on one mode of assessment, mainly the written essay format when we can see increas of AI-enabled writing platforms and/or apps. One of my colleagues commented that when she was marking the recent essay submissions, they were well written and not the usual standard for the same students who have submitted written coursework on previous occasions, however as Turnitin did not detect any plagiarism there was no action for the marking team to take and the students passed the module. 

      • Senior Lecturer Nursing, CPD Lead Mental Health
      • Daniela_Collins
      • 1 yr ago
      • Reported - view

      Gill Rowell Thank you

Content aside

  • 3 Likes
  • 1 yr agoLast active
  • 7Replies
  • 197Views
  • 6 Following