Demo of TurnItIn - New AI Detection Tool

Sarah Moore, Ph.D.
4 Apr 202303:12

TLDRDr. Moore from the University of Texas at Dallas demonstrates Turnitin's new AI detection tool. He simulates a student using Chat GPT to write a memo on AI writers, which is then uploaded to Turnitin. The tool flags a 45% similarity score, but more notably, it detects 100% AI writing, warning of potential academic misconduct. Faculty are advised to update their strategies, while students are cautioned against using AI writers to avoid plagiarism and cheating accusations.

Takeaways

  • 🔍 Dr. Moore demonstrates Turnitin's new AI detection tool.
  • 📝 He simulates a student using ChatGPT to write a memo comparing AI writers.
  • 💻 The memo generated by ChatGPT is uploaded to Turnitin for analysis.
  • 📊 Turnitin gives a similarity score of 45%, indicating a match with previously uploaded documents.
  • 🚩 Turnitin flags the document with 'AI 100', cautioning that the percentage may not indicate academic misconduct and review is required.
  • 👀 The tool correctly identifies the essay as 100% AI-written, despite not flagging the sources.
  • 👨‍🏫 For faculty, Turnitin's new feature seems effective in detecting AI-generated content.
  • 📚 Faculty are encouraged to consider changing rubrics and assignments to adapt to the new detection capabilities.
  • ⚠️ For students, using AI tools like ChatGPT to complete assignments is considered unauthorized and could be seen as cheating.
  • 📈 The video serves as a warning that Turnitin is evolving to catch AI-generated content that previously went undetected.
  • 📝 Dr. Moore suggests that students' original writing is often superior to AI-generated content, lacking in quality and depth.

Q & A

  • What is the purpose of the video by Dr. Moore?

    -The purpose of the video is to demonstrate and discuss the capabilities of Turnitin's new AI detection tool, specifically its ability to identify content generated by AI writers.

  • Which university is Dr. Moore affiliated with?

    -Dr. Moore is on faculty at the University of Texas at Dallas.

  • What type of assignment prompt did Dr. Moore use for testing the AI detection tool?

    -Dr. Moore used a standard essay assignment prompt that required students to write a memo comparing AI writers.

  • How did Dr. Moore simulate a student's use of an AI writer?

    -Dr. Moore simulated a student's use of an AI writer by logging into Chat GPT and asking it to write a memo comparing three AI writers, including some sources.

  • What was the similarity score given by Turnitin for the AI-generated memo?

    -The similarity score given by Turnitin for the AI-generated memo was 45%.

  • What does the 45% similarity score indicate according to Turnitin?

    -The 45% similarity score indicates a traditional match to previously uploaded documents and does not flag anything as problematic in terms of AI writing.

  • How does Turnitin's AI detection tool flag AI-generated content?

    -Turnitin's AI detection tool flags AI-generated content by showing an 'AI 100' warning, indicating that the percentage may not reflect academic misconduct and that a review is required.

  • What is the implication for faculty regarding the use of Turnitin's AI detection tool?

    -For faculty, Turnitin's AI detection tool seems to be effective, suggesting that they might need to consider changing their rubrics and assignments to account for the detection of AI-generated content.

  • What warning does Dr. Moore give to students about using AI writers for assignments?

    -Dr. Moore warns students that using AI writers to complete assignments is considered unauthorized and can be found as an instance of cheating, which could lead to academic penalties.

  • What is Dr. Moore's opinion on the quality of the AI-generated memo?

    -Dr. Moore believes that the AI-generated memo is not of high quality and that his students could write something better, more interesting, and with a better conclusion for business writing.

  • What advice does Dr. Moore give to students regarding their own writing?

    -Dr. Moore advises students to do their best and rely on their own writing abilities, as it is generally better than what AI writers can produce.

Outlines

00:00

📚 Testing Turnitin's AI Detection Tool

Dr. Moore from the University of Texas at Dallas conducts an experiment to evaluate Turnitin's new AI detection tool. He simulates a student's scenario by using an essay assignment prompt to write a memo comparing AI writers. He then utilizes Chat GPT to generate the memo, including sources, and uploads it to Turnitin. The tool flags a 45% similarity score, indicating a match with previously uploaded documents but does not initially flag the AI-generated content. However, upon further inspection, Turnitin's AI detection feature identifies the memo as 100% AI-written, prompting a 'caution' message for review. Dr. Moore emphasizes the importance of this tool for faculty to adapt their strategies and assignments, and warns students that using AI to complete assignments can be considered cheating.

Mindmap

Keywords

💡Turnitin

Turnitin is a plagiarism detection service that helps educators verify the originality of student submissions. In the context of the video, it has introduced an AI detection tool to identify content generated by artificial intelligence, such as essays written by AI writers. The video demonstrates how Turnitin flags a document as having a 'similarity score' and an 'AI 100' caution, indicating potential AI-generated content.

💡AI detection tool

The AI detection tool refers to a feature within Turnitin designed to identify content that may have been generated by artificial intelligence. The video script describes how this tool works by uploading a document to Turnitin and receiving a 'caution' notification if the content is suspected to be AI-generated, as shown when the tool flagged the essay as '100 AI written'.

💡Plagiarism

Plagiarism is the act of using another person's work or ideas without proper attribution and presenting them as one's own. The video discusses how Turnitin's AI detection tool can help prevent plagiarism by catching AI-generated content, which is considered unauthorized and can be seen as cheating in academic settings.

💡AI writers

AI writers are software programs capable of generating text based on given prompts or topics. In the video, the instructor uses an AI writer to create a memo comparing different AI writers, which is then used to demonstrate how Turnitin's AI detection tool identifies AI-generated content.

💡Memo

A memo is a brief written record or report, often used in a business context for internal communication. In the script, the assignment given to students is to write a memo comparing AI writers, which the instructor then has an AI writer generate to test Turnitin's AI detection capabilities.

💡Similarity score

The similarity score in Turnitin is a percentage that indicates how much of a document matches content from other sources in the Turnitin database. The video shows that the AI-generated memo received a 'similarity score of 45,' suggesting a moderate level of overlap with existing content.

💡Academic misconduct

Academic misconduct encompasses various actions that violate academic integrity, such as cheating, plagiarism, and using unauthorized assistance. The video warns that using AI writers to complete assignments can be considered academic misconduct and may lead to penalties if detected.

💡Rubrics

A rubric is a set of criteria used to evaluate the quality of students' work. The video suggests that educators might need to revise their rubrics to account for the detection of AI-generated content, ensuring that assignments can be effectively assessed for originality.

💡Assignments

Assignments are tasks given to students by educators as part of the learning process. The video script includes an example of an assignment prompt where students are asked to write a memo. The discussion also revolves around how the use of AI writers to complete such assignments can be detected by Turnitin's AI detection tool.

💡Cheating

Cheating refers to the act of using dishonest methods to gain an advantage, such as using AI writers to complete assignments without proper effort. The video emphasizes that using AI to cheat on assignments is a serious offense in academic settings and can be identified by Turnitin's AI detection tool.

💡Business writing

Business writing is a form of professional communication used in the workplace, including memos, reports, and emails. The video critiques the AI-generated memo for lacking qualities of good business writing, such as a conclusion and a coherent structure, suggesting that human writing is typically superior for such purposes.

Highlights

Introduction to Turnitin's new AI detection tool by Dr. Moore from the University of Texas at Dallas.

Demonstration of using Chat GPT to generate a memo comparing AI writers.

The memo generated by Chat GPT was uploaded to Turnitin for similarity check.

Turnitin's similarity score for the AI-generated memo was 45%.

Turnitin did not flag the AI-generated content as problematic, only as a traditional match.

The AI-generated memo was flagged with 'AI 100' indicating it was detected as AI-written.

A caution message appeared suggesting a review is required for the AI-written content.

The sources included in the memo were not flagged by Turnitin.

The tool's effectiveness in detecting AI-written content is discussed.

Implications for faculty on how to adapt assignments and rubrics to counter AI writing tools.

A warning for students that using AI writing tools can be considered cheating.

The university's stance on using unauthorized means to complete assignments.

Comparison of student writing capabilities to the AI-generated memo.

Critique of the AI-generated memo lacking a conclusion and overall quality.

Advice for students to focus on their own writing skills.

The video aims to educate and inform about the capabilities of Turnitin's AI detection.

Final thoughts on the importance of original student writing in academic settings.