Skip to content
  • Home
  • Emerging Technology & News
  • Computer Help
  • Privacy and Security
  • Reimage Windows Repair
The Reimage Blog
Menu
  • Home
  • Emerging Technology & News
  • Computer Help
  • Privacy and Security
  • Reimage Windows Repair
Facebook Twitter
Home  /  Emerging Technology & News  /  Are You Smarter Than ChatGPT? OpenAI Tool Aims to Detect AI-Generated Text
PostedinEmerging Technology & News Posted on February 1, 2023

Are You Smarter Than ChatGPT? OpenAI Tool Aims to Detect AI-Generated Text

Posted By Kerry.Hershey

The tool could help teachers catch students who are exploiting ChatGPT to cheat on homework assignments, though it’s far from perfect.

To stop ChatGPT abuse, OpenAI has a new tool that can tell you whether a piece of text is more likely to have come from an AI program or a human. 

OpenAI introduced the “classifier” tool on Tuesday to help crack down on AI-generated text that’s being passed off as coming from a human. The problem has become especially pronounced in education with students exploiting ChatGPT to complete homework assignments.

In a blog post, OpenAI also noted that AI-generated text could pose a threat when used to generate automated text for misinformation campaigns. 

The classifier tool is pretty straightforward: Submit some text at least 1,000 characters in length, and OpenAI will tell you the likelihood that it came from an AI program or a human. The tool was created by training a computer model to discern between “pairs of human-written text and AI-written text on the same topic.” 

What the classifier tool likes like
Credit: OpenAI

However, the San Francisco lab admits the classifier is far from perfect. “In our evaluations on a ‘challenge set’ of English texts, our classifier correctly identifies 26% of AI-written text (true positives) as ‘likely AI-written,’ while incorrectly labeling human-written text as AI-written 9% of the time (false positives),” OpenAI wrote. 

The classifier’s reliability also drops when examining short snippets or a few paragraphs of text. So the tool will only work on submissions at over 1,000 characters in length. In addition, “sometimes human-written text will be incorrectly but confidently labeled as AI-written by our classifier,” OpenAI noted. 

“Additionally, students may quickly learn how to evade detection by modifying some words or clauses in generated content,” the lab said. 

Hence, OpenAI says the tool “should not be used as a primary decision-making tool” when it comes to determining whether a piece of text is AI-generated or not. But despite all the limitations, OpenAI decided to release the tool as it works on “mitigations” to prevent students from exploiting ChatGPT for cheating purposes. 

“We’re making this classifier publicly available to get feedback on whether imperfect tools like this one are useful,” OpenAI added. “Our work on the detection of AI-generated text will continue, and we hope to share improved methods in the future.”

image of ChatGPT
An example of an essay ChatGPT can write. Credit: Open AI

Launched in November, ChatGPT is so advanced that the AI program can write essays, poems, and answer test questions on a wide variety of topics within seconds. While the quality of the responses can be shaky, researchers have found that ChatGPT is smart enough to (barely) pass an MBA exam and even fix numerous bugs in computer code. 

Inevitably, the emergence of ChatGPT has sparked questions over whether the same program threatens to undermine education and disrupt white-collar jobs. Already, some schools and teachers have decided to block the AI program on their networks over concerns that ChatGPT makes cheating on homework and tests all too easy. Meanwhile, some third parties have released their own free tools to help educators ferret out AI-generated text.  

OpenAI said it’s trying to address the cheating problems by reaching out to teachers in the US to learn about their experiences. The lab has also published a document with advice on how educators could introduce and oversee ChatGPT use in their classrooms safely. 

But OpenAI also noted it’s still too early to say how programs like ChatGPT will affect education and society. “To date we have seen instances of productivity improvements that transform jobs, job displacement, and job creation, but both the near and long term net effects are unclear,” it said.

Written by: Michael Kan
Source: PCMag.com
Featured Image Credit: Photo by Lionel Bonaventure/AFP via Getty Images

Share on Facebook Share on Twitter
Previous Article
SanDisk Professional G-DRIVE SSD review
Next Article
Tiny11 is out, promising to be Windows 11 without steep hardware requirements

About Author

Kerry.Hershey

Related Posts

  • Generative AI will soon be shaking up YouTube, too

    March 2, 2023
  • Qualcomm Builds iSIM Directly Into Snapdragon 8 Gen 2 Processor

    March 1, 2023
  • Tiny11 is out, promising to be Windows 11 without steep hardware requirements

    February 3, 2023
Scan Now

Categories

  • Business
  • Computer Help
  • Emerging Technology & News
  • Privacy and Security
  • Reviews

Reviews

Reimage Social

Security

Popular Posts

  • PCWorld calls Reimage “A Fantastic Repair Utility “ July 26, 2011 Reviews
  • 4 Ways to Keep the Ghouls & Goblins Away From Your PC October 26, 2010 Archive
  • The PC Key to Happiness – A Properly Maintained OS September 2, 2010 Archive
  • Google says hacked websites were attacking iPhones for years September 12, 2019 Privacy and Security

Random Posts

  • Researchers reveal “KNOB” flaw that affects almost every Bluetooth device August 22, 2019 Privacy and Security
  • Qualcomm updates robotics platform to add 5G connectivity and edge compute power June 3, 2022 Emerging Technology & News
  • Samsung’s oddball The Freestyle projector is a go-anywhere home cinema experience January 5, 2022 Reviews
  • Is there a new version of Windows 10 called "Ultra"? May 29, 2019 Emerging Technology & News
© Copyright 2019
We use cookies to ensure that we give you the best experience on our website.Ok