OpenAI Reportedly Withholding ChatGPT Text Detection Tool Due to Fear of Backlash

OpenAI reportedly believes launching a tool that can detect AI-generated text can push people away from using ChatGPT.

Advertisement
Written by Akash Dutta, Edited by Siddharth Suvarna | Updated: 5 August 2024 12:49 IST
Highlights
  • The text detection tool can help educators catch AI-based cheating
  • OpenAI is said to have a ChatGPT text detection tool ready for a year
  • OpenAI has reportedly found such a tool won’t reduce text output quality
OpenAI Reportedly Withholding ChatGPT Text Detection Tool Due to Fear of Backlash

OpenAI’s AI text detection tool can reportedly embed an invisible watermark on the ChatGPT-generated text

Photo Credit: Pexels/Shantanu Kumar

OpenAI reportedly has built a tool that can detect when text has been generated using its artificial intelligence (AI) chatbot, but is unwilling to release it to the public. As per the report, the tool has been ready to be released for quite some time, but the AI firm is concerned that such a detection tool might make the chatbot unpopular among users. However, not releasing such a tool has led to educators struggling to find out when an assignment or an essay was written using the help of AI.

OpenAI Reportedly Has an AI Text Detector

According to a report by The Wall Street Journal, OpenAI has been debating the release of such a tool for the last two years. The text detection tool has also been ready to release for about a year, the report claimed citing unnamed people familiar with the matter. One of the sources told the publication that releasing the tool was as easy as pressing a button.

Such a tool could help educators and other similar institutions where people have resorted to generating content such as essays and research papers using AI. Earlier this year, a peer-reviewed scientific paper published in Elsevier's Surfaces and Interfaces journal was found to be written by AI and was subsequently retracted after it gained attention online. This AI-based plagiarism has become a big concern for academia due to the lack of a reliable method to detect AI usage.

As per the report, OpenAI's refusal to release its AI detection tool comes from fears of losing existing users. The company reportedly conducted a survey and found that nearly a third of users would be less inclined to use ChatGPT if an anti-cheating mechanism was released.

Another fear was that making it available to a select number of users such as educators might reduce the usefulness of the tool, whereas making it available to a large group could result in the watermarking technology being deciphered by bad actors who can then make advanced masking tools.

Advertisement

Based on internal documents viewed by the publication, the report claims that the AI text detection tool is 99 percent effective in finding text that was written with the help of ChatGPT. This reportedly works as the tool is essentially a watermarking technology that embeds the text with an invisible watermark that cannot be seen but gets flagged when run through the AI checker.

The workings of the tool was also explained in internal documents. As per the report, ChatGPT generates text by predicting which word or phrase, also known as a token, should follow in a sequence. The selection is based on a small pool so the sentence is coherent.

Advertisement

The AI detection tool, in turn, has a slightly different algorithm for the selection of the tokens. The changes between ChatGPT-generated text and the tool's text leave a pattern, which helps in assessing whether AI was used to generate the text or not.

 

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.

Advertisement

Related Stories

Popular Mobile Brands
  1. Oppo Reno 14 5G Series Teased to Launch in India Soon
  2. Nothing Phone 3 to Get New Glyph Matrix Interface on the Rear Panel
  3. BSNL Announces Name of Its 5G Service in India
  4. World's Oldest Tailored Dress Found in Egyptian Tomb Dates Back Over 5,000 Years
  5. ESA's Proba-3 Unveils First-Ever Artificial Solar Eclipse Images from Precision Satellite Formation
  6. Samsung Galaxy M36 5G India Launch Date and Key Features Revealed
  7. Vivo X Fold 5 Dimensions, Charging Capacity Revealed Ahead of Launch
  8. Poco F7 5G to Be Equipped With a Snapdragon 8s Gen 4 SoC
  1. Fast Radio Bursts Reveal Universe’s Missing Matter Hidden in Cosmic Intergalactic Fog
  2. Apollo Astronauts Found Orange Glass Beads on the Moon, Scientists Now Know Why
  3. World’s Oldest Tailored Dress Found in Egyptian Tomb Dates Back Over 5,000 Years
  4. Ancient Footprints in White Sands Confirm Humans Reached America 23,000 Years Ago
  5. Humanoid Robot Achieves Controlled Flight Using Jet Propulsion and AI Systems
  6. Curiosity Rover Reaches Uyuni Quad, Begins New Mars Mapping and Surface Analysis Campaign
  7. NASA to Gather Reentry Imagery of European Commercial Capsule Using High-Altitude Aircraft
  8. ESA's Proba-3 Unveils First-Ever Artificial Solar Eclipse Images from Precision Satellite Formation
  9. My Hero Academia Final Season OTT Release Date Revealed: Everything You Need to Know
  10. NASA Study Reveals Correlation Between Earth’s Magnetic Field and Atmospheric Oxygen
Gadgets 360 is available in
Download Our Apps
Available in Hindi
© Copyright Red Pixels Ventures Limited 2025. All rights reserved.