Hate Speech-Detecting AIs Can Be Fooled: Study

Advertisement
By Indo-Asian News Service | Updated: 17 September 2018 17:01 IST

Machine learning detectors deployed by major social media and online platforms to track hate speech are "brittle and easy to deceive", a study claims.

The study, led by researchers from the Aalto University in Finland, found that bad grammar and awkward spelling - intentional or not - might make toxic social media comments harder for artificial intelligence (AI) detectors to spot.

Modern natural language processing techniques (NLP) can classify text based on individual characters, words or sentences. When faced with textual data that differs from that used in their training, they begin to fumble, the researchers said.

Advertisement

"We inserted typos, changed word boundaries or added neutral words to the original hate speech. Removing spaces between words was the most powerful attack, and a combination of these methods was effective even against Google's comment-ranking system Perspective," said Tommi Grondahl, a doctoral student at the varsity.

Advertisement

The team put seven state-of-the-art hate speech detectors to the test for the study. All of them failed.

Among them was Google's Perspective. It ranks the "toxicity" of comments using text analysis methods.

Advertisement

Earlier, it was found that "Perspective" can be fooled by introducing simple typos.

But, Grondahl's team discovered that although "Perspective" has since become resilient to simple typos, it can still be fooled by other modifications such as removing spaces or adding innocuous words like "love".

Advertisement

A sentence like "I hate you" slipped through the sieve and became non-hateful when modified into "Ihateyou love".

Hate speech is subjective and context-specific, which renders text analysis techniques insufficient as stand-alone solutions the researchers said.

They recommend that more attention be paid to the quality of data sets used to train machine learning models - rather than refining the model design.

The results will be presented at the forthcoming ACM AISec workshop in Toronto.

 

Catch the latest from the Consumer Electronics Show on Gadgets 360, at our CES 2026 hub.

Further reading: AI
Advertisement

Related Stories

Popular Mobile Brands
  1. Researchers Uncover Potential 9-Month 'Wobble' in Nearby Gas Giant
  2. iQOO 15 Ultra to Feature Shoulder Triggers, More Gaming Features
  3. Could Our Universe Be Just One Bubble in a Vast Multiverse?
  4. Young Sherlock Now Set for OTT Release on OTT: All the Details
  1. Scientists Search the Big Bang’s Afterglow for Signs of Colliding Parallel Universes
  2. Giant Ancient Collision May Have ‘Flipped’ the Moon’s Interior, Study Suggests
  3. VLT’s GRAVITY Instrument Detects ‘Tug’ from Colossal Exomoon; Could Be Largest Natural Satellite Ever Found
  4. Young Sherlock Now Set for OTT Release on OTT: What You Need to Know About Guy Ritchie’s Mystery Thriller
  5. NASA’s Miner++ AI Brings Machine Digs Into TESS Archive to the Hunt for Nearby Earth-Like Worlds
  6. iQOO 15 Ultra Confirmed to Feature Touch-based Shoulder Triggers With Haptic Feedback
  7. Invincible Season 4 OTT Release: When and Where to Watch the Highly Anticipated Viltrumite War Online?
  8. iPhone Shipments in India Rise to 14 Million Units in 2025 as Apple Sees Record Year: Report
  9. Oppo Find N6 Listed on TDRA Website, Hinting at Imminent Launch in the UAE
  10. NASA’s JWST Uncovers a ‘Feeding Frenzy’ That Births Supermassive Black Holes
Gadgets 360 is available in
Download Our Apps
Available in Hindi
© Copyright Red Pixels Ventures Limited 2026. All rights reserved.