Updates on Content Moderation

Every AI story we track on Content Moderation: 64 stories so far, each summarized in our own words and linked to the publisher that reported it.

Pulled from 125 sources

This week

Social Media7 min read

We Investigated Character.AI and Found a Horror Show. Now It’s Bankrupt.

Futurism
Social Media5 min read

Hindsight puts up to $1M behind its AI content moderation as Google shuts down Perspective API

The Next Web
Social Media4 min read

Head of Instagram Says He Has No Idea How to Deal With Wave of Horrible AI Slop

Futurism
Politics2 min read

Hundreds of Protestors Descend on Meta Corporate Office Depicting Zuck as the Devil

Futurism

This month

Meta Says Claude AI Tool Triggered No Kings Instagram Suspension

Covered by 2 sources
Consumer Tech2 min read

Apple updates App Store rules to ensure it doesn't offer AI nudify apps

Engadget
Cybersecurity1 min read

No. of deepfake sex videos up for review exceeds last year's figure in 8 months

Yonhap News Agency
Social Media8 min read

From Substack to YouTube, here are the social platforms cracking down on AI slop

Business Insider
Image Generation10 min read

OpenAI, Google pushing new AI models easily tricked into making nudes, researchers say

Ars Technica
Social Media4 min read

Meta Won’t Say If It Violates Its Policies to Upload AI-Generated Videos of Sobbing Little Children Begging for Likes and Follows So They Don’t Get Arrested by Police

Futurism
Social Media4 min read

Meta Took More Than 48 Hours to Remove AI-Generated Facebook Videos of Graphic Child Abuse, Including a Baby Roasting in an Oven

Futurism
Social Media3 min read

Meta rolls out new AI tools to detect ads that secretly lead to child sexual abuse material

TechCrunch
Social Media3 min read

How AI decision models could change content moderation

TechCrunch
Public Sector3 min read

Google Updates Guidelines to Punish Sites That Use Fake Bylines and AI-Generated Headshots

Futurism
Social Media4 min read

Woman loses 20 years of ‘digital memories’ after Meta deletes her accounts

TechRadar
Social Media4 min read

Reddit is killing RSS feeds and ending public API access because of AI bots

Covered by 2 sources
Social Media4 min read

That Company That Buys Struggling News Sites and Turns Them Into AI-Powered Content Mills Has Halted Publishing After a Futurism Investigation

Futurism
Society & Culture3 min read

Human Contractors Are Seeing All Your Horny — and Creepy — AI Prompts

Covered by 2 sources
Social Media3 min read

Meta Now Banning Ads That Promote Feminism

Futurism
Social Media3 min read

Meta ordered to remove UK deepfakes as oversight board criticises ‘inadequate’ safeguards

Covered by 2 sources
Social Media3 min read

Oversight Board says Meta's rules for AI deepfakes are 'consistently and fundamentally inadequate'

Engadget
Social Media8 min read

Facebook Is Hosting Huge Numbers of Horrifying AI-Generated Videos of Violent Child Abuse, and Meta Is Barely Even Pretending to Care About Taking Them Down

Futurism
AI Research5 min read

No monitoring system caught the German wiki. Two outside researchers found it by searching the internet.

The Next Web
Social Media6 min read

Instagram’s AI detection is a mess (again)

The Verge
Social Media2 min read

MauroPello/stop-the-slop: Spot AI-generated YouTube scripts

Hacker News
Social Media3 min read

LinkedIn's 'seems like AI slop' button is a hit

Covered by 2 sources
AI Research4 min read

Amazon will train on Twitch streamers’ content by default, unless they opt out

Covered by 4 sources
Social Media2 min read

Over 1 million people have clicked LinkedIn’s AI slop button

The Verge
Cybersecurity2 min read

Another woman joins lawsuit accusing Grok of generating CSAM

Engadget
Social Media2 min read

Twitch streamers can now opt out from training Amazon’s AI

Covered by 4 sources
Social Media3 min read

Twitch CPO squirms, admits everyone hates its new AI training 'feature'

Hacker News
Music & Audio3 min read

Spotify to distinguish AI artists from real people – and stop recommending them

Covered by 2 sources
AI Research6 min read

Mistral AI Releases Shieldstral 1.0 3B: An Open-Weights Policy-Adaptive Multimodal Safety Classifier Matching Models 7× Its Size

MarkTechPost
Social Media3 min read

AI isn’t enough to protect social media communities from AI

Ars Technica
Social Media3 min read

Meta apps displayed ads that contained AI-generated CSAM

Covered by 2 sources
Social Media4 min read

Old Reddit could be the next casualty of Reddit's war on AI scraping

Covered by 2 sources
Social Media2 min read

Telegram CEO says 'takedown extortionist' was responsible for the app being briefly delisted by Apple

Engadget
Social Media3 min read

Telegram’s Brief App Store Removal Renews Questions About Apple’s CSAM Enforcement

CNET
AI Research5 min read

Mistral's Shieldstral: 3B open-weights model for multimodal moderation

Covered by 2 sources
Social Media4 min read

Snapchat joins other popular platforms in fight against 'AI slop'

Covered by 3 sources
Social Media3 min read

LinkedIn to add AI slop report feature that could train better AI slop

Mashable
Cybersecurity4 min read

China drafts cyberbullying rules that reach AI-generated abuse

The Next Web
Dev20 min read

Best practices for applying Amazon Bedrock Guardrails to code generation workflows

AWS Blog
Agents31 min read

‘I Want Everything Completely Uncensored’: Here’s What Grok Users Are Complaining About to the FTC

Gizmodo
Social Media3 min read

Discord admits AI moderation bug wrongfully banned users over harmless images

TechCrunch

Big AI Had a Point When It Said It Needed to Be Told What Is Not Okay

Gizmodo

Spotify removed 57,000 fake podcast episodes promoting illegal drugs, but only after a senator forced its hand

The Next Web

Chinese activist in UK told by X that abusive deepfakes do not breach rules

The Guardian

Synthesia partners with Cinder to scale moderation before a frame renders

The Next Web

Prompting Amazon Nova 2 for content moderation

AWS Blog

‘Never Talk About Goblins’: OpenAI’s Instructions to Codex Have a Weirdly Emphatic No-Creatures Policy

Gizmodo

Claude Leak Shows That Anthropic Is Tracking Users’ Vulgar Language and Deems Them “Negative”

Futurism

The Facebook insider building content moderation for the AI era

TechCrunch

Teenager died after asking ChatGPT for ‘most successful’ way to take his life, inquest told

The Guardian

Wikipedia Editors Tried and Tried to Work With AI Content, Eventually Realized It Was Total Trash and Banned It Entirely

Futurism

OpenAI abandons yet another side quest: ChatGPT’s erotic mode

Covered by 3 sources

Meta rolls out new AI content enforcement systems while reducing reliance on third-party vendors

TechCrunch

“Educational” YouTube AI Slop Encourages Kids to Play in Traffic

Futurism
Showing the 60 most recent of 64 stories on Content Moderation