AI Research8 min reading time

Only 8.9% of sites block AI crawlers, but 94.8% are never cited in AI answers

Hacker News
Read the full article
A study found that only 8.9% of websites block AI crawlers via robots.txt, yet 94.8% of audited sites never appear in AI assistant answers. Among assistants, Gemini cited audited businesses most frequently at 2.9%.

More in AI Research

AI Research5 min read

Scientists overcome a hidden obstacle to more powerful quantum computers

Science Daily
AI Research1 min read

Different eval awareness may track different graders

LessWrong
AI Research1 min read

Tracing Subliminal Learning Through Pretraining

LessWrong