Get the app
CybersecurityPublic Sector19 min reading time

A year of fighting scrapers on my 1.5 million-page website

Hacker News
Read the full article
The PatronView website, hosting 1.5 million profile pages, experienced overwhelming bot traffic, with 214 bot page loads for every human visit. The site owner shares detailed firewall rules and observations, including blocking Amazon's AI crawler and noting extremely low CAPTCHA solve rates by bots.
#amazon#bot-mitigation#web-security

More in Cybersecurity

Cybersecurity3 min read

Anthropic’s Claude AI model accessed Georgia voter data in US

Covered by 3 sources
Cybersecurity3 min read

Australians should prepare for online services to go down unexpectedly as threats rise, cyber agency warns

The Guardian
Cybersecurity3 min read

Texas sues OpenAI and Sam Altman over ChatGPT’s safety for children

The Next Web