Keenable AI Open-Sources NEEDLE: A Live Search Benchmark That Rebuilds Its Query Set Every Hour

MarkTechPostPublished Aug 31, 2026

Keenable AI has open-sourced NEEDLE, a live benchmark for web search APIs that regenerates query sets hourly or daily from fresh public data sources. It evaluates 15 search APIs across multiple domains using a pooled oracle to assess retrieval performance.

#evaluation-frameworks #information-retrieval #keenable-ai #needle #search-benchmarking

Keenable AI Open-Sources NEEDLE: A Live Search Benchmark That Rebuilds Its Query Set Every Hour

More in Dev

Moonshot releases Kimi K3.1 Pro and says it cut its hacking skills

Microsoft Open-Sources Agensh: A Multi-Agent Harness for 1,024 Agents

Cognition Open-Sources an Agent Plugin that Helps Secure Systems against Recent Cybersecurity Threats