Faster Retrieval for Better, More Efficient RAG

Apple researchers presented a method at ICML 2026 that uses small neural networks trained offline to speed up maximum inner product search (MIPS) for retrieval-augmented generation by routing queries more efficiently. This approach leverages typical query distributions to improve retrieval speed and accuracy compared to traditional query-agnostic methods.