Plan or Retrieve First? A Scale Study of Tool Discovery Architectures

Researchers compared two methods for large language models to discover relevant APIs from large tool registries: Retrieve-then-Plan (RtP) and Plan-then-Retrieve (PtR). RtP works better for single-tool queries, while PtR excels on complex multi-tool queries, with trade-offs in inference cost and retrieval accuracy.