Plan or Retrieve First? A Scale Study of Tool Discovery Architectures
Apple researchers compare two ways for LLM agents to find the right tools in large registries: retrieving tools similar to the user query, or first having the model sketch the function signatures it needs and searching with those. The question matters because context windows cannot hold every tool definition.