Model routing
Sending each request to the cheapest model that clears its quality bar — small models for easy intents, frontier for hard ones. The workhorse of LLM cost optimization.
Sending each request to the cheapest model that clears its quality bar — small models for easy intents, frontier for hard ones. The workhorse of LLM cost optimization.