An LLM router built to control API cost
Use model: auto for cost-aware selection based on task requirements, or specify a model whenever consistency and model-specific behavior matter.
How automatic routing works
- Your application sends a text messages request.
- The router assesses the task and supported model choices.
- It selects a cost-effective model intended to handle that task.
- Basktre forwards the request without retaining prompt or response bodies.
- The response identifies the model used and provides usage metadata.
{
"model": "auto",
"messages": [
{
"role": "user",
"content": "Summarize this support ticket in three bullets."
}
]
}When automatic routing is appropriate
- High-volume text workloads where several models can meet the requirement.
- Summarization, extraction and routine generation where cost flexibility matters.
- Applications that record the selected model and evaluate outputs continuously.
When to pin a model
- You require repeatable model-specific behavior or have validated only one model.
- Your prompt relies on a capability or parameter that is not shared by every model.
- You are running benchmarks, regulated review workflows or incident reproduction.
Current limitations
Automatic selection is not a guarantee of a particular quality, latency or saving. Basktre’s public documentation does not currently promise a configurable fallback chain, voice routing, image generation, JSON mode or tool-call normalization. Use a pinned model and test every required parameter when those details matter.
How to evaluate savings responsibly
Basktre has not published a sufficiently detailed benchmark to support a universal percentage-savings claim, so this page does not make one. Build a representative prompt set, define pass/fail quality criteria, record the chosen model and token cost, and compare the same successful requests with your pinned baseline. Include Basktre’s 4% wallet top-up fee in the final calculation.
Compare current rates on the LLM API pricing page or model a workload with the cost calculator.
Frequently asked questions
What is an LLM router?
An LLM router selects a model for each request using task requirements and cost rather than sending every request to one model.
Can I override automatic routing?
Yes. Send a specific supported model tag whenever you need deterministic model selection.
Does routing guarantee savings or quality?
No. Model prices and task suitability vary. Benchmark your own workloads and pin a model when exact behavior matters.
Start with $1 in free API credit
No card required. Use one key across a growing model catalog with no additional Basktre token markup.
Start building