Original community demo · Video hosted on X
Model & tool routing
A model-router demo classifies incoming requests and dispatches them to a model suited to the task.
Opens the author's original post in a new tab.
The implementation ideas below are our interpretation of the community demo. Check the original post for the author’s actual setup.
Applications with several models or tools can use a small routing decision before starting a more expensive workflow.
Describe the available routes and their constraints, classify the request, then dispatch through an allowlisted mapping. Use a fallback for uncertain or unsupported tasks.
These examples explain a possible workflow; they are not recorded demo results or API request and response formats.
Routing quality depends on how clearly the destinations are defined. A wrong route can increase cost or reduce answer quality; measure results on your own traffic.
Define the context and a small set of choices in the playground, then use the API guide to connect your application.
View demoScore earlier tool calls for relevance, then remove less useful outputs from an agent’s working context.
View demoJev Ultrafast turns indexed page elements into candidate actions, demonstrated through a flight-search workflow.
View demoA Rust desktop application classifies live network traffic to highlight potential anomalies as they arrive.
