RouteX v0.1 is the first model in LLM Routers family by BRAHMAI. The model is based on BertForSequenceClassification.
RouteX v0.1 automatically determines whether to send queries to a local LLM (Mistral 7B, Llama-3.1 8B, etc...) or powerful cloud LLM (GPT-4, Sonnet 3.5, etc...), depending on which model is best-suited for your task. We've trained RouteX v0.1 on millions of data points from reliable, cross-domain evaluation benchmarks.
NOTE:
We are still working on improving the efficiency and reliability of these models.
We will release more information with you as we progress.
Regards, Team BRAHMAI
- Downloads last month
- 2
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.