End-to-End code sample / setup with 'Routing LLM' and 'Specialist LLMs'

#4
by christianweyer - opened

We should have a sample / setup that illustrates how the actual weaving and routing is done when the 'routing LLM' answers, then we need to delegate to the 'specialist LLM' and come back.

We should have a sample / setup that illustrates how the actual weaving and routing is done when the 'routing LLM' answers, then we need to delegate to the 'specialist LLM' and come back.

This model cannot directly give a specific model. It generates parameters for calling this function and needs to be used with Octopus v2.

Nexa AI org

Hi @huggingfacess @christianweyer Thanks for point this out, we have github code here:
https://github.com/NexaAI/octopus-v4

To be specific, all domain-specific LLMs are implemented here
https://github.com/NexaAI/octopus-v4/tree/main/specialized_models

Sign up or log in to comment