Qwen2.5-Coder-7B-Instruct-GGUF
Original Model
Qwen/Qwen2.5-Coder-7B-Instruct
Run with Gaianet
Prompt template
prompt template: chatml
Context size
chat_ctx_size: 128000
Run with GaiaNet
Quick start: https://docs.gaianet.ai/node-guide/quick-start
Customize your node: https://docs.gaianet.ai/node-guide/customize
Quantized with llama.cpp b3751
- Downloads last month
- 147
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.