|
|
|
--- |
|
license: apache-2.0 |
|
library_name: transformers |
|
pipeline_tag: text-generation |
|
tags: |
|
- mistral |
|
- text-generation-inference |
|
base_model: cognitivecomputations/dolphin-2.2.1-mistral-7b |
|
inference: false |
|
--- |
|
|
|
# Dolphin-2.2.1-mistral-7b-GGUF |
|
- Quantized version of [Dolphin-2.2.1-mistral-7b](https://huggingface.co/cognitivecomputations/dolphin-2.2.1-mistral-7b) |
|
- Created using llama.cpp |
|
|
|
## Available Quants |
|
- IQ3_S |
|
- Q2_K |
|
- Q3_K_L |
|
- Q3_K_M |
|
- Q3_K_S |
|
- Q4_0 |
|
- Q4_K_M |
|
- Q4_K_S |
|
- Q5_0 |
|
- Q5_K_M |
|
- Q5_K_S |
|
- Q6_K |
|
- Q8_0 |
|
|
