Hugging Face's logo

RichardErkhov
/
chargoddard_-_Chronorctypus-Limarobormes-13b-gguf

GGUF
Inference Endpoints
Model card Files Community
chargoddard_-_Chronorctypus-Limarobormes-13b-gguf
File size: 7,091 Bytes 
5b6b7f5
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
 
Quantization made by Richard Erkhov.

[Github](https://github.com/RichardErkhov)

[Discord](https://discord.gg/pvy7H8DZMG)

[Request more models](https://github.com/RichardErkhov/quant_request)


Chronorctypus-Limarobormes-13b - GGUF
- Model creator: https://huggingface.co/chargoddard/
- Original model: https://huggingface.co/chargoddard/Chronorctypus-Limarobormes-13b/


| Name | Quant method | Size |
| ---- | ---- | ---- |
| [Chronorctypus-Limarobormes-13b.Q2_K.gguf](https://huggingface.co/RichardErkhov/chargoddard_-_Chronorctypus-Limarobormes-13b-gguf/blob/main/Chronorctypus-Limarobormes-13b.Q2_K.gguf) | Q2_K | 4.52GB |
| [Chronorctypus-Limarobormes-13b.IQ3_XS.gguf](https://huggingface.co/RichardErkhov/chargoddard_-_Chronorctypus-Limarobormes-13b-gguf/blob/main/Chronorctypus-Limarobormes-13b.IQ3_XS.gguf) | IQ3_XS | 4.99GB |
| [Chronorctypus-Limarobormes-13b.IQ3_S.gguf](https://huggingface.co/RichardErkhov/chargoddard_-_Chronorctypus-Limarobormes-13b-gguf/blob/main/Chronorctypus-Limarobormes-13b.IQ3_S.gguf) | IQ3_S | 5.27GB |
| [Chronorctypus-Limarobormes-13b.Q3_K_S.gguf](https://huggingface.co/RichardErkhov/chargoddard_-_Chronorctypus-Limarobormes-13b-gguf/blob/main/Chronorctypus-Limarobormes-13b.Q3_K_S.gguf) | Q3_K_S | 5.27GB |
| [Chronorctypus-Limarobormes-13b.IQ3_M.gguf](https://huggingface.co/RichardErkhov/chargoddard_-_Chronorctypus-Limarobormes-13b-gguf/blob/main/Chronorctypus-Limarobormes-13b.IQ3_M.gguf) | IQ3_M | 5.57GB |
| [Chronorctypus-Limarobormes-13b.Q3_K.gguf](https://huggingface.co/RichardErkhov/chargoddard_-_Chronorctypus-Limarobormes-13b-gguf/blob/main/Chronorctypus-Limarobormes-13b.Q3_K.gguf) | Q3_K | 5.9GB |
| [Chronorctypus-Limarobormes-13b.Q3_K_M.gguf](https://huggingface.co/RichardErkhov/chargoddard_-_Chronorctypus-Limarobormes-13b-gguf/blob/main/Chronorctypus-Limarobormes-13b.Q3_K_M.gguf) | Q3_K_M | 5.9GB |
| [Chronorctypus-Limarobormes-13b.Q3_K_L.gguf](https://huggingface.co/RichardErkhov/chargoddard_-_Chronorctypus-Limarobormes-13b-gguf/blob/main/Chronorctypus-Limarobormes-13b.Q3_K_L.gguf) | Q3_K_L | 6.45GB |
| [Chronorctypus-Limarobormes-13b.IQ4_XS.gguf](https://huggingface.co/RichardErkhov/chargoddard_-_Chronorctypus-Limarobormes-13b-gguf/blob/main/Chronorctypus-Limarobormes-13b.IQ4_XS.gguf) | IQ4_XS | 6.54GB |
| [Chronorctypus-Limarobormes-13b.Q4_0.gguf](https://huggingface.co/RichardErkhov/chargoddard_-_Chronorctypus-Limarobormes-13b-gguf/blob/main/Chronorctypus-Limarobormes-13b.Q4_0.gguf) | Q4_0 | 6.86GB |
| [Chronorctypus-Limarobormes-13b.IQ4_NL.gguf](https://huggingface.co/RichardErkhov/chargoddard_-_Chronorctypus-Limarobormes-13b-gguf/blob/main/Chronorctypus-Limarobormes-13b.IQ4_NL.gguf) | IQ4_NL | 6.9GB |
| [Chronorctypus-Limarobormes-13b.Q4_K_S.gguf](https://huggingface.co/RichardErkhov/chargoddard_-_Chronorctypus-Limarobormes-13b-gguf/blob/main/Chronorctypus-Limarobormes-13b.Q4_K_S.gguf) | Q4_K_S | 6.91GB |
| [Chronorctypus-Limarobormes-13b.Q4_K.gguf](https://huggingface.co/RichardErkhov/chargoddard_-_Chronorctypus-Limarobormes-13b-gguf/blob/main/Chronorctypus-Limarobormes-13b.Q4_K.gguf) | Q4_K | 7.33GB |
| [Chronorctypus-Limarobormes-13b.Q4_K_M.gguf](https://huggingface.co/RichardErkhov/chargoddard_-_Chronorctypus-Limarobormes-13b-gguf/blob/main/Chronorctypus-Limarobormes-13b.Q4_K_M.gguf) | Q4_K_M | 7.33GB |
| [Chronorctypus-Limarobormes-13b.Q4_1.gguf](https://huggingface.co/RichardErkhov/chargoddard_-_Chronorctypus-Limarobormes-13b-gguf/blob/main/Chronorctypus-Limarobormes-13b.Q4_1.gguf) | Q4_1 | 7.61GB |
| [Chronorctypus-Limarobormes-13b.Q5_0.gguf](https://huggingface.co/RichardErkhov/chargoddard_-_Chronorctypus-Limarobormes-13b-gguf/blob/main/Chronorctypus-Limarobormes-13b.Q5_0.gguf) | Q5_0 | 8.36GB |
| [Chronorctypus-Limarobormes-13b.Q5_K_S.gguf](https://huggingface.co/RichardErkhov/chargoddard_-_Chronorctypus-Limarobormes-13b-gguf/blob/main/Chronorctypus-Limarobormes-13b.Q5_K_S.gguf) | Q5_K_S | 8.36GB |
| [Chronorctypus-Limarobormes-13b.Q5_K.gguf](https://huggingface.co/RichardErkhov/chargoddard_-_Chronorctypus-Limarobormes-13b-gguf/blob/main/Chronorctypus-Limarobormes-13b.Q5_K.gguf) | Q5_K | 8.6GB |
| [Chronorctypus-Limarobormes-13b.Q5_K_M.gguf](https://huggingface.co/RichardErkhov/chargoddard_-_Chronorctypus-Limarobormes-13b-gguf/blob/main/Chronorctypus-Limarobormes-13b.Q5_K_M.gguf) | Q5_K_M | 8.6GB |
| [Chronorctypus-Limarobormes-13b.Q5_1.gguf](https://huggingface.co/RichardErkhov/chargoddard_-_Chronorctypus-Limarobormes-13b-gguf/blob/main/Chronorctypus-Limarobormes-13b.Q5_1.gguf) | Q5_1 | 9.1GB |
| [Chronorctypus-Limarobormes-13b.Q6_K.gguf](https://huggingface.co/RichardErkhov/chargoddard_-_Chronorctypus-Limarobormes-13b-gguf/blob/main/Chronorctypus-Limarobormes-13b.Q6_K.gguf) | Q6_K | 9.95GB |
| [Chronorctypus-Limarobormes-13b.Q8_0.gguf](https://huggingface.co/RichardErkhov/chargoddard_-_Chronorctypus-Limarobormes-13b-gguf/blob/main/Chronorctypus-Limarobormes-13b.Q8_0.gguf) | Q8_0 | 12.88GB |




Original model description:
---
tags:
- llama
- merge
---
Five different instruction-tuned models (which I'm sure are intuitively obvious from the name) merged using the methodology described in [Resolving Interference When Merging Models](https://arxiv.org/abs/2306.01708).

In theory this should retain more of the capabilites of the constituent models than a straight linear merge would. In my testing, it feels quite capable.

Base model used for the merge: [TheBloke/Llama-2-13B-fp16](https://huggingface.co/TheBloke/Llama-2-13B-fp16)

Models merged in:
* [OpenOrca-Platypus2-13B](https://huggingface.co/Open-Orca/OpenOrca-Platypus2-13B)
* [limarp-13b-merged](https://huggingface.co/Oniichat/limarp-13b-merged)
* [Nous-Hermes-Llama2-13b](https://huggingface.co/NousResearch/Nous-Hermes-Llama2-13b)
* [chronos-13b-v2](https://huggingface.co/elinas/chronos-13b-v2)
* [airoboros-l2-13b-gpt4-1.4.1](https://huggingface.co/jondurbin/airoboros-l2-13b-gpt4-1.4.1)

Works quite well with Alpaca-style prompts:
```
### Instruction:

...

### Response:
```

The script I used to perform the merge is available [here](https://github.com/cg123/ties-merge).

The command that produced this model:
```
python ties_merge.py TheBloke/Llama-2-13B-fp16 ./Chronorctypus-Limarobormes-13b --merge elinas/chronos-13b-v2 --merge Open-Orca/OpenOrca-Platypus2-13B --merge Oniichat/limarp-13b-merged --merge jondurbin/airoboros-l2-13b-gpt4-1.4.1 --merge NousResearch/Nous-Hermes-Llama2-13b --cuda
```
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_chargoddard__Chronorctypus-Limarobormes-13b)

| Metric                | Value                     |
|-----------------------|---------------------------|
| Avg.                  | 49.88   |
| ARC (25-shot)         | 59.9          |
| HellaSwag (10-shot)   | 82.75    |
| MMLU (5-shot)         | 58.45         |
| TruthfulQA (0-shot)   | 51.9   |
| Winogrande (5-shot)   | 74.43   |
| GSM8K (5-shot)        | 3.87        |
| DROP (3-shot)         | 17.89         |