Update README.md
Browse filesAdded model details and disclaimer.
README.md
CHANGED
@@ -29,6 +29,11 @@ Sponsored by [CopilotKit: The Open-Source Copilot Platform](https://github.com/C
|
|
29 |
|
30 |
See also: [🐺🐦⬛ LLM Prompt Format Comparison/Test: Mixtral 8x7B Instruct with **17** different instruct templates : LocalLLaMA](https://www.reddit.com/r/LocalLLaMA/comments/18ljvxb/llm_prompt_format_comparisontest_mixtral_8x7b/)
|
31 |
|
|
|
|
|
|
|
|
|
|
|
32 |
## Merge Details
|
33 |
|
34 |
### Merge Method
|
@@ -73,8 +78,10 @@ slices:
|
|
73 |
|
74 |
## Credits & Special Thanks
|
75 |
|
76 |
-
* original model: [mistralai (Mistral AI_)](https://huggingface.co/mistralai)
|
77 |
* leaked model: [miqudev/miqu-1-70b](https://huggingface.co/miqudev/miqu-1-70b)
|
78 |
* f16 model: [152334H/miqu-1-70b-sf](https://huggingface.co/152334H/miqu-1-70b-sf)
|
79 |
* mergekit: [arcee-ai/mergekit: Tools for merging pretrained large language models.](https://github.com/arcee-ai/mergekit)
|
80 |
* mergekit_config.yml: [nsfwthrowitaway69/Venus-120b-v1.2](https://huggingface.co/nsfwthrowitaway69/Venus-120b-v1.2)
|
|
|
|
|
|
29 |
|
30 |
See also: [🐺🐦⬛ LLM Prompt Format Comparison/Test: Mixtral 8x7B Instruct with **17** different instruct templates : LocalLLaMA](https://www.reddit.com/r/LocalLLaMA/comments/18ljvxb/llm_prompt_format_comparisontest_mixtral_8x7b/)
|
31 |
|
32 |
+
## Model Details
|
33 |
+
|
34 |
+
* Max Context: 32764 tokens (kept the weird number from the original/base model)
|
35 |
+
* Layers: 140
|
36 |
+
|
37 |
## Merge Details
|
38 |
|
39 |
### Merge Method
|
|
|
78 |
|
79 |
## Credits & Special Thanks
|
80 |
|
81 |
+
* original (unreleased) model: [mistralai (Mistral AI_)](https://huggingface.co/mistralai)
|
82 |
* leaked model: [miqudev/miqu-1-70b](https://huggingface.co/miqudev/miqu-1-70b)
|
83 |
* f16 model: [152334H/miqu-1-70b-sf](https://huggingface.co/152334H/miqu-1-70b-sf)
|
84 |
* mergekit: [arcee-ai/mergekit: Tools for merging pretrained large language models.](https://github.com/arcee-ai/mergekit)
|
85 |
* mergekit_config.yml: [nsfwthrowitaway69/Venus-120b-v1.2](https://huggingface.co/nsfwthrowitaway69/Venus-120b-v1.2)
|
86 |
+
|
87 |
+
#### DISCLAIMER: THIS IS [BASED ON A LEAKED ASSET](https://huggingface.co/miqudev/miqu-1-70b/discussions/10) AND HAS NO LICENSE ASSOCIATED WITH IT. USE AT YOUR OWN RISK.
|