Description
This is a unified 20B model crafted via a multi-step SLERP merge of eight 20B models. The aim was to develop a versatile "base model" for TaskArithmetic in this size class.
Merging Process:
Models:
- model: Undi95/Emerhyst-20B
- model: Undi95/MXLewd-L2-20B
- model: Undi95/Lewd-Sydney-20B
- model: athirdpath/Nethena-20b-Glued
- model: tavtav/Rose-20B
- model: Undi95/PsyMedRP-v1-20B
- model: NeverSleep/Noromaid-20b-v0.1.1
- model: Undi95/U-Amethyst-20B
Concept:
The idea behind this process was to blend the unique attributes of each model while minimizing individual quirks. This approach has also shown promising results as a standalone RP model, providing a combination of high-quality writing and situational problem-solving/awareness.
Prompt template: Alpaca
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
{prompt}
### Response:
Thanks to Undi95 for pioneering the 20B recipe, and for most of the models involved.
- Downloads last month
- 1,291
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.