---
base_model:
- core-3/kuno-royale-v2-7b
- SanjiWatsuki/Kunoichi-DPO-v2-7B
- SanjiWatsuki/Kunoichi-7B
- KatyTheCutie/LemonadeRP-4.5.3
library_name: transformers
tags:
- mergekit
- merge
license: cc-by-nc-4.0
---
# kunoichi-lemon-royale-7b-7.1bpw-exl2

7.1bpw exl2 quant of (https://huggingface.co/grimjim/kunoichi-lemon-royale-7B)

Perfectly fits 16k context on 4bit with 8GB of vram. TabbyAPI recommended, ooba doesnt like this model for some reason.

Lightly tested with both Alpaca and ChatML prompts. Works with temperature 1.0 and minP 0.01, but feel free to vary it up. Tested to 8K context.

This model has a tendency to lean into revealing character interiority when generating narrative, which some people might find interesting. I found the model good with not only following the character card but also taking strong hints from the first message. This experimental model may occasionally reveal context, unfortunately.

This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).

Available quants: [GGUF](https://huggingface.co/grimjim/kunoichi-lemon-royale-7B-GGUF) (exl2 quant of BF16 model was broken, and withdrawn)

## Merge Details
### Merge Method

This model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](https://arxiv.org/abs/2306.01708) merge method using [SanjiWatsuki/Kunoichi-7B](https://huggingface.co/SanjiWatsuki/Kunoichi-7B) as a base. Each of the models had strengths I liked to varying degrees, leading to weights and densities being adjusted in aesthetic proportion.

### Models Merged

The following models were included in the merge:
* [core-3/kuno-royale-v2-7b](https://huggingface.co/core-3/kuno-royale-v2-7b)
* [SanjiWatsuki/Kunoichi-DPO-v2-7B](https://huggingface.co/SanjiWatsuki/Kunoichi-DPO-v2-7B)
* [KatyTheCutie/LemonadeRP-4.5.3](https://huggingface.co/KatyTheCutie/LemonadeRP-4.5.3)

### Configuration

The following YAML configuration was used to produce this model:

```yaml
models:
  - model: SanjiWatsuki/Kunoichi-7B
    # no parameters necessary for base model
  - model: KatyTheCutie/LemonadeRP-4.5.3
    parameters:
      weight: 0.3
      density: 0.4
  - model: core-3/kuno-royale-v2-7b
    parameters:
      weight: 0.3
      density: 0.4
  - model: SanjiWatsuki/Kunoichi-DPO-v2-7B
    parameters:
      weight: 0.4
      density: 0.8
merge_method: dare_ties
base_model: SanjiWatsuki/Kunoichi-7B
parameters:
  int8_mask: true
  normalize: true
dtype: bfloat16

```