Emerhyst-20B / README.md
leaderboard-pr-bot's picture
Adding Evaluation Results
1d857b8
|
raw
history blame
No virus
2.2 kB
metadata
license: cc-by-nc-4.0
tags:
  - not-for-all-audiences
  - nsfw

image/png

Merge of Amethyst 13B and Emerald 13B.

In addition, LimaRP v3 was used, is it recommanded to read the documentation.

Description

This repo contains fp16 files of Emerhyst-20B.

Models and loras used

  • PygmalionAI/pygmalion-2-13b
  • Xwin-LM/Xwin-LM-13B-V0.1
  • The-Face-Of-Goonery/Huginn-13b-FP16
  • zattio770/120-Days-of-LORA-v2-13B
  • lemonilia/LimaRP-Llama2-13B-v3-EXPERIMENT

Prompt template: Alpaca

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{prompt}

### Response:

LimaRP v3 usage and suggested settings

image/png

You can follow these instruction format settings in SillyTavern. Replace tiny with your desired response length:

image/png

Special thanks to Sushi.

If you want to support me, you can here.

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 51.85
ARC (25-shot) 61.69
HellaSwag (10-shot) 84.98
MMLU (5-shot) 56.98
TruthfulQA (0-shot) 54.16
Winogrande (5-shot) 76.09
GSM8K (5-shot) 8.49
DROP (3-shot) 20.56