mpasila's picture
Clarified quantization type
ac15111 verified
|
raw
history blame
1.27 kB
metadata
license: apache-2.0
language:
  - en

This is an ExLlamaV2 quantized model in 4bpw of l3utterfly/mistral-7b-v0.1-layla-v4 using the default calibration dataset.

Original Model card:

Model Card

Model Description

Mistral 7B fine-tuned by the OpenHermes 2.5 dataset optimised for multi-turn conversation and character impersonation.

The dataset has been pre-processed by doing the following:

  1. remove all refusals
  2. remove any mention of AI assistant
  3. split any multi-turn dialog generated in the dataset into multi-turn conversations records
  4. added nfsw generated conversations from the Teatime dataset
  • Developed by: l3utterfly
  • Funded by: Layla Network
  • Model type: Mistral
  • Language(s) (NLP): English
  • License: Apache-2.0
  • Finetuned from model: Mistral 7B

Uses

Base model used by Layla - the offline personal assistant: https://www.layla-network.ai

Help & support: https://discord.gg/x546YJ6nYC

Prompt:

USER:
ASSISTANT:

Built with Axolotl