Text Generation
GGUF
English
Edit model card

NeuralDaredevil-7B GGUF

Original model: NeuralDaredevil-7B Model creator: Maxime Labonne

This repo contains GGUF format model files for Maxime Labonne’s NeuralDaredevil-7B.

Maxime discussing NeuralDaredevil on Twitter:

🤝 NeuralDaredevil is actually trained using [argilla’s] excellent distilled version of the orca-dpo-pairs made with distilabel.

What is GGUF?

GGUF is a file format for representing AI models. It is the third version of the format, introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp. Converted using llama.cpp build 1879 (revision 3e5ca79)

Prompt template: Zephyr

Zephyr-style appears to work well!

<|system|>
{{system_message}}</s>
<|user|>
{{prompt}}</s>
<|assistant|>

Download & run with cnvrs on iPhone, iPad, and Mac!

cnvrs.ai

cnvrs is the best app for private, local AI on your device:

  • create & save Characters with custom system prompts & temperature settings
  • download and experiment with any GGUF model you can find on HuggingFace!
  • make it your own with custom Theme colors
  • powered by Metal ⚡️ & Llama.cpp, with haptics during response streaming!
  • try it out yourself today, on Testflight!
  • follow cnvrs on twitter to stay up to date

Original Model Evaluations:

Evaluations reported from mlabonne’s alternative leaderboard, YALL: Yet_Another_LLM_Leaderboard.

Model AGIEval GPT4All TruthfulQA Bigbench Average
NeuralDaredevil-7B 45.23 76.2 67.61 48.52 59.39
Mistral-7B-Instruct-v0.2 38.5 71.64 66.82 42.29 54.81
openchat-3.5-0106 44.17 73.72 52.53 44.4 53.71
OpenHermes-2.5-Mistral-7B 42.75 72.99 52.99 40.94 52.42
Downloads last month
75
GGUF
Model size
7.24B params
Architecture
llama

2-bit

3-bit

4-bit

5-bit

6-bit

Inference Examples
Inference API (serverless) has been turned off for this model.

Model tree for brittlewis12/NeuralDaredevil-7B-GGUF

Quantized
(4)
this model

Dataset used to train brittlewis12/NeuralDaredevil-7B-GGUF