File size: 1,490 Bytes
32e5ab3 e00d456 435852a e00d456 32e5ab3 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 |
---
base_model: unsloth/mistral-nemo-base-2407-bnb-4bit
language:
- en
license: apache-2.0
tags:
- text-generation-inference
- transformers
- unsloth
- mistral
- trl
---
# Mistral-Nemo-12b-Unsloth-2x-Faster-Finetuning
# Model Overview:
- **Developed by:** skkjodhpur
- **License:** Apache-2.0
- **Base Model:** unsloth/mistral-nemo-base-2407-bnb-4bit
- **Libraries Used:** Unsloth, Huggingface's TRL (Transformers Reinforcement Learning) library
- **Finetuned from model :** unsloth/mistral-nemo-base-2407-bnb-4bit
**Model Description**
The Mistral-Nemo-12b model has been fine-tuned for text generation tasks. This fine-tuning was performed using the Unsloth optimization framework, which significantly accelerates the training process, achieving a 2x faster fine-tuning time compared to conventional methods. The model leverages the robust capabilities of Huggingface's TRL library, enhancing its performance in generating high-quality text.
**Features**
**Language:** English
**Capabilities:** Text generation, transformers-based inference
**Fine-tuning Details:** The fine-tuning process was focused on improving inference speed and maintaining or enhancing the quality of the generated text.
This mistral model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
|