File size: 1,063 Bytes
0ab7ab0 a97d8aa 0ab7ab0 da4d410 0ab7ab0 da4d410 0ab7ab0 da4d410 0ab7ab0 da4d410 0ab7ab0 da4d410 8e8b72d 0ab7ab0 da4d410 0ab7ab0 a97d8aa |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 |
---
library_name: transformers
tags:
- ultrachat
datasets:
- HuggingFaceH4/ultrachat_200k
base_model:
- TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T
---
# Model Card for Model ID
This is quantized adapters trained on the Ultrachat 200k dataset for the TinyLlama-1.1B Intermediate Step 1431k 3T model.
adapter_name = TinyLlama-1.1B-intermediate-1431k-3T-adapters-ultrachat
## Model Details
Base model was quantized using BitsAndBytes
```python
from bitsandbytes import BitsAndBytesConfig
bnb_config = BitsAndBytesConfig(
load_in_4bit=True, # Use 4-bit precision model loading
bnb_4bit_quant_type="nf4", # Quantization type
bnb_4bit_compute_dtype="float16", # Compute data type
bnb_4bit_use_double_quant=True # Apply nested quantization
)
```
### Model Description
This is quantized adapters trained on the Ultrachat 200k dataset for the TinyLlama-1.1B Intermediate Step 1431k 3T model.
- Finetuned from model : [TinyLlama](https://huggingface.co/TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T) |