mpasila commited on
Commit
d47f0cd
1 Parent(s): 4a20aea

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -3
README.md CHANGED
@@ -2,7 +2,7 @@
2
  base_model: unsloth/meta-llama-3.1-8b
3
  language:
4
  - en
5
- license: apache-2.0
6
  tags:
7
  - text-generation-inference
8
  - transformers
@@ -10,14 +10,24 @@ tags:
10
  - llama
11
  - trl
12
  - sft
 
 
 
13
  ---
 
 
 
 
 
 
 
14
 
15
  # Uploaded model
16
 
17
  - **Developed by:** mpasila
18
- - **License:** apache-2.0
19
  - **Finetuned from model :** unsloth/meta-llama-3.1-8b
20
 
21
  This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
22
 
23
- [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
2
  base_model: unsloth/meta-llama-3.1-8b
3
  language:
4
  - en
5
+ license: llama3.1
6
  tags:
7
  - text-generation-inference
8
  - transformers
 
10
  - llama
11
  - trl
12
  - sft
13
+ - not-for-all-audiences
14
+ datasets:
15
+ - mpasila/Literotica-stories-short
16
  ---
17
+ Dataset used: [mpasila/Literotica-stories-short](https://huggingface.co/datasets/mpasila/Literotica-stories-short) which contains only a subset of the stories from the full Literotica dataset and was chunked down to fit within 8192 tokens.
18
+
19
+ Prompt format is: No formatting
20
+
21
+ LoRA: [mpasila/Llama-3.1-Literotica-LoRA-8B](https://huggingface.co/mpasila/Llama-3.1-Literotica-LoRA-8B)
22
+
23
+ Trained with regular LoRA (not quantized/QLoRA) and LoRA rank was 128 and Alpha set to 32. Trained for 1 epoch using A40 for about 13 hours.
24
 
25
  # Uploaded model
26
 
27
  - **Developed by:** mpasila
28
+ - **License:** Llama 3.1 Community License Agreement
29
  - **Finetuned from model :** unsloth/meta-llama-3.1-8b
30
 
31
  This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
32
 
33
+ [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)