szymonrucinski
commited on
Commit
•
05cceac
1
Parent(s):
26cc4d0
Update README.md
Browse files
README.md
CHANGED
@@ -5,7 +5,7 @@ language:
|
|
5 |
---
|
6 |
# Model Card for Krakowiak-v2-7b
|
7 |
|
8 |
-
Krakowiak-v2-7b is a state of the art 7.3 billion parameters LLM based on Mistral-7B. It was finetuned for Polish text generation using custom created large corpus of
|
9 |
|
10 |
## Model Architecture
|
11 |
|
|
|
5 |
---
|
6 |
# Model Card for Krakowiak-v2-7b
|
7 |
|
8 |
+
Krakowiak-v2-7b is a state of the art 7.3 billion parameters LLM based on Mistral-7B. It was finetuned for Polish text generation using custom created large corpus of 300K Polish instructions. It uses novel techniques e.g. LORA, adding noise to the embeddings for greater preformance. For full details of this model please read our [paper to be released soon](www.example.come)
|
9 |
|
10 |
## Model Architecture
|
11 |
|