Update README_TEMPLATE.md
Browse files- README_TEMPLATE.md +17 -6
README_TEMPLATE.md
CHANGED
@@ -6,16 +6,27 @@ pipeline_tag: text-generation
|
|
6 |
license: apache-2.0
|
7 |
language:
|
8 |
- en
|
|
|
|
|
9 |
---
|
10 |
# GGML converted versions of [Together](https://huggingface.co/togethercomputer)'s RedPajama models
|
11 |
|
12 |
-
|
13 |
-
|
|
|
14 |
The training was done on 3,072 V100 GPUs provided as part of the INCITE 2023 project on Scalable Foundation Models for Transferrable Generalist AI, awarded to MILA, LAION, and EleutherAI in fall 2022, with support from the Oak Ridge Leadership Computing Facility (OLCF) and INCITE program.
|
15 |
|
16 |
-
- Base Model: [RedPajama-INCITE-Base
|
17 |
-
- Instruction-tuned Version: [RedPajama-INCITE-Instruct
|
18 |
-
- Chat Version: [RedPajama-INCITE-Chat
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
19 |
|
20 |
## Converted Models:
|
21 |
|
@@ -33,7 +44,7 @@ Via pip: `pip install llm-rs`
|
|
33 |
from llm_rs import AutoModel
|
34 |
|
35 |
#Load the model, define any model you like from the list above as the `model_file`
|
36 |
-
model = AutoModel.from_pretrained("rustformers/redpajama-
|
37 |
|
38 |
#Generate
|
39 |
print(model.generate("The meaning of life is"))
|
|
|
6 |
license: apache-2.0
|
7 |
language:
|
8 |
- en
|
9 |
+
datasets:
|
10 |
+
- togethercomputer/RedPajama-Data-1T
|
11 |
---
|
12 |
# GGML converted versions of [Together](https://huggingface.co/togethercomputer)'s RedPajama models
|
13 |
|
14 |
+
# RedPajama-INCITE-7B-Base
|
15 |
+
|
16 |
+
RedPajama-INCITE-7B-Base was developed by Together and leaders from the open-source AI community including Ontocord.ai, ETH DS3Lab, AAI CERC, Université de Montréal, MILA - Québec AI Institute, Stanford Center for Research on Foundation Models (CRFM), Stanford Hazy Research research group and LAION.
|
17 |
The training was done on 3,072 V100 GPUs provided as part of the INCITE 2023 project on Scalable Foundation Models for Transferrable Generalist AI, awarded to MILA, LAION, and EleutherAI in fall 2022, with support from the Oak Ridge Leadership Computing Facility (OLCF) and INCITE program.
|
18 |
|
19 |
+
- Base Model: [RedPajama-INCITE-7B-Base](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base)
|
20 |
+
- Instruction-tuned Version: [RedPajama-INCITE-7B-Instruct](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Instruct)
|
21 |
+
- Chat Version: [RedPajama-INCITE-7B-Chat](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Chat)
|
22 |
+
|
23 |
+
|
24 |
+
## Model Details
|
25 |
+
- **Developed by**: Together Computer.
|
26 |
+
- **Model type**: Language Model
|
27 |
+
- **Language(s)**: English
|
28 |
+
- **License**: Apache 2.0
|
29 |
+
- **Model Description**: A 6.9B parameter pretrained language model.
|
30 |
|
31 |
## Converted Models:
|
32 |
|
|
|
44 |
from llm_rs import AutoModel
|
45 |
|
46 |
#Load the model, define any model you like from the list above as the `model_file`
|
47 |
+
model = AutoModel.from_pretrained("rustformers/redpajama-7b-ggml",model_file="RedPajama-INCITE-7B-Base-q4_0-ggjt.bin")
|
48 |
|
49 |
#Generate
|
50 |
print(model.generate("The meaning of life is"))
|