adalbertojunior
commited on
Commit
•
0c2eff5
1
Parent(s):
9d84f0b
Update README.md
Browse files
README.md
CHANGED
@@ -3,4 +3,17 @@ language:
|
|
3 |
- pt
|
4 |
---
|
5 |
|
|
|
6 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
3 |
- pt
|
4 |
---
|
5 |
|
6 |
+
This model was distilled from [BERTimbau](https://huggingface.co/neuralmind/bert-base-portuguese-cased)
|
7 |
|
8 |
+
## Usage
|
9 |
+
|
10 |
+
```python
|
11 |
+
from transformers import AutoTokenizer # Or BertTokenizer
|
12 |
+
from transformers import AutoModelForPreTraining # Or BertForPreTraining for loading pretraining heads
|
13 |
+
from transformers import AutoModel # or BertModel, for BERT without pretraining heads
|
14 |
+
model = AutoModelForPreTraining.from_pretrained('adalbertojunior/distilbert-portuguese-cased')
|
15 |
+
tokenizer = AutoTokenizer.from_pretrained('adalbertojunior/distilbert-portuguese-cased', do_lower_case=False)
|
16 |
+
```
|
17 |
+
You should fine tune it on your own data.
|
18 |
+
|
19 |
+
It can achieve accuracy up to 99% relative to the original BERTimbau in some tasks.
|