File size: 970 Bytes
c7f31b7 00c7c7f c7f31b7 00c7c7f |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 |
---
library_name: transformers
base_model: Isotonic/TinyMixtral_4x220M-UniversalNER
---
# Model card of Tiny_JOxIE_4x220M_UniversalNER_base
## This is my Token customized Isotonic/TinyMixtral_4x220M-UniversalNER model
[Origional Model][https://huggingface.co/Isotonic/TinyMixtral_4x220M-UniversalNER]
This is based on Isotonic/TinyMixtral_4x220M-UniversalNER model with added custom special Tokens.
<br>
### New added Special Tokens
```text
'<|functions|>',
'<|gökdeniz|>',
'<|user|>',
'<|josie|>',
'<|assistant|>',
'<|function_call|>',
'<|function_response|>',
'<|image|>',
'<|long_term_memory|>',
'<|short_term_memory|>',
'<|home_state|>',
'<|current_states|>',
'<|context|>'
```
<br>
### New BOS and EOS Tokens
```text
BOS = '<|startoftext|>'
EOS = '<|endoftext|>'
```
<br>
### New added Normal Tokens
```text
['Gökdeniz Gülmez', 'Gökdeniz', 'Gülmez', 'JOSIE', 'J.O.S.I.E.', 'Josie', 'josie', 'Just an Outstandingly Smart and Intelligent Entity']
``` |