metadata

library_name: transformers
base_model: Isotonic/TinyMixtral_4x220M-UniversalNER

Model card of Tiny_JOxIE_4x220M_UniversalNER_base

This is my Token customized Isotonic/TinyMixtral_4x220M-UniversalNER model

[Origional Model][https://huggingface.co/Isotonic/TinyMixtral_4x220M-UniversalNER]

This is based on Isotonic/TinyMixtral_4x220M-UniversalNER model with added custom special Tokens.

New added Special Tokens

'<|functions|>',
'<|gökdeniz|>',
'<|user|>',
'<|josie|>',
'<|assistant|>',
'<|function_call|>',
'<|function_response|>',
'<|image|>',
'<|long_term_memory|>',
'<|short_term_memory|>',
'<|home_state|>',
'<|current_states|>',
'<|context|>'

New BOS and EOS Tokens

BOS = '<|startoftext|>'
EOS = '<|endoftext|>'

New added Normal Tokens

['Gökdeniz Gülmez', 'Gökdeniz', 'Gülmez', 'JOSIE', 'J.O.S.I.E.', 'Josie', 'josie', 'Just an Outstandingly Smart and Intelligent Entity']