YAML Metadata
Warning:
empty or missing yaml metadata in repo card
(https://huggingface.co/docs/hub/model-cards#model-card-metadata)
This repository doesn't contain a model, but only a tokenizer that can be used with the
tokenizers
library.
This tokenizer is just a copy of bert-base-uncased
.
from tokenizers import Tokenizer
tokenizer = Tokenizer.from_pretrained("anthony/tokenizers-test")