How to get file tokenizer.json?

by AICoding91 - opened 15 days ago

15 days ago

I see that there is not file tokenizer.json? I want to see the mapping between tokens and indices.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment