Upload tokenizer

#28

by ArthurZ HF staff - opened Dec 18, 2023

base: refs/heads/main

←

from: refs/pr/28

Discussion Files changed

+12990

-28

ArthurZ

Dec 18, 2023

Fixes #16, which showed that one of the merges is missing, which creates different outputs. The issue with this is that finetuned models were trained using this.

Upload tokenizer2ca60a10

ArthurZ

Jan 19

@sanchit-gandhi if you can merge this one!

sanchit-gandhi

Feb 29

Thanks for the fix @ArthurZ !

sanchit-gandhi changed pull request status to merged Feb 29

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment