Fix max_length parameters in tokenizer_config.json

by kubernetez - opened Sep 15, 2023

base: refs/heads/main

←

from: refs/pr/4

Discussion Files changed

-1

kubernetez

Sep 15, 2023

What ?
I tried to use the tokenizer but there is no truncation happening.
I think the parameter is misnamed.
How ?
Rename the parameter to model_max_length

Fix max_length parameters in tokenizer_config.jsonec08d621

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Ready to merge

This branch is ready to get merged automatically.

· Sign up or log in to comment