mymusise

/

CPM-Generate-distill

like 6

First, "text_generator" name is wrong(it is a small mistake)
And Huggingface update the fuction: "AutoModelWithLMHead" with
AutoModelForCausalLM for causal language models, AutoModelForMaskedLM for masked language models and AutoModelForSeq2SeqLM for encoder-decoder models
And we should use AutoModelForCausalLM here.
The performance is better btw.