BigBird Model
#4
by
rafaellaae
- opened
Your github repo only has the BERT model available, yet I was looking to use the BigBird model due to the larger input size (24000 vs 3000). Is that possible?
Hi! Weights for all pre-trained models are uploaded to the Huggingface model hub.
Yes, you can use the BigBird model as shown in the model card examples: https://huggingface.co/AIRI-Institute/gena-lm-bigbird-base-t2t#examples