Edit model card

This is a MicroBERT model for Indonesian.

  • Its suffix is -m, which means that it was pretrained using supervision from masked language modeling.
  • The unlabeled Indonesian data was taken from a June 2022 dump of Indonesian Wikipedia, downsampled to 1,439,772 tokens.
  • The UD treebank UD_Indonesian-GSD, v2.10, totaling 122,021 tokens, was used for labeled data.

Please see the repository and the paper for more details.

Downloads last month
2
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.