RuLeanALBERT is a pretrained masked language model for the Russian language using a memory-efficient architecture.

Read more about the model in this blog post (in Russian).

See its implementation, as well as the pretraining and finetuning code, at https://github.com/yandex-research/RuLeanALBERT.

Downloads last month
70
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Space using yandex/RuLeanALBERT 1