👨🏻⚕️ Spanish Clinical Encoders Analysis
Collection
Models and datasets used in the paper `A comparative analysis of Spanish Clinical encoder-based models on NER and classification tasks`
•
92 items
•
Updated
xlm-roberta-large-ctebmsp
This model is a finetuned version of xlm-roberta-large for the CT-EBM-SP (Clinical Trials for Evidence-based Medicine in Spanish) dataset used in a benchmark in the paper TODO. The model has a F1 of 0.906
Please refer to the original publication for more information TODO LINK
Parameters used
| parameter | Value |
|---|---|
| batch size | 64 |
| learning rate | 2e-05 |
| classifier dropout | 0.1 |
| warmup ratio | 0 |
| warmup steps | 0 |
| weight decay | 0 |
| optimizer | AdamW |
| epochs | 10 |
| early stopping patience | 3 |
BibTeX entry and citation info
TODO
- Downloads last month
- 14
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.
Dataset used to train IIC/xlm-roberta-large-ctebmsp
Collection including IIC/xlm-roberta-large-ctebmsp
Evaluation results
- f1 on CT-EBM-SP (Clinical Trials for Evidence-based Medicine in Spanish)test set self-reported0.906