veronica-girolimetti/t5classification-from-rattle

results

This model is a fine-tuned version of google/flan-t5-small on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 0.2443

• Classification Report: precision recall f1-score support

  ALLERGY       0.84      0.94      0.89        17
  

  ASSESSMENT 0.00 0.00 0.00 10 CC 0.47 0.36 0.41 22 DIAGNOSIS 0.00 0.00 0.00 6 DISPOSITION 0.00 0.00 0.00 4 EDCOURSE 0.00 0.00 0.00 2 EXAM 0.00 0.00 0.00 8 FAM/SOCHX 0.87 0.97 0.92 98 GENHX 0.76 0.92 0.83 75 IMAGING 0.00 0.00 0.00 3

IMMUNIZATIONS 0.00 0.00 0.00 3 LABS 0.00 0.00 0.00 1 MEDICATIONS 0.73 0.94 0.82 17 OTHER_HISTORY 0.00 0.00 0.00 3 PASTMEDICALHX 0.59 0.78 0.67 37 PASTSURGICAL 0.73 0.79 0.76 14 PLAN 0.00 0.00 0.00 5 PROCEDURES 0.00 0.00 0.00 2 ROS 0.35 0.43 0.39 14

 accuracy                           0.73       341
macro avg       0.28      0.32      0.30       341

weighted avg 0.63 0.73 0.68 341

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 0.0003
• train_batch_size: 16
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 2

Training results

Training Loss	Epoch	Step	Validation Loss	Classification Report
No log	1.0	85	0.2758	precision recall f1-score support

  ALLERGY       0.76      0.94      0.84        17

ASSESSMENT 0.00 0.00 0.00 10 CC 0.44 0.32 0.37 22 DIAGNOSIS 0.00 0.00 0.00 6 DISPOSITION 0.00 0.00 0.00 4 EDCOURSE 0.00 0.00 0.00 2 EXAM 0.00 0.00 0.00 8 FAM/SOCHX 0.86 0.98 0.91 98 GENHX 0.72 0.91 0.80 75 IMAGING 0.00 0.00 0.00 3 IMMUNIZATIONS 0.00 0.00 0.00 3 LABS 0.00 0.00 0.00 1 MEDICATIONS 0.70 0.82 0.76 17 OTHER_HISTORY 0.00 0.00 0.00 3 PASTMEDICALHX 0.47 0.59 0.52 37 PASTSURGICAL 0.61 0.79 0.69 14 PLAN 0.00 0.00 0.00 5 PROCEDURES 0.00 0.00 0.00 2 ROS 0.50 0.43 0.46 14

 accuracy                           0.70       341
macro avg       0.27      0.30      0.28       341

weighted avg 0.60 0.70 0.65 341 | | No log | 2.0 | 170 | 0.2443 | precision recall f1-score support

  ALLERGY       0.84      0.94      0.89        17

ASSESSMENT 0.00 0.00 0.00 10 CC 0.47 0.36 0.41 22 DIAGNOSIS 0.00 0.00 0.00 6 DISPOSITION 0.00 0.00 0.00 4 EDCOURSE 0.00 0.00 0.00 2 EXAM 0.00 0.00 0.00 8 FAM/SOCHX 0.87 0.97 0.92 98 GENHX 0.76 0.92 0.83 75 IMAGING 0.00 0.00 0.00 3 IMMUNIZATIONS 0.00 0.00 0.00 3 LABS 0.00 0.00 0.00 1 MEDICATIONS 0.73 0.94 0.82 17 OTHER_HISTORY 0.00 0.00 0.00 3 PASTMEDICALHX 0.59 0.78 0.67 37 PASTSURGICAL 0.73 0.79 0.76 14 PLAN 0.00 0.00 0.00 5 PROCEDURES 0.00 0.00 0.00 2 ROS 0.35 0.43 0.39 14

 accuracy                           0.73       341
macro avg       0.28      0.32      0.30       341

weighted avg 0.63 0.73 0.68 341 |

Framework versions

• Transformers 4.36.2
• Pytorch 2.1.2+cu121
• Datasets 2.16.0
• Tokenizers 0.15.0