TenaliAI-FinTech-v1

This model was trained from scratch on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 0.9575

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 16
• eval_batch_size: 16
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 25

Training results

Training Loss	Epoch	Step	Validation Loss
2.1596	1.0	1251	1.5085
1.1181	2.0	2502	1.0933
1.0009	3.0	3753	1.0202
0.922	4.0	5004	0.9683
0.8721	5.0	6255	0.9575
0.8498	6.0	7506	0.9721
0.8363	7.0	8757	1.0118
0.8535	8.0	10008	0.9851
0.8239	9.0	11259	0.9728
0.8242	10.0	12510	0.9693
0.7947	11.0	13761	0.9947
0.7951	12.0	15012	0.9905
0.7874	13.0	16263	0.9900
0.7967	14.0	17514	0.9984
0.7666	15.0	18765	0.9918
0.7788	16.0	20016	0.9955
0.7832	17.0	21267	1.0130
0.7615	18.0	22518	1.0061
0.7666	19.0	23769	1.0104
0.7685	20.0	25020	1.0144
0.7367	21.0	26271	1.0275
0.7609	22.0	27522	1.0371
0.7663	23.0	28773	1.0271
0.7564	24.0	30024	1.0498
0.7478	25.0	31275	1.0385

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.1+cu121
• Datasets 2.21.0
• Tokenizers 0.19.1