simonycl's picture
update model card README.md
504ce93
metadata
license: apache-2.0
base_model: albert-base-v2
tags:
  - generated_from_trainer
metrics:
  - accuracy
model-index:
  - name: best_model-yelp_polarity-16-87
    results: []

best_model-yelp_polarity-16-87

This model is a fine-tuned version of albert-base-v2 on an unknown dataset. It achieves the following results on the evaluation set:

  • Loss: 0.0012
  • Accuracy: 1.0

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 1e-05
  • train_batch_size: 32
  • eval_batch_size: 32
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • lr_scheduler_warmup_steps: 500
  • num_epochs: 150

Training results

Training Loss Epoch Step Validation Loss Accuracy
No log 1.0 1 0.3437 0.875
No log 2.0 2 0.3444 0.875
No log 3.0 3 0.3459 0.875
No log 4.0 4 0.3481 0.875
No log 5.0 5 0.3509 0.875
No log 6.0 6 0.3542 0.875
No log 7.0 7 0.3577 0.875
No log 8.0 8 0.3605 0.875
No log 9.0 9 0.3609 0.875
1.0043 10.0 10 0.3571 0.875
1.0043 11.0 11 0.3490 0.875
1.0043 12.0 12 0.3367 0.875
1.0043 13.0 13 0.3202 0.875
1.0043 14.0 14 0.2996 0.875
1.0043 15.0 15 0.2751 0.875
1.0043 16.0 16 0.2470 0.9375
1.0043 17.0 17 0.2159 0.9375
1.0043 18.0 18 0.1832 0.9375
1.0043 19.0 19 0.1516 0.9375
0.6554 20.0 20 0.1241 0.9688
0.6554 21.0 21 0.1018 0.9688
0.6554 22.0 22 0.0818 0.9688
0.6554 23.0 23 0.0611 0.9688
0.6554 24.0 24 0.0378 0.9688
0.6554 25.0 25 0.0170 1.0
0.6554 26.0 26 0.0093 1.0
0.6554 27.0 27 0.0077 1.0
0.6554 28.0 28 0.0073 1.0
0.6554 29.0 29 0.0072 1.0
0.1962 30.0 30 0.0072 1.0
0.1962 31.0 31 0.0071 1.0
0.1962 32.0 32 0.0070 1.0
0.1962 33.0 33 0.0069 1.0
0.1962 34.0 34 0.0068 1.0
0.1962 35.0 35 0.0067 1.0
0.1962 36.0 36 0.0065 1.0
0.1962 37.0 37 0.0063 1.0
0.1962 38.0 38 0.0060 1.0
0.1962 39.0 39 0.0058 1.0
0.0075 40.0 40 0.0056 1.0
0.0075 41.0 41 0.0053 1.0
0.0075 42.0 42 0.0051 1.0
0.0075 43.0 43 0.0050 1.0
0.0075 44.0 44 0.0048 1.0
0.0075 45.0 45 0.0046 1.0
0.0075 46.0 46 0.0045 1.0
0.0075 47.0 47 0.0043 1.0
0.0075 48.0 48 0.0042 1.0
0.0075 49.0 49 0.0041 1.0
0.0019 50.0 50 0.0040 1.0
0.0019 51.0 51 0.0039 1.0
0.0019 52.0 52 0.0038 1.0
0.0019 53.0 53 0.0037 1.0
0.0019 54.0 54 0.0036 1.0
0.0019 55.0 55 0.0035 1.0
0.0019 56.0 56 0.0035 1.0
0.0019 57.0 57 0.0034 1.0
0.0019 58.0 58 0.0033 1.0
0.0019 59.0 59 0.0033 1.0
0.0014 60.0 60 0.0032 1.0
0.0014 61.0 61 0.0032 1.0
0.0014 62.0 62 0.0031 1.0
0.0014 63.0 63 0.0031 1.0
0.0014 64.0 64 0.0030 1.0
0.0014 65.0 65 0.0030 1.0
0.0014 66.0 66 0.0029 1.0
0.0014 67.0 67 0.0029 1.0
0.0014 68.0 68 0.0029 1.0
0.0014 69.0 69 0.0028 1.0
0.0011 70.0 70 0.0028 1.0
0.0011 71.0 71 0.0028 1.0
0.0011 72.0 72 0.0027 1.0
0.0011 73.0 73 0.0027 1.0
0.0011 74.0 74 0.0027 1.0
0.0011 75.0 75 0.0026 1.0
0.0011 76.0 76 0.0026 1.0
0.0011 77.0 77 0.0026 1.0
0.0011 78.0 78 0.0026 1.0
0.0011 79.0 79 0.0025 1.0
0.0009 80.0 80 0.0025 1.0
0.0009 81.0 81 0.0025 1.0
0.0009 82.0 82 0.0024 1.0
0.0009 83.0 83 0.0024 1.0
0.0009 84.0 84 0.0024 1.0
0.0009 85.0 85 0.0023 1.0
0.0009 86.0 86 0.0023 1.0
0.0009 87.0 87 0.0023 1.0
0.0009 88.0 88 0.0022 1.0
0.0009 89.0 89 0.0022 1.0
0.0008 90.0 90 0.0022 1.0
0.0008 91.0 91 0.0021 1.0
0.0008 92.0 92 0.0021 1.0
0.0008 93.0 93 0.0021 1.0
0.0008 94.0 94 0.0020 1.0
0.0008 95.0 95 0.0020 1.0
0.0008 96.0 96 0.0020 1.0
0.0008 97.0 97 0.0019 1.0
0.0008 98.0 98 0.0019 1.0
0.0008 99.0 99 0.0019 1.0
0.0007 100.0 100 0.0019 1.0
0.0007 101.0 101 0.0018 1.0
0.0007 102.0 102 0.0018 1.0
0.0007 103.0 103 0.0018 1.0
0.0007 104.0 104 0.0018 1.0
0.0007 105.0 105 0.0018 1.0
0.0007 106.0 106 0.0017 1.0
0.0007 107.0 107 0.0017 1.0
0.0007 108.0 108 0.0017 1.0
0.0007 109.0 109 0.0017 1.0
0.0006 110.0 110 0.0017 1.0
0.0006 111.0 111 0.0016 1.0
0.0006 112.0 112 0.0016 1.0
0.0006 113.0 113 0.0016 1.0
0.0006 114.0 114 0.0016 1.0
0.0006 115.0 115 0.0016 1.0
0.0006 116.0 116 0.0016 1.0
0.0006 117.0 117 0.0015 1.0
0.0006 118.0 118 0.0015 1.0
0.0006 119.0 119 0.0015 1.0
0.0005 120.0 120 0.0015 1.0
0.0005 121.0 121 0.0015 1.0
0.0005 122.0 122 0.0015 1.0
0.0005 123.0 123 0.0015 1.0
0.0005 124.0 124 0.0015 1.0
0.0005 125.0 125 0.0014 1.0
0.0005 126.0 126 0.0014 1.0
0.0005 127.0 127 0.0014 1.0
0.0005 128.0 128 0.0014 1.0
0.0005 129.0 129 0.0014 1.0
0.0005 130.0 130 0.0014 1.0
0.0005 131.0 131 0.0014 1.0
0.0005 132.0 132 0.0014 1.0
0.0005 133.0 133 0.0014 1.0
0.0005 134.0 134 0.0014 1.0
0.0005 135.0 135 0.0013 1.0
0.0005 136.0 136 0.0013 1.0
0.0005 137.0 137 0.0013 1.0
0.0005 138.0 138 0.0013 1.0
0.0005 139.0 139 0.0013 1.0
0.0004 140.0 140 0.0013 1.0
0.0004 141.0 141 0.0013 1.0
0.0004 142.0 142 0.0013 1.0
0.0004 143.0 143 0.0013 1.0
0.0004 144.0 144 0.0013 1.0
0.0004 145.0 145 0.0013 1.0
0.0004 146.0 146 0.0013 1.0
0.0004 147.0 147 0.0013 1.0
0.0004 148.0 148 0.0012 1.0
0.0004 149.0 149 0.0012 1.0
0.0004 150.0 150 0.0012 1.0

Framework versions

  • Transformers 4.32.0.dev0
  • Pytorch 2.0.1+cu118
  • Datasets 2.4.0
  • Tokenizers 0.13.3