shiyi-li
/

BirdAST

Model card Files Files and versions Community

shiyi-li commited on May 31

Commit

d91de4a

•

1 Parent(s): 71ba963

5fold training weights

Browse files

Files changed (10) hide show

.gitattributes +1 -0
BirdAST_Baseline_5folds_fold_0.pth +3 -0
BirdAST_Baseline_5folds_fold_1.pth +3 -0
BirdAST_Baseline_5folds_fold_2.pth +3 -0
BirdAST_Baseline_5folds_fold_3.pth +3 -0
BirdAST_Baseline_5folds_fold_4.pth +3 -0
BirdAST_Baseline_5folds_label_map.csv +729 -0
BirdAST_Baseline_5folds_loss.jpg +0 -0
BirdAST_Baseline_5folds_oof.csv +3 -0
BirdAST_Baseline_5folds_training.log +592 -0

.gitattributes CHANGED Viewed

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text

 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+BirdAST_Baseline_5folds_oof.csv filter=lfs diff=lfs merge=lfs -text

BirdAST_Baseline_5folds_fold_0.pth ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:16de508b77c808ab37e83674034dd7ff1d9e232ba44311d91ef14545a7d96e54
+size 349437557

BirdAST_Baseline_5folds_fold_1.pth ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e9461e08de98e19c4c51fcfb880435e0201bb19105291375b154e1a50a8b405b
+size 349437557

BirdAST_Baseline_5folds_fold_2.pth ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:77eee1df1c7209de9cd54ccd519e834b17f837d1c1d47a87e2171f32e7af523d
+size 349437557

BirdAST_Baseline_5folds_fold_3.pth ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3a80e9cef89191d3d23c945b3ef8bb1829dfb88868b59ba4d052f940103be8b1
+size 349437557

BirdAST_Baseline_5folds_fold_4.pth ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:690265d0acb06594038e76c2e60684624aec4648d3d494cfdfd83aa70aecc686
+size 349437557

BirdAST_Baseline_5folds_label_map.csv ADDED Viewed

	@@ -0,0 +1,729 @@

+scientific_name,species_id
+Accipiter_superciliosus,0
+Akletos_melanoceps,1
+Amazona_amazonica,2
+Amazona_diadema,3
+Amazona_farinosa,4
+Amazona_festiva,5
+Amblycercus_holosericeus,6
+Ammodramus_aurifrons,7
+Ammonastes_pelzelni,8
+Ampelion_rufaxilla,9
+Anabazenops_dorsalis,10
+Anairetes_parulus,11
+Andigena_hypoglauca,12
+Anhima_cornuta,13
+Anisognathus_lacrymosus,14
+Anthracothorax_viridigula,15
+Antrostomus_rufus,16
+Ara_ararauna,17
+Ara_chloropterus,18
+Ara_severus,19
+Aramides_cajaneus,20
+"Aramus_Vieillot,",21
+Aratinga_leucophthalma,22
+Ardea_cocoi,23
+Arremon_abeillei,24
+Arremon_assimilis,25
+Arremon_taciturnus,26
+Asthenes_flammulata,27
+Atlapetes_latinuchus,28
+Atticora_tibialis,29
+Attila_bolivianus,30
+Attila_cinnamomeus,31
+Attila_citriniventris,32
+Attila_spadiceus,33
+Automolus_infuscatus,34
+Automolus_ochrolaemus,35
+Automolus_paraensis,36
+Automolus_rufipileatus,37
+Automolus_subulatus,38
+Basileuterus_tristriatus,39
+Berlepschia_rikeri,40
+Boissonneaua_matthewsii,41
+Brotogeris_chrysoptera,42
+Brotogeris_cyanoptera,43
+Brotogeris_sanctithomae,44
+Brotogeris_versicolurus,45
+Bucco_capensis,46
+Buteo_nitidus,47
+Buteogallus_schistaceus,48
+Buteogallus_urubitinga,49
+Buthraupis_montana,50
+Cacicus_cela,51
+Cacicus_chrysonotus,52
+Cacicus_haemorrhous,53
+Cacicus_leucoramphus,54
+Calidris_fuscicollis,55
+Campephilus_melanoleucos,56
+Campephilus_pollens,57
+Campephilus_rubricollis,58
+Camptostoma_obsoletum,59
+Campylorhamphus_procurvoides,60
+Campylorhynchus_fasciatus,61
+Cantorchilus_leucotis,62
+Capito_auratus,63
+Capito_aurovirens,64
+Capito_niger,65
+Capsiempis_flaveola,66
+Carduelis_magellanica,67
+Caryothraustes_canadensis,68
+Catharus_fuscater,69
+Celeus_elegans,70
+Celeus_flavus,71
+Celeus_grammicus,72
+Celeus_torquatus,73
+Celeus_undatus,74
+Cephalopterus_ornatus,75
+Ceratopipra_erythrocephala,76
+Ceratotriccus_granadensis,77
+Cercomacra_cinerascens,78
+Cercomacra_manu,79
+Cercomacra_nigrescens,80
+Cercomacroides_fuscicauda,81
+Cercomacroides_serva,82
+Cercomacroides_tyrannina,83
+Certhiasomus_stictolaemus,84
+Certhiaxis_cinnamomeus,85
+Certhiaxis_mustelinus,86
+Chaetura_brachyura,87
+Chaetura_spinicaudus,88
+Chamaeza_mollissima,89
+Chamaeza_nobilis,90
+Charadrius_collaris,91
+Chelidoptera_tenebrosa,92
+Chionomesa_fimbriata,93
+Chiroxiphia_pareola,94
+Chlorestes_cyanus,95
+Chloroceryle_americana,96
+Chlorophanes_spiza,97
+Chlorophonia_pyrrhophrys,98
+Chlorornis_riefferii,99
+Chlorospingus_flavopectus,100
+Chlorostilbon_mellisugus,101
+Chlorostilbon_olivaresi,102
+Chordeiles_pusillus,103
+Chrysomus_icterocephalus,104
+Ciccaba_albitarsis,105
+Cinnycerthia_peruana,106
+Cissopis_leverianus,107
+Cistothorus_platensis,108
+Cnemoscopus_rubrirostris,109
+Cnemotriccus_fuscatus,110
+Cnipodectes_subbrunneus,111
+Coccycua_minuta,112
+Coccyzus_melacoryphus,113
+Coeligena_violifer,114
+"Coereba_Vieillot,",115
+Colaptes_atricollis,116
+Colibri_coruscans,117
+Columba_speciosa,118
+Columbina_cruziana,119
+Columbina_minuta,120
+Conirostrum_bicolor,121
+Conirostrum_margaritae,122
+Conopias_parvus,123
+Conopias_trivirgatus,124
+Conopophaga_aurita,125
+Contopus_fumigatus,126
+Contopus_punensis,127
+Corythopis_torquatus,128
+Cranioleuca_antisiensis,129
+Cranioleuca_berlepschi,130
+Cranioleuca_gutturata,131
+Cranioleuca_muelleri,132
+Cranioleuca_vulpecula,133
+Cranioleuca_vulpina,134
+Crax_alector,135
+Crax_globulosa,136
+Crotophaga_ani,137
+Crotophaga_major,138
+Crypturellus_bartletti,139
+Crypturellus_casiquiare,140
+Crypturellus_cinereus,141
+Crypturellus_duidae,142
+Crypturellus_soui,143
+Crypturellus_undulatus,144
+Crypturellus_variegatus,145
+Cyanerpes_caeruleus,146
+Cyanicterus_cyanicterus,147
+Cyanocorax_heilprini,148
+Cyanocorax_violaceus,149
+Cyanocorax_yncas,150
+Cyanoloxia_rothschildii,151
+Cyanolyca_viridicyanus,152
+Cyclarhis_gujanensis,153
+Cymbilaimus_lineatus,154
+Cyphorhinus_arada,155
+Cyphorhinus_thoracicus,156
+Cyphos_macrodactylus,157
+Dacnis_albiventris,158
+Daptrius_ater,159
+Deconychura_longicauda,160
+Dendrexetastes_rufigula,161
+Dendrocincla_fuliginosa,162
+Dendrocincla_merula,163
+Dendrocolaptes_certhia,164
+Dendrocolaptes_hoffmannsi,165
+Dendrocolaptes_picumnus,166
+Dendrocygna_autumnalis,167
+Dendroplex_kienerii,168
+Deroptyus_accipitrinus,169
+Dichrozona_cincta,170
+Diglossa_cyanea,171
+Diglossa_mystacalis,172
+Diglossa_sittoides,173
+Donacobius_atricapilla,174
+Dromococcyx_phasianellus,175
+Drymophila_devillei,176
+Drymophila_striaticeps,177
+Dryocopus_lineatus,178
+Egretta_alba,179
+Egretta_thula,180
+Elaenia_flavogaster,181
+Elaenia_pallatangae,182
+Elaenia_pelzelni,183
+Elaenia_ruficeps,184
+Elliotomyia_chionogaster,185
+Empidonomus_varius,186
+Epinecrophylla_amazonica,187
+Epinecrophylla_gutturalis,188
+Epinecrophylla_haematonota,189
+Epinecrophylla_leucophthalma,190
+Epinecrophylla_ornata,191
+Eriocnemis_alinae,192
+Eubucco_richardsoni,193
+Euchrepomis_humeralis,194
+Eucometis_penicillata,195
+Euphonia_cayennensis,196
+Euphonia_chlorotica,197
+Euphonia_chrysopasta,198
+Euphonia_cyanocephala,199
+Euphonia_minuta,200
+Euphonia_plumbea,201
+Euphonia_rufiventris,202
+Euphonia_xanthogaster,203
+Eupsittula_pertinax,204
+Eurypygidae,205
+Falco_deiroleucus,206
+Falco_femoralis,207
+Falco_magnirostris,208
+Falco_rufigularis,209
+Florisuga_mellivora,210
+Formicarius_analis,211
+Formicarius_colma,212
+Formicivora_grisea,213
+Forpus_crassirostris,214
+Forpus_xanthops,215
+Frederickena_unduliger,216
+Frederickena_viridis,217
+Fringilla_capensis,218
+Fringilla_psaltria,219
+Furnarius_figulus,220
+Furnarius_leucopus,221
+Furnarius_minor,222
+Furnarius_torridus,223
+Galbacyrhynchus_leucotis,224
+Galbalcyrhynchus_purusianus,225
+Galbula_cyanescens,226
+Galbula_cyanicollis,227
+Galbula_dea,228
+Galbula_galbula,229
+Galbula_leucogastra,230
+Galbula_ruficauda,231
+Galbula_tombacea,232
+Gallinula_galeata,233
+Geothlypis_aequinoctialis,234
+Geranospiza_caerulescens,235
+Glaucidium_bolivianum,236
+Glaucidium_brasilianum,237
+Glaucidium_hardyi,238
+Glyphorynchus_spirurus,239
+Grallaria_blakei,240
+Grallaria_carrikeri,241
+Grallaria_obscura,242
+Grallaria_occabambae,243
+Grallaria_przewalskii,244
+Grallaria_quitensis,245
+Grallaria_ruficapilla,246
+Grallaria_squamigera,247
+Grallaricula_leymebambae,248
+Grallaricula_ochraceifrons,249
+Graydidascalus_brachyurus,250
+Gymnomystax_mexicanus,251
+Gymnopithys_leucaspis,252
+Gymnopithys_rufigula,253
+Gymnopithys_salvini,254
+Habia_rubica,255
+Hafferia_fortis,256
+Haplospiza_rustica,257
+Harpia_harpyja,258
+Heliangelus_amethysticollis,259
+Helicolestes_hamatus,260
+Heliornis_fulica,261
+Hemithraupis_flavicollis,262
+Hemitriccus_griseipectus,263
+Hemitriccus_inornatus,264
+Hemitriccus_josephinae,265
+Hemitriccus_minimus,266
+Hemitriccus_minor,267
+Hemitriccus_zosterops,268
+Henicorhina_leucophrys,269
+Henicorhina_leucoptera,270
+Henicorhina_leucosticta,271
+Herpetotheres_cachinnans,272
+Herpsilochmus_axillaris,273
+Herpsilochmus_dorsimaculatus,274
+Herpsilochmus_dugandi,275
+Herpsilochmus_parkeri,276
+Herpsilochmus_praedictus,277
+Herpsilochmus_stotzi,278
+Heterocercus_aurantiivertex,279
+Heterocercus_flavivertex,280
+Hoploxypterus_cayanus,281
+Hylexetastes_perrotii,282
+Hylexetastes_uniformis,283
+Hylocharis_sapphirina,284
+Hylopezus_macularius,285
+Hylophilus_brunneiceps,286
+Hylophilus_muscicapinus,287
+Hylophilus_olivaceus,288
+Hylophilus_pectoralis,289
+Hylophilus_semicinereus,290
+Hylophilus_thoracicus,291
+Hylophylax_naevius,292
+Hylophylax_punctulatus,293
+Hypnelus_bicinctus,294
+Hypocnemis_cantator,295
+Hypocnemis_flavescens,296
+Hypocnemis_hypoxantha,297
+Hypocnemis_peruviana,298
+Hypocnemis_rondoni,299
+Hypocnemis_striata,300
+Hypocnemoides_maculicauda,301
+Hypocnemoides_melanopogon,302
+Ibycter_americanus,303
+Icterus_cayanensis,304
+Ictinia_plumbea,305
+Incaspiza_laeta,306
+Incaspiza_watkinsi,307
+Inezia_subflava,308
+Iodopleura_isabellae,309
+Iridosornis_reinhardti,310
+Isleria_guttata,311
+Islerothraupis_luctuosa,312
+Jacamerops_aureus,313
+Jacana_jacana,314
+Kleinothraupis_atropileus,315
+Knipolegus_orenocensis,316
+Lampropsar_tanagrinus,317
+Lamprospiza_melanoleuca,318
+Lanio_fulvus,319
+Lanio_versicolor,320
+Laniocera_hypopyrra,321
+Larus_serranus,322
+Laterallus_exilis,323
+Lathrotriccus_euleri,324
+Leistes_bellicosus,325
+Lepidocolaptes_duidae,326
+Lepidocolaptes_fatimalimae,327
+Lepidocolaptes_fuscicapillus,328
+Lepidothrix_coronata,329
+Lepidothrix_nattereri,330
+Lepidothrix_serena,331
+Leptodon_cayanensis,332
+Leptopogon_taczanowskii,333
+Leptotila_rufaxilla,334
+Leptotila_verreauxi,335
+Leuconotopicus_fumigatus,336
+Leucopternis_kuhli,337
+Liosceles_thoracicus,338
+Lipaugus_vociferans,339
+Loddigesia_mirabilis,340
+Lophostrix_cristata,341
+Lophotriccus_galeatus,342
+Lophotriccus_vitiosus,343
+Lurocalis_rufiventris,344
+Malacoptila_fusca,345
+Manacus_manacus,346
+Margarornis_squamiger,347
+Mazaria_propinqua,348
+Mecocerculus_stictopterus,349
+Megascops_albogularis,350
+Megascops_choliba,351
+Megascops_ingens,352
+Megascops_petersoni,353
+Megascops_watsonii,354
+Megastictus_margaritatus,355
+Melanerpes_cruentatus,356
+Melanopareia_maranonica,357
+Micrastur_gilvicollis,358
+Micrastur_mintoni,359
+Micrastur_mirandollei,360
+Micrastur_ruficollis,361
+Micrastur_semitorquatus,362
+Microbates_collaris,363
+Microcerculus_bambla,364
+Microcerculus_marginatus,365
+Microrhopias_quixensis,366
+Milvago_chimachima,367
+Mimus_longicaudatus,368
+Mionectes_oleagineus,369
+Mionectes_striaticollis,370
+Mitrephanes_olivaceus,371
+Monasa_atra,372
+Monasa_morphoeus,373
+Monasa_nigrifrons,374
+Muscicapa_similis,375
+Myadestes_ralloides,376
+Myiarchus_cephalotes,377
+Myiarchus_swainsoni,378
+Myiarchus_tuberculifer,379
+Myiarchus_tyrannulus,380
+Myioborus_melanocephalus,381
+Myioborus_miniatus,382
+Myiodynastes_maculatus,383
+Myiopagis_caniceps,384
+Myiopagis_flavivertex,385
+Myiopagis_gaimardii,386
+Myiophobus_cryptoxanthus,387
+Myiornis_ecaudatus,388
+Myiotheretes_fumigatus,389
+Myiothlypis_coronata,390
+Myiothlypis_luteoviridis,391
+Myiothlypis_nigrocristata,392
+Myiozetetes_cayanensis,393
+Myiozetetes_luteiventris,394
+Myornis_senilis,395
+Myrmeciza_atrothorax,396
+Myrmeciza_longipes,397
+Myrmelastes_humaythae,398
+Myrmelastes_hyperythrus,399
+Myrmelastes_leucostigma,400
+Myrmelastes_rufifacies,401
+Myrmoborus_leucophrys,402
+Myrmoborus_lugubris,403
+Myrmoborus_melanurus,404
+Myrmoborus_myotherinus,405
+Myrmochanes_hemileucus,406
+Myrmoderus_ferruginea,407
+Myrmornis_torquata,408
+Myrmothera_campanisona,409
+Myrmotherula_ambigua,410
+Myrmotherula_assimilis,411
+Myrmotherula_axillaris,412
+Myrmotherula_brachyura,413
+Myrmotherula_cherriei,414
+Myrmotherula_iheringi,415
+Myrmotherula_klagesi,416
+Myrmotherula_longipennis,417
+Myrmotherula_menetriesii,418
+Nasica_longirostris,419
+Nemosia_pileata,420
+Neoctantes_niger,421
+Neopelma_chrysocephalum,422
+Neopipo_cinnamomea,423
+Nesotriccus_tumbezanus,424
+Nonnula_sclateri,425
+Notharchus_hyperrhynchus,426
+Notharchus_ordii,427
+Notharchus_tectus,428
+Nothocrax_urumutum,429
+Nyctalops_stygius,430
+Nyctibius_grandis,431
+Nyctibius_leucopterus,432
+Nyctidromus_albicollis,433
+Nyctiprogne_leucopyga,434
+Nystactes_tamatia,435
+Nystalus_obamai,436
+Ochthoeca_cinnamomeiventris,437
+Ochthoeca_diadema,438
+Ochthoeca_pulchella,439
+Ochthoeca_thoracica,440
+Ocreatus_underwoodii,441
+Odontophorus_gujanensis,442
+Onychorhynchus_coronatus,443
+Opisthocomidae,444
+Ornithion_inerme,445
+Ortalis_guttata,446
+Ortalis_motmot,447
+Pachyramphus_castaneus,448
+Pachyramphus_marginatus,449
+Pachyramphus_minor,450
+Pachyramphus_polychopterus,451
+Pachyramphus_rufus,452
+Pachyramphus_surinamus,453
+Pachyramphus_versicolor,454
+Pachysylvia_hypoxantha,455
+Pardirallus_sanguinolentus,456
+Paroaria_gularis,457
+Patagioenas_cayennensis,458
+Patagioenas_plumbea,459
+Patagioenas_subvinacea,460
+Penelope_jacquacu,461
+Penelope_montagnii,462
+Percnostola_rufifrons,463
+Perissocephalus_tricolor,464
+Phacellodomus_rufifrons,465
+Phaeomyias_murina,466
+Phaeothlypis_fulvicauda,467
+Phaeothlypis_rivularis,468
+Phaethornis_guy,469
+Phaethornis_hispidus,470
+Phaethornis_malaris,471
+Phaethornis_ruber,472
+Phaethornis_rupurumii,473
+Phaethornis_superciliosus,474
+Phaetusa_simplex,475
+Pharomachrus_auriceps,476
+Pharomachrus_pavoninus,477
+Pheucticus_chrysogaster,478
+Pheugopedius_coraya,479
+Pheugopedius_euophrys,480
+Pheugopedius_genibarbis,481
+Pheugopedius_paucimaculatus,482
+Philydor_erythropterum,483
+Philydor_pyrrhodes,484
+Phlegopsis_erythroptera,485
+Phlegopsis_nigromaculata,486
+Phoenicircus_carnifex,487
+Phoenicircus_nigricollis,488
+Phyllaemulor_bracteatus,489
+Phyllomyias_plumbeiceps,490
+Phylloscartes_gualaquizae,491
+Phylloscartes_ventralis,492
+Piaya_cayana,493
+Piaya_melanogaster,494
+Piculus_chrysochloros,495
+Piculus_flavigula,496
+Picumnus_castelnau,497
+Picumnus_exilis,498
+Picumnus_lafresnayi,499
+Picumnus_steindachneri,500
+Picumnus_varzeae,501
+Pionites_melanocephalus,502
+Pionus_fuscus,503
+Pionus_menstruus,504
+Pipile_cumanensis,505
+Pipra_aureola,506
+Pipra_pipra,507
+Pipraeidea_bonariensis,508
+Pipreola_arcuata,509
+Piprites_chloris,510
+Piranga_hepatica,511
+Pitangus_lictor,512
+Pitangus_sulphuratus,513
+Pithys_albifrons,514
+Platyrinchus_coronatus,515
+Platyrinchus_platyrhynchos,516
+Poecilotriccus_calopterus,517
+Poecilotriccus_capitalis,518
+Poecilotriccus_latirostris,519
+Poecilotriccus_luluae,520
+Poecilotriccus_senex,521
+Polioptila_attenboroughi,522
+Polioptila_guianensis,523
+Polioptila_plumbea,524
+Polytmus_theresiae,525
+Progne_subis,526
+Psarocolius_angustifrons,527
+Psarocolius_bifasciatus,528
+Psarocolius_decumanus,529
+Psarocolius_viridis,530
+Pseudastur_albicollis,531
+Pseudocolaptes_boissonneauii,532
+Pseudotriccus_ruficeps,533
+Psittacara_frontatus,534
+Psittacara_mitratus,535
+Psophia_crepitans,536
+Pteroglossus_aracari,537
+Pteroglossus_azara,538
+Pteroglossus_beauharnaisii,539
+Pteroglossus_castanotis,540
+Pulsatrix_perspicillata,541
+Pygiptila_stellaris,542
+Pygochelidon_melanoleuca,543
+Pyriglena_maura,544
+Pyrilia_aurantiocephala,545
+Pyrilia_barrabandi,546
+Pyrilia_caica,547
+Pyrrhomyias_cinnamomeus,548
+Pyrrhura_roseifrons,549
+Querula_purpurata,550
+Ramphastos_sulfuratus,551
+Ramphastos_tucanus,552
+Ramphastos_vitellinus,553
+Ramphocaenus_melanurus,554
+Ramphocelus_carbo,555
+Ramphocelus_nigrogularis,556
+Ramphotrigon_megacephalum,557
+Ramphotrigon_ruficauda,558
+Rhegmatorhina_berlepschi,559
+Rhegmatorhina_cristata,560
+Rhegmatorhina_hoffmannsi,561
+Rhegmatorhina_melanosticta,562
+Rhynchocyclus_olivaceus,563
+Rhytipterna_immunda,564
+Rhytipterna_simplex,565
+Rostrhamus_sociabilis,566
+Rufirallus_castaneiceps,567
+Rufirallus_viridis,568
+Rupicola_rupicola,569
+Rynchops_niger,570
+Sakesphorus_canadensis,571
+Sakesphorus_luctuosus,572
+Saltator_coerulescens,573
+Saltator_grossus,574
+Saltator_maximus,575
+Saltator_striatipectus,576
+Schiffornis_major,577
+Schiffornis_turdina,578
+Schistocichla_schistacea,579
+Schizoeaca_fuliginosa,580
+Sciaphylax_castanea,581
+Sciaphylax_hemimelaena,582
+Sclateria_naevia,583
+Sclerurus_obscurior,584
+Sclerurus_rufigularis,585
+Scytalopus_altirostris,586
+Scytalopus_atratus,587
+Scytalopus_femoralis,588
+Scytalopus_intermedius,589
+Scytalopus_parvirostris,590
+Selenidera_gouldii,591
+Selenidera_nattereri,592
+Selenidera_piperivora,593
+Selenidera_reinwardtii,594
+Sericossypha_albocristata,595
+Serpophaga_hypoleuca,596
+Serpophaga_subcristata,597
+Sicalis_columbiana,598
+Sirystes_sibilator,599
+Sirystes_subcanescens,600
+Sittasomus_griseicapillus,601
+Spinus_olivaceus,602
+Spizaetus_ornatus,603
+Sporophila_angolensis,604
+Sporophila_bouvronides,605
+Sporophila_castaneiventris,606
+Sporophila_fringilloides,607
+Sporophila_luctuosa,608
+Sporophila_simplex,609
+Sternula_superciliaris,610
+Stilpnia_viridicollis,611
+Sturnella_militaris,612
+Sublegatus_obscurior,613
+Synallaxis_albescens,614
+Synallaxis_albigularis,615
+Synallaxis_azarae,616
+Synallaxis_gujanensis,617
+Synallaxis_hypospodia,618
+Synallaxis_maranonica,619
+Synallaxis_rutilans,620
+Synallaxis_unirufa,621
+Syndactyla_rufosuperciliata,622
+Syndactyla_ucayalae,623
+Tachycineta_albiventer,624
+Tachyphonus_cristatus,625
+Tachyphonus_phoenicius,626
+Tachyphonus_surinamus,627
+Talaphorus_chlorocercus,628
+Tangara_cayana,629
+Tangara_chilensis,630
+Tangara_nigroviridis,631
+Tangara_punctata,632
+Tangara_varia,633
+Tangara_velia,634
+Tapera_naevia,635
+Taraba_major,636
+Terenura_spodioptila,637
+Tersina_viridis,638
+Thamnomanes_ardesiacus,639
+Thamnomanes_caesius,640
+Thamnomanes_saturninus,641
+Thamnomanes_schistogynus,642
+Thamnophilus_aethiops,643
+Thamnophilus_amazonicus,644
+Thamnophilus_bernardi,645
+Thamnophilus_cryptoleucus,646
+Thamnophilus_doliatus,647
+Thamnophilus_murinus,648
+Thamnophilus_nigrocinereus,649
+Thamnophilus_punctatus,650
+Thamnophilus_ruficapillus,651
+Thamnophilus_schistaceus,652
+Thamnophilus_stictocephalus,653
+Thamnophilus_unicolor,654
+Thaumasius_taczanowskii,655
+Thlypopsis_inornata,656
+Thlypopsis_superciliaris,657
+Thraupis_episcopus,658
+Thripadectes_scrutator,659
+Thripophaga_fusciceps,660
+Thryothorus_griseus,661
+Tiaris_obscurus,662
+Tinamus_major,663
+Tityra_cayana,664
+Tityra_semifasciata,665
+Todirostrum_chrysocrotaphum,666
+Todirostrum_maculatum,667
+Todirostrum_pictum,668
+Tolmomyias_assimilis,669
+Tolmomyias_flaviventris,670
+Tolmomyias_poliocephalus,671
+Tolmomyias_sulphurescens,672
+Tolmomyias_traylori,673
+Tolmomyias_viridiceps,674
+Topaza_pella,675
+Topaza_pyra,676
+Touit_purpuratus,677
+Troglodytes_aedon,678
+Troglodytes_solstitialis,679
+Trogon_collaris,680
+Trogon_curucui,681
+Trogon_melanurus,682
+Trogon_ramonianus,683
+Trogon_rufus,684
+Trogon_violaceus,685
+Trogon_viridis,686
+Tunchiornis_ochraceiceps,687
+Turdus_albicollis,688
+Turdus_hauxwelli,689
+Turdus_ignobilis,690
+Turdus_lawrencii,691
+Turdus_leucomelas,692
+Turdus_maranonicus,693
+Turdus_nigriceps,694
+Turdus_sanchezorum,695
+Turdus_serranus,696
+Tyranneutes_stolzmanni,697
+Tyranneutes_virescens,698
+Tyranniscus_cinereiceps,699
+Tyranniscus_uropygialis,700
+Tyrannulus_elatus,701
+Tyrannus_melancholicus,702
+Tyrannus_savana,703
+Uranomitra_franciae,704
+Uromyias_agraphia,705
+Uropsalis_segmentata,706
+Veniliornis_cassini,707
+Vireo_chivi,708
+Vireolanius_leucotis,709
+Volatinia_jacarina,710
+Wetmorethraupis_sterrhopteron,711
+Willisornis_poecilinotus,712
+Xenoglaux_loweryi,713
+Xenopipo_atronitens,714
+Xenops_milleri,715
+Xenops_minutus,716
+Xiphocolaptes_promeropirhynchus,717
+Xipholena_punicea,718
+Xiphorhynchus_elegans,719
+Xiphorhynchus_guttatus,720
+Xiphorhynchus_obsoletus,721
+Xiphorhynchus_ocellatus,722
+Xiphorhynchus_pardalotus,723
+Xiphorhynchus_picus,724
+Zimmerius_acer,725
+Zimmerius_gracilipes,726
+Zimmerius_viridiflavus,727

BirdAST_Baseline_5folds_loss.jpg ADDED Viewed

BirdAST_Baseline_5folds_oof.csv ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f717a5f976ab916007f29eecfad4c7718e667665f6e8a7a30f05eb88b9f7217d
+size 90747059

BirdAST_Baseline_5folds_training.log ADDED Viewed

	@@ -0,0 +1,592 @@

+################################### TRAIN_CONFIG ###################################
+dataset_dir: ./Audio_XenoCanto
+labels_list: ./xeno_labels.csv
+model_name: BirdAST_Baseline_5folds
+backbone_name: MIT/ast-finetuned-audioset-10-10-0.4593
+n_classes: 728
+audio_sr: 16000
+segment_length: 10
+fft_window: 0.025
+hop_window_length: 0.01
+n_mels: 128
+low_cut: 1000
+high_cut: 8000
+top_db: 100
+batch_size: 4
+num_workers: 0
+n_splits: 5
+log_dir: ./training_logs
+max_lr: 1e-05
+epochs: 15
+weight_decay: 0.01
+lr_final_div: 1000
+amp: True
+grad_accum_steps: 1
+max_grad_norm: 10000000.0
+print_epoch_freq: 1
+print_freq: 500
+random_seed: 2046
+copy: <classmethod(<function Config.copy at 0x7679174d28c0>)>
+################################################################################
+Failed to detect the name of this notebook, you can set it manually with the WANDB_NOTEBOOK_NAME environment variable to enable code saving.
+Epoch 1 [0/2235] | Train Loss: 0.0084 Grad: 5827.5073 LR: 4.0000e-07 | Elapse: 4.53s
+################################### TRAIN_CONFIG ###################################
+dataset_dir: ./Audio_XenoCanto
+labels_list: ./xeno_labels.csv
+model_name: BirdAST_Baseline_5folds
+backbone_name: MIT/ast-finetuned-audioset-10-10-0.4593
+n_classes: 728
+audio_sr: 16000
+segment_length: 10
+fft_window: 0.025
+hop_window_length: 0.01
+n_mels: 128
+low_cut: 1000
+high_cut: 8000
+top_db: 100
+batch_size: 16
+num_workers: 0
+n_splits: 5
+log_dir: ./training_logs
+max_lr: 1e-05
+epochs: 15
+weight_decay: 0.01
+lr_final_div: 1000
+amp: True
+grad_accum_steps: 1
+max_grad_norm: 10000000.0
+print_epoch_freq: 1
+print_freq: 500
+random_seed: 2046
+copy: <classmethod(<function Config.copy at 0x72c092bb2b00>)>
+################################################################################
+Failed to detect the name of this notebook, you can set it manually with the WANDB_NOTEBOOK_NAME environment variable to enable code saving.
+Epoch 1 [0/559] | Train Loss: 0.1937 Grad: 68037.4219 LR: 4.0003e-07 | Elapse: 5.38s
+Epoch 1 [500/559] | Train Loss: 0.1745 Grad: 33365.0820 LR: 6.6576e-06 | Elapse: 662.72s
+Epoch 1 [558/559] | Train Loss: 0.1640 Grad: 45012.7109 LR: 7.6104e-06 | Elapse: 736.30s
+Epoch 1 [0/140] | Valid Loss: 0.1974 | Elapse: 1.78s
+Epoch 1 [139/140] | Valid Loss: 0.1618 | Elapse: 177.47s
+Epoch 1 - Train Loss: 0.1640 - Valid Loss: 0.5766 - Elapsed Time: 973.32s
+- Epoch 1: Best model found with loss = 0.5766.
+Epoch 2 [0/559] | Train Loss: 0.1964 Grad: 55763.4883 LR: 7.6259e-06 | Elapse: 1.70s
+Epoch 2 [500/559] | Train Loss: 0.1703 Grad: 39483.6250 LR: 9.9786e-06 | Elapse: 663.00s
+Epoch 2 [558/559] | Train Loss: 0.1594 Grad: 47397.5625 LR: 9.9660e-06 | Elapse: 736.53s
+Epoch 2 [0/140] | Valid Loss: 0.1822 | Elapse: 1.45s
+Epoch 2 [139/140] | Valid Loss: 0.1503 | Elapse: 177.50s
+Epoch 2 - Train Loss: 0.1594 - Valid Loss: 0.7081 - Elapsed Time: 973.49s
+- Epoch 2: Best model found with loss = 0.7081.
+Epoch 3 [0/559] | Train Loss: 0.1799 Grad: 67393.6719 LR: 9.9657e-06 | Elapse: 1.30s
+Epoch 3 [500/559] | Train Loss: 0.1420 Grad: 46305.6367 LR: 9.7377e-06 | Elapse: 653.21s
+Epoch 3 [558/559] | Train Loss: 0.1324 Grad: 49667.2188 LR: 9.6978e-06 | Elapse: 727.64s
+Epoch 3 [0/140] | Valid Loss: 0.1788 | Elapse: 1.65s
+Epoch 3 [139/140] | Valid Loss: 0.1328 | Elapse: 180.90s
+Epoch 3 - Train Loss: 0.1324 - Valid Loss: 0.7903 - Elapsed Time: 967.32s
+- Epoch 3: Best model found with loss = 0.7903.
+Epoch 4 [0/559] | Train Loss: 0.1564 Grad: 90217.3984 LR: 9.6970e-06 | Elapse: 1.47s
+Epoch 4 [500/559] | Train Loss: 0.1024 Grad: 57958.9102 LR: 9.2415e-06 | Elapse: 645.67s
+Epoch 4 [558/559] | Train Loss: 0.0954 Grad: 50135.2852 LR: 9.1763e-06 | Elapse: 715.82s
+Epoch 4 [0/140] | Valid Loss: 0.1678 | Elapse: 1.34s
+Epoch 4 [139/140] | Valid Loss: 0.1166 | Elapse: 174.58s
+Epoch 4 - Train Loss: 0.0954 - Valid Loss: 0.8370 - Elapsed Time: 950.32s
+- Epoch 4: Best model found with loss = 0.8370.
+Epoch 5 [0/559] | Train Loss: 0.1133 Grad: 98545.1953 LR: 9.1752e-06 | Elapse: 1.75s
+Epoch 5 [500/559] | Train Loss: 0.0708 Grad: 55418.7812 LR: 8.5166e-06 | Elapse: 646.95s
+Epoch 5 [558/559] | Train Loss: 0.0660 Grad: 38844.8906 LR: 8.4298e-06 | Elapse: 723.69s
+Epoch 5 [0/140] | Valid Loss: 0.1484 | Elapse: 1.25s
+Epoch 5 [139/140] | Valid Loss: 0.1034 | Elapse: 174.60s
+Epoch 5 - Train Loss: 0.0660 - Valid Loss: 0.8642 - Elapsed Time: 958.10s
+- Epoch 5: Best model found with loss = 0.8642.
+Epoch 6 [0/559] | Train Loss: 0.0655 Grad: 92076.9453 LR: 8.4282e-06 | Elapse: 1.32s
+Epoch 6 [500/559] | Train Loss: 0.0480 Grad: 49009.5000 LR: 7.6021e-06 | Elapse: 646.01s
+Epoch 6 [558/559] | Train Loss: 0.0449 Grad: 35213.2227 LR: 7.4983e-06 | Elapse: 719.55s
+Epoch 6 [0/140] | Valid Loss: 0.1325 | Elapse: 1.06s
+Epoch 6 [139/140] | Valid Loss: 0.0923 | Elapse: 180.89s
+Epoch 6 - Train Loss: 0.0449 - Valid Loss: 0.8900 - Elapsed Time: 960.07s
+- Epoch 6: Best model found with loss = 0.8900.
+Epoch 7 [0/559] | Train Loss: 0.0334 Grad: 69795.4609 LR: 7.4965e-06 | Elapse: 1.24s
+Epoch 7 [500/559] | Train Loss: 0.0334 Grad: 43454.2812 LR: 6.5474e-06 | Elapse: 650.74s
+Epoch 7 [558/559] | Train Loss: 0.0313 Grad: 28944.0547 LR: 6.4322e-06 | Elapse: 724.98s
+Epoch 7 [0/140] | Valid Loss: 0.1219 | Elapse: 1.35s
+Epoch 7 [139/140] | Valid Loss: 0.0838 | Elapse: 176.90s
+Epoch 7 - Train Loss: 0.0313 - Valid Loss: 0.9075 - Elapsed Time: 961.58s
+- Epoch 7: Best model found with loss = 0.9075.
+Epoch 8 [0/559] | Train Loss: 0.0170 Grad: 43371.9336 LR: 6.4302e-06 | Elapse: 1.26s
+Epoch 8 [500/559] | Train Loss: 0.0248 Grad: 39485.9570 LR: 5.4093e-06 | Elapse: 653.76s
+Epoch 8 [558/559] | Train Loss: 0.0234 Grad: 24213.1797 LR: 5.2888e-06 | Elapse: 732.80s
+Epoch 8 [0/140] | Valid Loss: 0.1195 | Elapse: 1.55s
+Epoch 8 [139/140] | Valid Loss: 0.0784 | Elapse: 182.49s
+Epoch 8 - Train Loss: 0.0234 - Valid Loss: 0.9198 - Elapsed Time: 975.01s
+- Epoch 8: Best model found with loss = 0.9198.
+Epoch 9 [0/559] | Train Loss: 0.0113 Grad: 29259.3535 LR: 5.2868e-06 | Elapse: 1.64s
+Epoch 9 [500/559] | Train Loss: 0.0198 Grad: 35717.7930 LR: 4.2491e-06 | Elapse: 656.84s
+Epoch 9 [558/559] | Train Loss: 0.0187 Grad: 20421.3691 LR: 4.1299e-06 | Elapse: 732.78s
+Epoch 9 [0/140] | Valid Loss: 0.1195 | Elapse: 1.65s
+Epoch 9 [139/140] | Valid Loss: 0.0751 | Elapse: 177.80s
+Epoch 9 - Train Loss: 0.0187 - Valid Loss: 0.9285 - Elapsed Time: 970.49s
+- Epoch 9: Best model found with loss = 0.9285.
+Epoch 10 [0/559] | Train Loss: 0.0088 Grad: 22859.0410 LR: 4.1279e-06 | Elapse: 1.36s
+Epoch 10 [500/559] | Train Loss: 0.0165 Grad: 29824.0293 LR: 3.1294e-06 | Elapse: 651.96s
+Epoch 10 [558/559] | Train Loss: 0.0157 Grad: 17685.0957 LR: 3.0180e-06 | Elapse: 725.69s
+Epoch 10 [0/140] | Valid Loss: 0.1202 | Elapse: 1.45s
+Epoch 10 [139/140] | Valid Loss: 0.0731 | Elapse: 178.00s
+Epoch 10 - Train Loss: 0.0157 - Valid Loss: 0.9346 - Elapsed Time: 964.26s
+- Epoch 10: Best model found with loss = 0.9346.
+Epoch 11 [0/559] | Train Loss: 0.0078 Grad: 20275.6602 LR: 3.0161e-06 | Elapse: 1.09s
+Epoch 11 [500/559] | Train Loss: 0.0146 Grad: 26114.4258 LR: 2.1105e-06 | Elapse: 643.29s
+Epoch 11 [558/559] | Train Loss: 0.0138 Grad: 16013.0762 LR: 2.0129e-06 | Elapse: 713.93s
+Epoch 11 [0/140] | Valid Loss: 0.1210 | Elapse: 1.35s
+Epoch 11 [139/140] | Valid Loss: 0.0714 | Elapse: 178.40s
+Epoch 11 - Train Loss: 0.0138 - Valid Loss: 0.9384 - Elapsed Time: 952.42s
+- Epoch 11: Best model found with loss = 0.9384.
+Epoch 12 [0/559] | Train Loss: 0.0074 Grad: 20586.8594 LR: 2.0112e-06 | Elapse: 1.37s
+Epoch 12 [500/559] | Train Loss: 0.0135 Grad: 28101.5156 LR: 1.2475e-06 | Elapse: 647.48s
+Epoch 12 [558/559] | Train Loss: 0.0128 Grad: 15472.9678 LR: 1.1688e-06 | Elapse: 721.03s
+Epoch 12 [0/140] | Valid Loss: 0.1222 | Elapse: 0.93s
+Epoch 12 [139/140] | Valid Loss: 0.0692 | Elapse: 180.78s
+Epoch 12 - Train Loss: 0.0128 - Valid Loss: 0.9413 - Elapsed Time: 960.70s
+- Epoch 12: Best model found with loss = 0.9413.
+Epoch 13 [0/559] | Train Loss: 0.0072 Grad: 20721.5391 LR: 1.1675e-06 | Elapse: 1.37s
+Epoch 13 [500/559] | Train Loss: 0.0134 Grad: 32372.1992 LR: 5.8671e-07 | Elapse: 650.37s
+Epoch 13 [558/559] | Train Loss: 0.0128 Grad: 16761.3359 LR: 5.3128e-07 | Elapse: 724.01s
+Epoch 13 [0/140] | Valid Loss: 0.1244 | Elapse: 1.34s
+Epoch 13 [139/140] | Valid Loss: 0.0688 | Elapse: 172.69s
+Epoch 13 - Train Loss: 0.0128 - Valid Loss: 0.9419 - Elapsed Time: 956.02s
+- Epoch 13: Best model found with loss = 0.9419.
+Epoch 14 [0/559] | Train Loss: 0.0076 Grad: 26602.7090 LR: 5.3035e-07 | Elapse: 1.34s
+Epoch 14 [500/559] | Train Loss: 0.0153 Grad: 28308.5898 LR: 1.6390e-07 | Elapse: 643.94s
+Epoch 14 [558/559] | Train Loss: 0.0145 Grad: 14808.6914 LR: 1.3469e-07 | Elapse: 714.98s
+Epoch 14 [0/140] | Valid Loss: 0.1268 | Elapse: 1.44s
+Epoch 14 [139/140] | Valid Loss: 0.0656 | Elapse: 176.59s
+Epoch 14 - Train Loss: 0.0145 - Valid Loss: 0.9434 - Elapsed Time: 951.58s
+- Epoch 14: Best model found with loss = 0.9434.
+Epoch 15 [0/559] | Train Loss: 0.0078 Grad: 28353.9336 LR: 1.3421e-07 | Elapse: 1.18s
+Epoch 15 [500/559] | Train Loss: 0.0188 Grad: 24622.5938 LR: 1.8075e-09 | Elapse: 638.46s
+Epoch 15 [558/559] | Train Loss: 0.0176 Grad: 12045.1396 LR: 4.0043e-10 | Elapse: 712.99s
+Epoch 15 [0/140] | Valid Loss: 0.1179 | Elapse: 1.32s
+Epoch 15 [139/140] | Valid Loss: 0.0590 | Elapse: 177.87s
+Epoch 15 - Train Loss: 0.0176 - Valid Loss: 0.9461 - Elapsed Time: 950.37s
+- Epoch 15: Best model found with loss = 0.9461.
+Fold 1 | Time: 241.61min | Overall Evaluation Loss: 0.9461
+Epoch 1 [0/559] | Train Loss: 0.4216 Grad: 124713.3594 LR: 4.0003e-07 | Elapse: 1.29s
+Epoch 1 [500/559] | Train Loss: 0.1733 Grad: 3465.7744 LR: 6.6576e-06 | Elapse: 638.69s
+Epoch 1 [558/559] | Train Loss: 0.1627 Grad: 33522.4336 LR: 7.6104e-06 | Elapse: 713.22s
+Epoch 1 [0/140] | Valid Loss: 0.0022 | Elapse: 1.25s
+Epoch 1 [139/140] | Valid Loss: 0.1657 | Elapse: 177.49s
+Epoch 1 - Train Loss: 0.1627 - Valid Loss: 0.5743 - Elapsed Time: 951.73s
+- Epoch 1: Best model found with loss = 0.5743.
+Epoch 2 [0/559] | Train Loss: 0.3910 Grad: 93335.5234 LR: 7.6259e-06 | Elapse: 1.65s
+Epoch 2 [500/559] | Train Loss: 0.1689 Grad: 3991.0815 LR: 9.9786e-06 | Elapse: 645.65s
+Epoch 2 [558/559] | Train Loss: 0.1581 Grad: 36387.4648 LR: 9.9660e-06 | Elapse: 720.68s
+Epoch 2 [0/140] | Valid Loss: 0.0025 | Elapse: 1.35s
+Epoch 2 [139/140] | Valid Loss: 0.1551 | Elapse: 174.90s
+Epoch 2 - Train Loss: 0.1581 - Valid Loss: 0.7066 - Elapsed Time: 954.89s
+- Epoch 2: Best model found with loss = 0.7066.
+Epoch 3 [0/559] | Train Loss: 0.3425 Grad: 120896.1484 LR: 9.9657e-06 | Elapse: 1.76s
+Epoch 3 [500/559] | Train Loss: 0.1436 Grad: 5205.2388 LR: 9.7377e-06 | Elapse: 651.85s
+Epoch 3 [558/559] | Train Loss: 0.1338 Grad: 41782.4336 LR: 9.6978e-06 | Elapse: 726.09s
+Epoch 3 [0/140] | Valid Loss: 0.0028 | Elapse: 1.28s
+Epoch 3 [139/140] | Valid Loss: 0.1380 | Elapse: 176.91s
+Epoch 3 - Train Loss: 0.1338 - Valid Loss: 0.7882 - Elapsed Time: 962.77s
+- Epoch 3: Best model found with loss = 0.7882.
+Epoch 4 [0/559] | Train Loss: 0.2430 Grad: 165577.8125 LR: 9.6970e-06 | Elapse: 1.38s
+Epoch 4 [500/559] | Train Loss: 0.1065 Grad: 5715.7354 LR: 9.2415e-06 | Elapse: 647.98s
+Epoch 4 [558/559] | Train Loss: 0.0990 Grad: 40249.1367 LR: 9.1763e-06 | Elapse: 719.71s
+Epoch 4 [0/140] | Valid Loss: 0.0029 | Elapse: 1.45s
+Epoch 4 [139/140] | Valid Loss: 0.1204 | Elapse: 180.50s
+Epoch 4 - Train Loss: 0.0990 - Valid Loss: 0.8343 - Elapsed Time: 959.92s
+- Epoch 4: Best model found with loss = 0.8343.
+Epoch 5 [0/559] | Train Loss: 0.1413 Grad: 195477.3906 LR: 9.1752e-06 | Elapse: 1.36s
+Epoch 5 [500/559] | Train Loss: 0.0759 Grad: 6313.8467 LR: 8.5166e-06 | Elapse: 649.84s
+Epoch 5 [558/559] | Train Loss: 0.0705 Grad: 37943.1094 LR: 8.4298e-06 | Elapse: 721.81s
+Epoch 5 [0/140] | Valid Loss: 0.0029 | Elapse: 1.13s
+Epoch 5 [139/140] | Valid Loss: 0.1068 | Elapse: 179.07s
+Epoch 5 - Train Loss: 0.0705 - Valid Loss: 0.8644 - Elapsed Time: 960.74s
+- Epoch 5: Best model found with loss = 0.8644.
+Epoch 6 [0/559] | Train Loss: 0.0582 Grad: 128484.4844 LR: 8.4282e-06 | Elapse: 1.10s
+Epoch 6 [500/559] | Train Loss: 0.0512 Grad: 6602.7700 LR: 7.6021e-06 | Elapse: 650.60s
+Epoch 6 [558/559] | Train Loss: 0.0478 Grad: 33963.3555 LR: 7.4983e-06 | Elapse: 724.14s
+Epoch 6 [0/140] | Valid Loss: 0.0029 | Elapse: 1.25s
+Epoch 6 [139/140] | Valid Loss: 0.0955 | Elapse: 180.59s
+Epoch 6 - Train Loss: 0.0478 - Valid Loss: 0.8855 - Elapsed Time: 963.84s
+- Epoch 6: Best model found with loss = 0.8855.
+Epoch 7 [0/559] | Train Loss: 0.0247 Grad: 70728.7188 LR: 7.4965e-06 | Elapse: 1.66s
+Epoch 7 [500/559] | Train Loss: 0.0355 Grad: 6962.7485 LR: 6.5474e-06 | Elapse: 652.36s
+Epoch 7 [558/559] | Train Loss: 0.0333 Grad: 28417.3770 LR: 6.4322e-06 | Elapse: 724.99s
+Epoch 7 [0/140] | Valid Loss: 0.0029 | Elapse: 1.25s
+Epoch 7 [139/140] | Valid Loss: 0.0878 | Elapse: 177.79s
+Epoch 7 - Train Loss: 0.0333 - Valid Loss: 0.9002 - Elapsed Time: 962.18s
+- Epoch 7: Best model found with loss = 0.9002.
+Epoch 8 [0/559] | Train Loss: 0.0140 Grad: 36290.3242 LR: 6.4302e-06 | Elapse: 1.17s
+Epoch 8 [500/559] | Train Loss: 0.0260 Grad: 6885.5967 LR: 5.4093e-06 | Elapse: 653.16s
+Epoch 8 [558/559] | Train Loss: 0.0245 Grad: 23809.4492 LR: 5.2888e-06 | Elapse: 726.92s
+Epoch 8 [0/140] | Valid Loss: 0.0028 | Elapse: 1.36s
+Epoch 8 [139/140] | Valid Loss: 0.0823 | Elapse: 176.58s
+Epoch 8 - Train Loss: 0.0245 - Valid Loss: 0.9112 - Elapsed Time: 963.31s
+- Epoch 8: Best model found with loss = 0.9112.
+Epoch 9 [0/559] | Train Loss: 0.0105 Grad: 24844.7188 LR: 5.2868e-06 | Elapse: 1.06s
+Epoch 9 [500/559] | Train Loss: 0.0205 Grad: 6883.3525 LR: 4.2491e-06 | Elapse: 642.26s
+Epoch 9 [558/559] | Train Loss: 0.0194 Grad: 20682.1309 LR: 4.1299e-06 | Elapse: 716.99s
+Epoch 9 [0/140] | Valid Loss: 0.0028 | Elapse: 1.45s
+Epoch 9 [139/140] | Valid Loss: 0.0783 | Elapse: 176.79s
+Epoch 9 - Train Loss: 0.0194 - Valid Loss: 0.9188 - Elapsed Time: 954.44s
+- Epoch 9: Best model found with loss = 0.9188.
+Epoch 10 [0/559] | Train Loss: 0.0091 Grad: 20860.1367 LR: 4.1279e-06 | Elapse: 1.11s
+Epoch 10 [500/559] | Train Loss: 0.0170 Grad: 6804.7153 LR: 3.1294e-06 | Elapse: 642.90s
+Epoch 10 [558/559] | Train Loss: 0.0162 Grad: 18611.3281 LR: 3.0180e-06 | Elapse: 714.56s
+Epoch 10 [0/140] | Valid Loss: 0.0028 | Elapse: 1.23s
+Epoch 10 [139/140] | Valid Loss: 0.0753 | Elapse: 178.87s
+Epoch 10 - Train Loss: 0.0162 - Valid Loss: 0.9246 - Elapsed Time: 953.05s
+- Epoch 10: Best model found with loss = 0.9246.
+Epoch 11 [0/559] | Train Loss: 0.0085 Grad: 19455.4121 LR: 3.0161e-06 | Elapse: 1.35s
+Epoch 11 [500/559] | Train Loss: 0.0149 Grad: 6900.8940 LR: 2.1105e-06 | Elapse: 646.55s
+Epoch 11 [558/559] | Train Loss: 0.0142 Grad: 17686.6504 LR: 2.0129e-06 | Elapse: 719.29s
+Epoch 11 [0/140] | Valid Loss: 0.0028 | Elapse: 1.56s
+Epoch 11 [139/140] | Valid Loss: 0.0728 | Elapse: 176.09s
+Epoch 11 - Train Loss: 0.0142 - Valid Loss: 0.9285 - Elapsed Time: 954.97s
+- Epoch 11: Best model found with loss = 0.9285.
+Epoch 12 [0/559] | Train Loss: 0.0082 Grad: 19114.8496 LR: 2.0112e-06 | Elapse: 0.99s
+Epoch 12 [500/559] | Train Loss: 0.0139 Grad: 6952.1978 LR: 1.2475e-06 | Elapse: 645.08s
+Epoch 12 [558/559] | Train Loss: 0.0133 Grad: 15867.8369 LR: 1.1688e-06 | Elapse: 719.55s
+Epoch 12 [0/140] | Valid Loss: 0.0029 | Elapse: 1.42s
+Epoch 12 [139/140] | Valid Loss: 0.0696 | Elapse: 179.57s
+Epoch 12 - Train Loss: 0.0133 - Valid Loss: 0.9321 - Elapsed Time: 959.11s
+- Epoch 12: Best model found with loss = 0.9321.
+Epoch 13 [0/559] | Train Loss: 0.0081 Grad: 19348.4922 LR: 1.1675e-06 | Elapse: 1.08s
+Epoch 13 [500/559] | Train Loss: 0.0140 Grad: 7006.5898 LR: 5.8671e-07 | Elapse: 652.07s
+Epoch 13 [558/559] | Train Loss: 0.0134 Grad: 14142.9746 LR: 5.3128e-07 | Elapse: 728.81s
+Epoch 13 [0/140] | Valid Loss: 0.0029 | Elapse: 1.15s
+Epoch 13 [139/140] | Valid Loss: 0.0682 | Elapse: 177.89s
+Epoch 13 - Train Loss: 0.0134 - Valid Loss: 0.9330 - Elapsed Time: 965.98s
+- Epoch 13: Best model found with loss = 0.9330.
+Epoch 14 [0/559] | Train Loss: 0.0109 Grad: 42109.3281 LR: 5.3035e-07 | Elapse: 1.28s
+Epoch 14 [500/559] | Train Loss: 0.0160 Grad: 7358.2085 LR: 1.6390e-07 | Elapse: 641.98s
+Epoch 14 [558/559] | Train Loss: 0.0152 Grad: 12558.0586 LR: 1.3469e-07 | Elapse: 713.12s
+Epoch 14 [0/140] | Valid Loss: 0.0029 | Elapse: 1.05s
+Epoch 14 [139/140] | Valid Loss: 0.0636 | Elapse: 173.62s
+Epoch 14 - Train Loss: 0.0152 - Valid Loss: 0.9368 - Elapsed Time: 946.93s
+- Epoch 14: Best model found with loss = 0.9368.
+Epoch 15 [0/559] | Train Loss: 0.0121 Grad: 59014.1406 LR: 1.3421e-07 | Elapse: 1.55s
+Epoch 15 [500/559] | Train Loss: 0.0176 Grad: 7590.2749 LR: 1.8075e-09 | Elapse: 643.34s
+Epoch 15 [558/559] | Train Loss: 0.0166 Grad: 13347.2998 LR: 4.0043e-10 | Elapse: 717.88s
+Epoch 15 [0/140] | Valid Loss: 0.0030 | Elapse: 1.55s
+Epoch 15 [139/140] | Valid Loss: 0.0606 | Elapse: 175.80s
+Epoch 15 - Train Loss: 0.0166 - Valid Loss: 0.9384 - Elapsed Time: 953.08s
+- Epoch 15: Best model found with loss = 0.9384.
+Fold 2 | Time: 240.75min | Overall Evaluation Loss: 0.9405
+Epoch 1 [0/559] | Train Loss: 0.3982 Grad: 125106.8906 LR: 4.0003e-07 | Elapse: 1.41s
+Epoch 1 [500/559] | Train Loss: 0.1755 Grad: 57749.5234 LR: 6.6576e-06 | Elapse: 643.70s
+Epoch 1 [558/559] | Train Loss: 0.1648 Grad: 31245.7852 LR: 7.6104e-06 | Elapse: 719.98s
+Epoch 1 [0/140] | Valid Loss: 0.3405 | Elapse: 1.41s
+Epoch 1 [139/140] | Valid Loss: 0.1585 | Elapse: 177.45s
+Epoch 1 - Train Loss: 0.1648 - Valid Loss: 0.5808 - Elapsed Time: 955.69s
+- Epoch 1: Best model found with loss = 0.5808.
+Epoch 2 [0/559] | Train Loss: 0.3776 Grad: 105642.1875 LR: 7.6259e-06 | Elapse: 1.21s
+Epoch 2 [500/559] | Train Loss: 0.1717 Grad: 66910.3984 LR: 9.9786e-06 | Elapse: 637.51s
+Epoch 2 [558/559] | Train Loss: 0.1607 Grad: 31724.7090 LR: 9.9660e-06 | Elapse: 709.85s
+Epoch 2 [0/140] | Valid Loss: 0.3099 | Elapse: 1.45s
+Epoch 2 [139/140] | Valid Loss: 0.1498 | Elapse: 175.69s
+Epoch 2 - Train Loss: 0.1607 - Valid Loss: 0.6966 - Elapsed Time: 943.63s
+- Epoch 2: Best model found with loss = 0.6966.
+Epoch 3 [0/559] | Train Loss: 0.3213 Grad: 121472.9141 LR: 9.9657e-06 | Elapse: 1.18s
+Epoch 3 [500/559] | Train Loss: 0.1440 Grad: 103090.0625 LR: 9.7377e-06 | Elapse: 644.68s
+Epoch 3 [558/559] | Train Loss: 0.1341 Grad: 36844.5195 LR: 9.6978e-06 | Elapse: 716.82s
+Epoch 3 [0/140] | Valid Loss: 0.2482 | Elapse: 0.88s
+Epoch 3 [139/140] | Valid Loss: 0.1333 | Elapse: 176.00s
+Epoch 3 - Train Loss: 0.1341 - Valid Loss: 0.7746 - Elapsed Time: 951.51s
+- Epoch 3: Best model found with loss = 0.7746.
+Epoch 4 [0/559] | Train Loss: 0.2317 Grad: 167371.5625 LR: 9.6970e-06 | Elapse: 1.19s
+Epoch 4 [500/559] | Train Loss: 0.1037 Grad: 111101.2422 LR: 9.2415e-06 | Elapse: 640.47s
+Epoch 4 [558/559] | Train Loss: 0.0964 Grad: 36731.4844 LR: 9.1763e-06 | Elapse: 712.91s
+Epoch 4 [0/140] | Valid Loss: 0.1839 | Elapse: 1.05s
+Epoch 4 [139/140] | Valid Loss: 0.1155 | Elapse: 180.00s
+Epoch 4 - Train Loss: 0.0964 - Valid Loss: 0.8242 - Elapsed Time: 952.45s
+- Epoch 4: Best model found with loss = 0.8242.
+Epoch 5 [0/559] | Train Loss: 0.1119 Grad: 162986.0000 LR: 9.1752e-06 | Elapse: 1.52s
+Epoch 5 [500/559] | Train Loss: 0.0713 Grad: 100894.1797 LR: 8.5166e-06 | Elapse: 656.92s
+Epoch 5 [558/559] | Train Loss: 0.0663 Grad: 34186.8906 LR: 8.4298e-06 | Elapse: 732.87s
+Epoch 5 [0/140] | Valid Loss: 0.1360 | Elapse: 1.45s
+Epoch 5 [139/140] | Valid Loss: 0.1025 | Elapse: 176.98s
+Epoch 5 - Train Loss: 0.0663 - Valid Loss: 0.8523 - Elapsed Time: 967.91s
+- Epoch 5: Best model found with loss = 0.8523.
+Epoch 6 [0/559] | Train Loss: 0.0425 Grad: 102910.8594 LR: 8.4282e-06 | Elapse: 1.61s
+Epoch 6 [500/559] | Train Loss: 0.0477 Grad: 59404.9648 LR: 7.6021e-06 | Elapse: 657.10s
+Epoch 6 [558/559] | Train Loss: 0.0446 Grad: 33187.6953 LR: 7.4983e-06 | Elapse: 731.94s
+Epoch 6 [0/140] | Valid Loss: 0.1006 | Elapse: 1.05s
+Epoch 6 [139/140] | Valid Loss: 0.0935 | Elapse: 177.79s
+Epoch 6 - Train Loss: 0.0446 - Valid Loss: 0.8722 - Elapsed Time: 968.10s
+- Epoch 6: Best model found with loss = 0.8722.
+Epoch 7 [0/559] | Train Loss: 0.0218 Grad: 57458.2891 LR: 7.4965e-06 | Elapse: 1.40s
+Epoch 7 [500/559] | Train Loss: 0.0329 Grad: 38623.2969 LR: 6.5474e-06 | Elapse: 646.70s
+Epoch 7 [558/559] | Train Loss: 0.0310 Grad: 30045.2578 LR: 6.4322e-06 | Elapse: 721.54s
+Epoch 7 [0/140] | Valid Loss: 0.0848 | Elapse: 1.25s
+Epoch 7 [139/140] | Valid Loss: 0.0860 | Elapse: 175.20s
+Epoch 7 - Train Loss: 0.0310 - Valid Loss: 0.8886 - Elapsed Time: 955.19s
+- Epoch 7: Best model found with loss = 0.8886.
+Epoch 8 [0/559] | Train Loss: 0.0142 Grad: 36089.4648 LR: 6.4302e-06 | Elapse: 1.21s
+Epoch 8 [500/559] | Train Loss: 0.0244 Grad: 29544.0957 LR: 5.4093e-06 | Elapse: 656.81s
+Epoch 8 [558/559] | Train Loss: 0.0231 Grad: 26089.1152 LR: 5.2888e-06 | Elapse: 731.55s
+Epoch 8 [0/140] | Valid Loss: 0.0702 | Elapse: 1.25s
+Epoch 8 [139/140] | Valid Loss: 0.0802 | Elapse: 175.81s
+Epoch 8 - Train Loss: 0.0231 - Valid Loss: 0.9009 - Elapsed Time: 965.36s
+- Epoch 8: Best model found with loss = 0.9009.
+Epoch 9 [0/559] | Train Loss: 0.0116 Grad: 26916.4824 LR: 5.2868e-06 | Elapse: 1.45s
+Epoch 9 [500/559] | Train Loss: 0.0194 Grad: 27676.7578 LR: 4.2491e-06 | Elapse: 650.75s
+Epoch 9 [558/559] | Train Loss: 0.0185 Grad: 22893.2988 LR: 4.1299e-06 | Elapse: 724.12s
+Epoch 9 [0/140] | Valid Loss: 0.0627 | Elapse: 1.13s
+Epoch 9 [139/140] | Valid Loss: 0.0771 | Elapse: 178.01s
+Epoch 9 - Train Loss: 0.0185 - Valid Loss: 0.9090 - Elapsed Time: 960.16s
+- Epoch 9: Best model found with loss = 0.9090.
+Epoch 10 [0/559] | Train Loss: 0.0107 Grad: 24621.1934 LR: 4.1279e-06 | Elapse: 1.29s
+Epoch 10 [500/559] | Train Loss: 0.0162 Grad: 25335.7344 LR: 3.1294e-06 | Elapse: 645.49s
+Epoch 10 [558/559] | Train Loss: 0.0155 Grad: 21706.3672 LR: 3.0180e-06 | Elapse: 716.23s
+Epoch 10 [0/140] | Valid Loss: 0.0593 | Elapse: 1.35s
+Epoch 10 [139/140] | Valid Loss: 0.0754 | Elapse: 179.70s
+Epoch 10 - Train Loss: 0.0155 - Valid Loss: 0.9146 - Elapsed Time: 954.55s
+- Epoch 10: Best model found with loss = 0.9146.
+Epoch 11 [0/559] | Train Loss: 0.0096 Grad: 22430.6914 LR: 3.0161e-06 | Elapse: 1.13s
+Epoch 11 [500/559] | Train Loss: 0.0143 Grad: 24016.1289 LR: 2.1105e-06 | Elapse: 644.93s
+Epoch 11 [558/559] | Train Loss: 0.0138 Grad: 21748.4395 LR: 2.0129e-06 | Elapse: 720.27s
+Epoch 11 [0/140] | Valid Loss: 0.0590 | Elapse: 1.15s
+Epoch 11 [139/140] | Valid Loss: 0.0751 | Elapse: 171.39s
+Epoch 11 - Train Loss: 0.0138 - Valid Loss: 0.9171 - Elapsed Time: 950.43s
+- Epoch 11: Best model found with loss = 0.9171.
+Epoch 12 [0/559] | Train Loss: 0.0088 Grad: 20412.5254 LR: 2.0112e-06 | Elapse: 1.40s
+Epoch 12 [500/559] | Train Loss: 0.0136 Grad: 32134.5352 LR: 1.2475e-06 | Elapse: 647.60s
+Epoch 12 [558/559] | Train Loss: 0.0131 Grad: 23307.2793 LR: 1.1688e-06 | Elapse: 719.54s
+Epoch 12 [0/140] | Valid Loss: 0.0584 | Elapse: 1.45s
+Epoch 12 [139/140] | Valid Loss: 0.0751 | Elapse: 180.09s
+Epoch 12 - Train Loss: 0.0131 - Valid Loss: 0.9179 - Elapsed Time: 957.95s
+- Epoch 12: Best model found with loss = 0.9179.
+Epoch 13 [0/559] | Train Loss: 0.0087 Grad: 23177.0508 LR: 1.1675e-06 | Elapse: 1.25s
+Epoch 13 [500/559] | Train Loss: 0.0142 Grad: 23201.0508 LR: 5.8671e-07 | Elapse: 653.55s
+Epoch 13 [558/559] | Train Loss: 0.0137 Grad: 30058.3652 LR: 5.3128e-07 | Elapse: 729.39s
+Epoch 13 [0/140] | Valid Loss: 0.0632 | Elapse: 1.25s
+Epoch 13 [139/140] | Valid Loss: 0.0799 | Elapse: 179.09s
+Epoch 13 - Train Loss: 0.0137 - Valid Loss: 0.9144 - Elapsed Time: 966.71s
+Epoch 14 [0/559] | Train Loss: 0.0112 Grad: 51606.1914 LR: 5.3035e-07 | Elapse: 1.54s
+Epoch 14 [500/559] | Train Loss: 0.0171 Grad: 24198.2812 LR: 1.6390e-07 | Elapse: 651.34s
+Epoch 14 [558/559] | Train Loss: 0.0161 Grad: 17722.1055 LR: 1.3469e-07 | Elapse: 727.78s
+Epoch 14 [0/140] | Valid Loss: 0.0579 | Elapse: 1.05s
+Epoch 14 [139/140] | Valid Loss: 0.0655 | Elapse: 182.60s
+Epoch 14 - Train Loss: 0.0161 - Valid Loss: 0.9277 - Elapsed Time: 969.78s
+- Epoch 14: Best model found with loss = 0.9277.
+Epoch 15 [0/559] | Train Loss: 0.0095 Grad: 25194.0781 LR: 1.3421e-07 | Elapse: 1.46s
+Epoch 15 [500/559] | Train Loss: 0.0181 Grad: 19076.9629 LR: 1.8075e-09 | Elapse: 647.35s
+Epoch 15 [558/559] | Train Loss: 0.0171 Grad: 14837.4453 LR: 4.0043e-10 | Elapse: 721.40s
+Epoch 15 [0/140] | Valid Loss: 0.0564 | Elapse: 1.45s
+Epoch 15 [139/140] | Valid Loss: 0.0629 | Elapse: 179.29s
+Epoch 15 - Train Loss: 0.0171 - Valid Loss: 0.9295 - Elapsed Time: 959.98s
+- Epoch 15: Best model found with loss = 0.9295.
+Fold 3 | Time: 241.13min | Overall Evaluation Loss: 0.9382
+Epoch 1 [0/559] | Train Loss: 0.3633 Grad: 124250.9141 LR: 4.0003e-07 | Elapse: 1.09s
+Epoch 1 [500/559] | Train Loss: 0.1642 Grad: 550.4676 LR: 6.6576e-06 | Elapse: 652.68s
+Epoch 1 [558/559] | Train Loss: 0.1646 Grad: 18192.2656 LR: 7.6104e-06 | Elapse: 729.42s
+Epoch 1 [0/140] | Valid Loss: 0.2690 | Elapse: 1.55s
+Epoch 1 [139/140] | Valid Loss: 0.1589 | Elapse: 178.19s
+Epoch 1 - Train Loss: 0.1646 - Valid Loss: 0.5713 - Elapsed Time: 967.22s
+- Epoch 1: Best model found with loss = 0.5713.
+Epoch 2 [0/559] | Train Loss: 0.3655 Grad: 99907.1562 LR: 7.6259e-06 | Elapse: 1.37s
+Epoch 2 [500/559] | Train Loss: 0.1607 Grad: 672.9160 LR: 9.9786e-06 | Elapse: 654.16s
+Epoch 2 [558/559] | Train Loss: 0.1598 Grad: 21048.8535 LR: 9.9660e-06 | Elapse: 728.21s
+Epoch 2 [0/140] | Valid Loss: 0.2438 | Elapse: 1.54s
+Epoch 2 [139/140] | Valid Loss: 0.1508 | Elapse: 185.69s
+Epoch 2 - Train Loss: 0.1598 - Valid Loss: 0.6758 - Elapsed Time: 973.26s
+- Epoch 2: Best model found with loss = 0.6758.
+Epoch 3 [0/559] | Train Loss: 0.3119 Grad: 131969.9375 LR: 9.9657e-06 | Elapse: 1.40s
+Epoch 3 [500/559] | Train Loss: 0.1382 Grad: 983.9833 LR: 9.7377e-06 | Elapse: 645.90s
+Epoch 3 [558/559] | Train Loss: 0.1360 Grad: 22967.9785 LR: 9.6978e-06 | Elapse: 720.34s
+Epoch 3 [0/140] | Valid Loss: 0.2111 | Elapse: 1.35s
+Epoch 3 [139/140] | Valid Loss: 0.1370 | Elapse: 180.99s
+Epoch 3 - Train Loss: 0.1360 - Valid Loss: 0.7520 - Elapsed Time: 960.87s
+- Epoch 3: Best model found with loss = 0.7520.
+Epoch 4 [0/559] | Train Loss: 0.1790 Grad: 156240.8906 LR: 9.6970e-06 | Elapse: 1.53s
+Epoch 4 [500/559] | Train Loss: 0.1014 Grad: 1266.3868 LR: 9.2415e-06 | Elapse: 642.03s
+Epoch 4 [558/559] | Train Loss: 0.0994 Grad: 23239.8164 LR: 9.1763e-06 | Elapse: 716.17s
+Epoch 4 [0/140] | Valid Loss: 0.1738 | Elapse: 1.24s
+Epoch 4 [139/140] | Valid Loss: 0.1241 | Elapse: 176.79s
+Epoch 4 - Train Loss: 0.0994 - Valid Loss: 0.7934 - Elapsed Time: 951.72s
+- Epoch 4: Best model found with loss = 0.7934.
+Epoch 5 [0/559] | Train Loss: 0.0794 Grad: 141872.0156 LR: 9.1752e-06 | Elapse: 1.50s
+Epoch 5 [500/559] | Train Loss: 0.0701 Grad: 1435.0442 LR: 8.5166e-06 | Elapse: 655.00s
+Epoch 5 [558/559] | Train Loss: 0.0688 Grad: 22167.5000 LR: 8.4298e-06 | Elapse: 729.74s
+Epoch 5 [0/140] | Valid Loss: 0.1549 | Elapse: 1.45s
+Epoch 5 [139/140] | Valid Loss: 0.1157 | Elapse: 177.20s
+Epoch 5 - Train Loss: 0.0688 - Valid Loss: 0.8173 - Elapsed Time: 965.22s
+- Epoch 5: Best model found with loss = 0.8173.
+Epoch 6 [0/559] | Train Loss: 0.0344 Grad: 87340.9609 LR: 8.4282e-06 | Elapse: 1.48s
+Epoch 6 [500/559] | Train Loss: 0.0480 Grad: 1550.3583 LR: 7.6021e-06 | Elapse: 650.57s
+Epoch 6 [558/559] | Train Loss: 0.0474 Grad: 20225.2676 LR: 7.4983e-06 | Elapse: 724.31s
+Epoch 6 [0/140] | Valid Loss: 0.1368 | Elapse: 1.45s
+Epoch 6 [139/140] | Valid Loss: 0.1052 | Elapse: 180.79s
+Epoch 6 - Train Loss: 0.0474 - Valid Loss: 0.8380 - Elapsed Time: 963.61s
+- Epoch 6: Best model found with loss = 0.8380.
+Epoch 7 [0/559] | Train Loss: 0.0166 Grad: 44716.8789 LR: 7.4965e-06 | Elapse: 1.76s
+Epoch 7 [500/559] | Train Loss: 0.0329 Grad: 1702.5387 LR: 6.5474e-06 | Elapse: 646.56s
+Epoch 7 [558/559] | Train Loss: 0.0328 Grad: 16368.6797 LR: 6.4322e-06 | Elapse: 720.99s
+Epoch 7 [0/140] | Valid Loss: 0.1277 | Elapse: 1.55s
+Epoch 7 [139/140] | Valid Loss: 0.0995 | Elapse: 179.20s
+Epoch 7 - Train Loss: 0.0328 - Valid Loss: 0.8543 - Elapsed Time: 959.19s
+- Epoch 7: Best model found with loss = 0.8543.
+Epoch 8 [0/559] | Train Loss: 0.0134 Grad: 37146.0703 LR: 6.4302e-06 | Elapse: 1.26s
+Epoch 8 [500/559] | Train Loss: 0.0241 Grad: 1791.6235 LR: 5.4093e-06 | Elapse: 647.76s
+Epoch 8 [558/559] | Train Loss: 0.0242 Grad: 13751.4150 LR: 5.2888e-06 | Elapse: 725.20s
+Epoch 8 [0/140] | Valid Loss: 0.1255 | Elapse: 0.96s
+Epoch 8 [139/140] | Valid Loss: 0.0937 | Elapse: 184.89s
+Epoch 8 - Train Loss: 0.0242 - Valid Loss: 0.8670 - Elapsed Time: 970.38s
+- Epoch 8: Best model found with loss = 0.8670.
+Epoch 9 [0/559] | Train Loss: 0.0105 Grad: 25991.3223 LR: 5.2868e-06 | Elapse: 1.18s
+Epoch 9 [500/559] | Train Loss: 0.0191 Grad: 1816.1155 LR: 4.2491e-06 | Elapse: 647.57s
+Epoch 9 [558/559] | Train Loss: 0.0193 Grad: 11664.7656 LR: 4.1299e-06 | Elapse: 723.21s
+Epoch 9 [0/140] | Valid Loss: 0.1225 | Elapse: 1.45s
+Epoch 9 [139/140] | Valid Loss: 0.0896 | Elapse: 176.91s
+Epoch 9 - Train Loss: 0.0193 - Valid Loss: 0.8769 - Elapsed Time: 959.24s
+- Epoch 9: Best model found with loss = 0.8769.
+Epoch 10 [0/559] | Train Loss: 0.0091 Grad: 20763.9258 LR: 4.1279e-06 | Elapse: 1.63s
+Epoch 10 [500/559] | Train Loss: 0.0160 Grad: 1870.6489 LR: 3.1294e-06 | Elapse: 650.43s
+Epoch 10 [558/559] | Train Loss: 0.0163 Grad: 9963.1377 LR: 3.0180e-06 | Elapse: 725.57s
+Epoch 10 [0/140] | Valid Loss: 0.1228 | Elapse: 1.55s
+Epoch 10 [139/140] | Valid Loss: 0.0863 | Elapse: 179.89s
+Epoch 10 - Train Loss: 0.0163 - Valid Loss: 0.8838 - Elapsed Time: 964.06s
+- Epoch 10: Best model found with loss = 0.8838.
+Epoch 11 [0/559] | Train Loss: 0.0087 Grad: 19777.8633 LR: 3.0161e-06 | Elapse: 1.57s
+Epoch 11 [500/559] | Train Loss: 0.0142 Grad: 1895.5302 LR: 2.1105e-06 | Elapse: 646.77s
+Epoch 11 [558/559] | Train Loss: 0.0145 Grad: 9178.5586 LR: 2.0129e-06 | Elapse: 720.21s
+Epoch 11 [0/140] | Valid Loss: 0.1234 | Elapse: 1.05s
+Epoch 11 [139/140] | Valid Loss: 0.0840 | Elapse: 177.70s
+Epoch 11 - Train Loss: 0.0145 - Valid Loss: 0.8882 - Elapsed Time: 956.95s
+- Epoch 11: Best model found with loss = 0.8882.
+Epoch 12 [0/559] | Train Loss: 0.0085 Grad: 21362.3984 LR: 2.0112e-06 | Elapse: 1.13s
+Epoch 12 [500/559] | Train Loss: 0.0133 Grad: 1930.3713 LR: 1.2475e-06 | Elapse: 643.53s
+Epoch 12 [558/559] | Train Loss: 0.0136 Grad: 10055.4883 LR: 1.1688e-06 | Elapse: 719.66s
+Epoch 12 [0/140] | Valid Loss: 0.1230 | Elapse: 1.16s
+Epoch 12 [139/140] | Valid Loss: 0.0822 | Elapse: 177.09s
+Epoch 12 - Train Loss: 0.0136 - Valid Loss: 0.8905 - Elapsed Time: 956.91s
+- Epoch 12: Best model found with loss = 0.8905.
+Epoch 13 [0/559] | Train Loss: 0.0089 Grad: 28545.0586 LR: 1.1675e-06 | Elapse: 1.31s
+Epoch 13 [500/559] | Train Loss: 0.0134 Grad: 2208.5732 LR: 5.8671e-07 | Elapse: 651.11s
+Epoch 13 [558/559] | Train Loss: 0.0137 Grad: 11693.8750 LR: 5.3128e-07 | Elapse: 723.84s
+Epoch 13 [0/140] | Valid Loss: 0.1226 | Elapse: 1.35s
+Epoch 13 [139/140] | Valid Loss: 0.0797 | Elapse: 178.20s
+Epoch 13 - Train Loss: 0.0137 - Valid Loss: 0.8916 - Elapsed Time: 961.21s
+- Epoch 13: Best model found with loss = 0.8916.
+Epoch 14 [0/559] | Train Loss: 0.0106 Grad: 44991.1055 LR: 5.3035e-07 | Elapse: 1.23s
+Epoch 14 [500/559] | Train Loss: 0.0151 Grad: 2720.3081 LR: 1.6390e-07 | Elapse: 647.89s
+Epoch 14 [558/559] | Train Loss: 0.0160 Grad: 8372.2275 LR: 1.3469e-07 | Elapse: 720.33s
+Epoch 14 [0/140] | Valid Loss: 0.1300 | Elapse: 1.35s
+Epoch 14 [139/140] | Valid Loss: 0.0720 | Elapse: 175.69s
+Epoch 14 - Train Loss: 0.0160 - Valid Loss: 0.9002 - Elapsed Time: 954.98s
+- Epoch 14: Best model found with loss = 0.9002.
+Epoch 15 [0/559] | Train Loss: 0.0121 Grad: 53557.4883 LR: 1.3421e-07 | Elapse: 1.72s
+Epoch 15 [500/559] | Train Loss: 0.0168 Grad: 2852.8547 LR: 1.8075e-09 | Elapse: 649.21s
+Epoch 15 [558/559] | Train Loss: 0.0171 Grad: 9246.8477 LR: 4.0043e-10 | Elapse: 725.75s
+Epoch 15 [0/140] | Valid Loss: 0.1239 | Elapse: 1.35s
+Epoch 15 [139/140] | Valid Loss: 0.0694 | Elapse: 177.70s
+Epoch 15 - Train Loss: 0.0171 - Valid Loss: 0.9015 - Elapsed Time: 962.32s
+- Epoch 15: Best model found with loss = 0.9015.
+Fold 4 | Time: 242.02min | Overall Evaluation Loss: 0.9291
+Epoch 1 [0/559] | Train Loss: 0.1902 Grad: 66413.2578 LR: 4.0003e-07 | Elapse: 1.13s
+Epoch 1 [500/559] | Train Loss: 0.1762 Grad: 2669.0898 LR: 6.6576e-06 | Elapse: 645.72s
+Epoch 1 [558/559] | Train Loss: 0.1660 Grad: 50164.2422 LR: 7.6104e-06 | Elapse: 721.57s
+Epoch 1 [0/140] | Valid Loss: 0.1869 | Elapse: 1.34s
+Epoch 1 [139/140] | Valid Loss: 0.1561 | Elapse: 181.44s
+Epoch 1 - Train Loss: 0.1660 - Valid Loss: 0.5658 - Elapsed Time: 961.36s
+- Epoch 1: Best model found with loss = 0.5658.
+Epoch 2 [0/559] | Train Loss: 0.1867 Grad: 57774.2891 LR: 7.6259e-06 | Elapse: 1.37s
+Epoch 2 [500/559] | Train Loss: 0.1714 Grad: 2945.2744 LR: 9.9786e-06 | Elapse: 657.97s
+Epoch 2 [558/559] | Train Loss: 0.1607 Grad: 50242.5000 LR: 9.9660e-06 | Elapse: 736.99s
+Epoch 2 [0/140] | Valid Loss: 0.1820 | Elapse: 1.36s
+Epoch 2 [139/140] | Valid Loss: 0.1447 | Elapse: 180.02s
+Epoch 2 - Train Loss: 0.1607 - Valid Loss: 0.7065 - Elapsed Time: 976.65s
+- Epoch 2: Best model found with loss = 0.7065.
+Epoch 3 [0/559] | Train Loss: 0.1736 Grad: 71577.5156 LR: 9.9657e-06 | Elapse: 1.61s
+Epoch 3 [500/559] | Train Loss: 0.1443 Grad: 4092.1748 LR: 9.7377e-06 | Elapse: 652.20s
+Epoch 3 [558/559] | Train Loss: 0.1345 Grad: 50957.5117 LR: 9.6978e-06 | Elapse: 727.83s
+Epoch 3 [0/140] | Valid Loss: 0.1715 | Elapse: 1.26s
+Epoch 3 [139/140] | Valid Loss: 0.1274 | Elapse: 179.61s
+Epoch 3 - Train Loss: 0.1345 - Valid Loss: 0.7868 - Elapsed Time: 965.51s
+- Epoch 3: Best model found with loss = 0.7868.
+Epoch 4 [0/559] | Train Loss: 0.1299 Grad: 89553.9766 LR: 9.6970e-06 | Elapse: 1.30s
+Epoch 4 [500/559] | Train Loss: 0.1024 Grad: 4908.1235 LR: 9.2415e-06 | Elapse: 646.79s
+Epoch 4 [558/559] | Train Loss: 0.0953 Grad: 51755.4883 LR: 9.1763e-06 | Elapse: 723.82s
+Epoch 4 [0/140] | Valid Loss: 0.1466 | Elapse: 1.17s
+Epoch 4 [139/140] | Valid Loss: 0.1127 | Elapse: 177.61s
+Epoch 4 - Train Loss: 0.0953 - Valid Loss: 0.8238 - Elapsed Time: 959.55s
+- Epoch 4: Best model found with loss = 0.8238.
+Epoch 5 [0/559] | Train Loss: 0.0821 Grad: 102318.5078 LR: 9.1752e-06 | Elapse: 1.54s
+Epoch 5 [500/559] | Train Loss: 0.0698 Grad: 5586.0479 LR: 8.5166e-06 | Elapse: 647.14s
+Epoch 5 [558/559] | Train Loss: 0.0650 Grad: 44889.3242 LR: 8.4298e-06 | Elapse: 721.04s
+Epoch 5 [0/140] | Valid Loss: 0.1277 | Elapse: 1.28s
+Epoch 5 [139/140] | Valid Loss: 0.1013 | Elapse: 178.04s
+Epoch 5 - Train Loss: 0.0650 - Valid Loss: 0.8493 - Elapsed Time: 958.05s
+- Epoch 5: Best model found with loss = 0.8493.
+Epoch 6 [0/559] | Train Loss: 0.0456 Grad: 94000.5000 LR: 8.4282e-06 | Elapse: 1.29s
+Epoch 6 [500/559] | Train Loss: 0.0469 Grad: 5821.9785 LR: 7.6021e-06 | Elapse: 650.70s
+Epoch 6 [558/559] | Train Loss: 0.0439 Grad: 36521.1172 LR: 7.4983e-06 | Elapse: 726.91s
+Epoch 6 [0/140] | Valid Loss: 0.1070 | Elapse: 0.91s
+Epoch 6 [139/140] | Valid Loss: 0.0911 | Elapse: 176.52s
+Epoch 6 - Train Loss: 0.0439 - Valid Loss: 0.8720 - Elapsed Time: 962.33s
+- Epoch 6: Best model found with loss = 0.8720.
+Epoch 7 [0/559] | Train Loss: 0.0244 Grad: 67486.2812 LR: 7.4965e-06 | Elapse: 1.45s
+Epoch 7 [500/559] | Train Loss: 0.0322 Grad: 6044.8472 LR: 6.5474e-06 | Elapse: 649.35s
+Epoch 7 [558/559] | Train Loss: 0.0303 Grad: 31346.2227 LR: 6.4322e-06 | Elapse: 723.66s
+Epoch 7 [0/140] | Valid Loss: 0.0936 | Elapse: 0.88s
+Epoch 7 [139/140] | Valid Loss: 0.0839 | Elapse: 176.47s
+Epoch 7 - Train Loss: 0.0303 - Valid Loss: 0.8888 - Elapsed Time: 958.02s
+- Epoch 7: Best model found with loss = 0.8888.
+Epoch 8 [0/559] | Train Loss: 0.0108 Grad: 29399.3164 LR: 6.4302e-06 | Elapse: 1.63s
+Epoch 8 [500/559] | Train Loss: 0.0237 Grad: 6178.5142 LR: 5.4093e-06 | Elapse: 660.03s
+Epoch 8 [558/559] | Train Loss: 0.0224 Grad: 27034.6348 LR: 5.2888e-06 | Elapse: 732.26s
+Epoch 8 [0/140] | Valid Loss: 0.0897 | Elapse: 0.90s
+Epoch 8 [139/140] | Valid Loss: 0.0791 | Elapse: 178.92s
+Epoch 8 - Train Loss: 0.0224 - Valid Loss: 0.9013 - Elapsed Time: 968.97s
+- Epoch 8: Best model found with loss = 0.9013.
+Epoch 9 [0/559] | Train Loss: 0.0083 Grad: 21065.5977 LR: 5.2868e-06 | Elapse: 1.36s
+Epoch 9 [500/559] | Train Loss: 0.0187 Grad: 6257.6196 LR: 4.2491e-06 | Elapse: 662.97s
+Epoch 9 [558/559] | Train Loss: 0.0177 Grad: 22987.4766 LR: 4.1299e-06 | Elapse: 734.99s
+Epoch 9 [0/140] | Valid Loss: 0.0882 | Elapse: 1.26s
+Epoch 9 [139/140] | Valid Loss: 0.0756 | Elapse: 172.32s
+Epoch 9 - Train Loss: 0.0177 - Valid Loss: 0.9107 - Elapsed Time: 965.28s
+- Epoch 9: Best model found with loss = 0.9107.
+Epoch 10 [0/559] | Train Loss: 0.0070 Grad: 16650.1582 LR: 4.1279e-06 | Elapse: 1.39s
+Epoch 10 [500/559] | Train Loss: 0.0156 Grad: 6256.2896 LR: 3.1294e-06 | Elapse: 654.08s
+Epoch 10 [558/559] | Train Loss: 0.0149 Grad: 19737.6699 LR: 3.0180e-06 | Elapse: 727.41s
+Epoch 10 [0/140] | Valid Loss: 0.0873 | Elapse: 1.47s
+Epoch 10 [139/140] | Valid Loss: 0.0728 | Elapse: 180.91s
+Epoch 10 - Train Loss: 0.0149 - Valid Loss: 0.9173 - Elapsed Time: 966.90s
+- Epoch 10: Best model found with loss = 0.9173.
+Epoch 11 [0/559] | Train Loss: 0.0062 Grad: 13547.4805 LR: 3.0161e-06 | Elapse: 1.28s
+Epoch 11 [500/559] | Train Loss: 0.0137 Grad: 6225.1914 LR: 2.1105e-06 | Elapse: 648.78s
+Epoch 11 [558/559] | Train Loss: 0.0131 Grad: 18167.6406 LR: 2.0129e-06 | Elapse: 722.64s
+Epoch 11 [0/140] | Valid Loss: 0.0885 | Elapse: 1.53s
+Epoch 11 [139/140] | Valid Loss: 0.0705 | Elapse: 177.18s
+Epoch 11 - Train Loss: 0.0131 - Valid Loss: 0.9215 - Elapsed Time: 957.63s
+- Epoch 11: Best model found with loss = 0.9215.
+Epoch 12 [0/559] | Train Loss: 0.0057 Grad: 11864.8066 LR: 2.0112e-06 | Elapse: 1.57s
+Epoch 12 [500/559] | Train Loss: 0.0127 Grad: 6288.3857 LR: 1.2475e-06 | Elapse: 651.31s
+Epoch 12 [558/559] | Train Loss: 0.0121 Grad: 18782.9395 LR: 1.1688e-06 | Elapse: 727.78s
+Epoch 12 [0/140] | Valid Loss: 0.0907 | Elapse: 1.06s
+Epoch 12 [139/140] | Valid Loss: 0.0689 | Elapse: 178.82s
+Epoch 12 - Train Loss: 0.0121 - Valid Loss: 0.9232 - Elapsed Time: 964.75s
+- Epoch 12: Best model found with loss = 0.9232.
+Epoch 13 [0/559] | Train Loss: 0.0055 Grad: 11599.3584 LR: 1.1675e-06 | Elapse: 1.30s
+Epoch 13 [500/559] | Train Loss: 0.0123 Grad: 6445.4780 LR: 5.8671e-07 | Elapse: 649.70s
+Epoch 13 [558/559] | Train Loss: 0.0118 Grad: 19700.5469 LR: 5.3128e-07 | Elapse: 723.02s
+Epoch 13 [0/140] | Valid Loss: 0.0884 | Elapse: 1.26s
+Epoch 13 [139/140] | Valid Loss: 0.0675 | Elapse: 176.02s
+Epoch 13 - Train Loss: 0.0118 - Valid Loss: 0.9250 - Elapsed Time: 956.68s
+- Epoch 13: Best model found with loss = 0.9250.
+Epoch 14 [0/559] | Train Loss: 0.0054 Grad: 12537.0361 LR: 5.3035e-07 | Elapse: 1.41s
+Epoch 14 [500/559] | Train Loss: 0.0135 Grad: 6409.6084 LR: 1.6390e-07 | Elapse: 649.01s
+Epoch 14 [558/559] | Train Loss: 0.0128 Grad: 13459.7871 LR: 1.3469e-07 | Elapse: 723.84s
+Epoch 14 [0/140] | Valid Loss: 0.0842 | Elapse: 1.16s
+Epoch 14 [139/140] | Valid Loss: 0.0630 | Elapse: 178.11s
+Epoch 14 - Train Loss: 0.0128 - Valid Loss: 0.9302 - Elapsed Time: 960.51s
+- Epoch 14: Best model found with loss = 0.9302.
+Epoch 15 [0/559] | Train Loss: 0.0060 Grad: 18633.8516 LR: 1.3421e-07 | Elapse: 1.50s
+Epoch 15 [500/559] | Train Loss: 0.0144 Grad: 6711.6953 LR: 1.8075e-09 | Elapse: 645.79s
+Epoch 15 [558/559] | Train Loss: 0.0136 Grad: 15909.6465 LR: 4.0043e-10 | Elapse: 722.12s
+Epoch 15 [0/140] | Valid Loss: 0.0799 | Elapse: 1.26s
+Epoch 15 [139/140] | Valid Loss: 0.0600 | Elapse: 178.51s
+Epoch 15 - Train Loss: 0.0136 - Valid Loss: 0.9312 - Elapsed Time: 958.84s
+- Epoch 15: Best model found with loss = 0.9312.
+Fold 0 | Time: 242.28min | Overall Evaluation Loss: 0.9283