logs/testing/pas-21.log

[02/29 16:25:37] d2.data.datasets.coco INFO: Loaded 1449 images with semantic segmentation from /share/home/chenxi/cx_xchen/datasets/pascal_voc_d2/images/validation
[02/29 16:25:37] d2.data.dataset_mapper INFO: [DatasetMapper] Augmentations used in inference: [ResizeShortestEdge(short_edge_length=(800, 800), max_size=1333, sample_style='choice')]
[02/29 16:25:37] d2.data.common INFO: Serializing the dataset using: <class 'detectron2.data.common._TorchSerializedList'>
[02/29 16:25:37] d2.data.common INFO: Serializing 1449 elements to byte tensors and concatenating them all ...
[02/29 16:25:37] d2.data.common INFO: Serialized dataset takes 0.37 MiB
[02/29 16:25:37] d2.data.datasets.coco INFO: Loaded 1449 images with semantic segmentation from /share/home/chenxi/cx_xchen/datasets/pascal_voc_d2/images/validation
[02/29 16:25:37] d2.evaluation.evaluator INFO: Start inference on 363 batches
[02/29 16:25:49] d2.evaluation.evaluator INFO: Inference done 11/363. Dataloading: 0.0018 s/iter. Inference: 0.2588 s/iter. Eval: 0.0061 s/iter. Total: 0.2667 s/iter. ETA=0:01:33
[02/29 16:25:54] d2.evaluation.evaluator INFO: Inference done 30/363. Dataloading: 0.0023 s/iter. Inference: 0.2581 s/iter. Eval: 0.0065 s/iter. Total: 0.2669 s/iter. ETA=0:01:28
[02/29 16:26:00] d2.evaluation.evaluator INFO: Inference done 49/363. Dataloading: 0.0024 s/iter. Inference: 0.2604 s/iter. Eval: 0.0064 s/iter. Total: 0.2692 s/iter. ETA=0:01:24
[02/29 16:26:05] d2.evaluation.evaluator INFO: Inference done 68/363. Dataloading: 0.0024 s/iter. Inference: 0.2590 s/iter. Eval: 0.0065 s/iter. Total: 0.2680 s/iter. ETA=0:01:19
[02/29 16:26:10] d2.evaluation.evaluator INFO: Inference done 87/363. Dataloading: 0.0025 s/iter. Inference: 0.2584 s/iter. Eval: 0.0065 s/iter. Total: 0.2674 s/iter. ETA=0:01:13
[02/29 16:26:15] d2.evaluation.evaluator INFO: Inference done 106/363. Dataloading: 0.0025 s/iter. Inference: 0.2585 s/iter. Eval: 0.0064 s/iter. Total: 0.2674 s/iter. ETA=0:01:08
[02/29 16:26:20] d2.evaluation.evaluator INFO: Inference done 125/363. Dataloading: 0.0025 s/iter. Inference: 0.2590 s/iter. Eval: 0.0064 s/iter. Total: 0.2679 s/iter. ETA=0:01:03
[02/29 16:26:25] d2.evaluation.evaluator INFO: Inference done 144/363. Dataloading: 0.0025 s/iter. Inference: 0.2589 s/iter. Eval: 0.0063 s/iter. Total: 0.2677 s/iter. ETA=0:00:58
[02/29 16:26:30] d2.evaluation.evaluator INFO: Inference done 163/363. Dataloading: 0.0024 s/iter. Inference: 0.2586 s/iter. Eval: 0.0063 s/iter. Total: 0.2674 s/iter. ETA=0:00:53
[02/29 16:26:35] d2.evaluation.evaluator INFO: Inference done 182/363. Dataloading: 0.0024 s/iter. Inference: 0.2589 s/iter. Eval: 0.0063 s/iter. Total: 0.2677 s/iter. ETA=0:00:48
[02/29 16:26:40] d2.evaluation.evaluator INFO: Inference done 201/363. Dataloading: 0.0024 s/iter. Inference: 0.2589 s/iter. Eval: 0.0063 s/iter. Total: 0.2677 s/iter. ETA=0:00:43
[02/29 16:26:45] d2.evaluation.evaluator INFO: Inference done 220/363. Dataloading: 0.0024 s/iter. Inference: 0.2586 s/iter. Eval: 0.0063 s/iter. Total: 0.2673 s/iter. ETA=0:00:38
[02/29 16:26:50] d2.evaluation.evaluator INFO: Inference done 239/363. Dataloading: 0.0024 s/iter. Inference: 0.2588 s/iter. Eval: 0.0063 s/iter. Total: 0.2675 s/iter. ETA=0:00:33
[02/29 16:26:55] d2.evaluation.evaluator INFO: Inference done 258/363. Dataloading: 0.0024 s/iter. Inference: 0.2588 s/iter. Eval: 0.0063 s/iter. Total: 0.2676 s/iter. ETA=0:00:28
[02/29 16:27:01] d2.evaluation.evaluator INFO: Inference done 277/363. Dataloading: 0.0024 s/iter. Inference: 0.2587 s/iter. Eval: 0.0063 s/iter. Total: 0.2675 s/iter. ETA=0:00:23
[02/29 16:27:06] d2.evaluation.evaluator INFO: Inference done 296/363. Dataloading: 0.0025 s/iter. Inference: 0.2587 s/iter. Eval: 0.0063 s/iter. Total: 0.2675 s/iter. ETA=0:00:17
[02/29 16:27:11] d2.evaluation.evaluator INFO: Inference done 315/363. Dataloading: 0.0025 s/iter. Inference: 0.2585 s/iter. Eval: 0.0063 s/iter. Total: 0.2673 s/iter. ETA=0:00:12
[02/29 16:27:16] d2.evaluation.evaluator INFO: Inference done 334/363. Dataloading: 0.0024 s/iter. Inference: 0.2585 s/iter. Eval: 0.0063 s/iter. Total: 0.2673 s/iter. ETA=0:00:07
[02/29 16:27:21] d2.evaluation.evaluator INFO: Inference done 353/363. Dataloading: 0.0025 s/iter. Inference: 0.2587 s/iter. Eval: 0.0063 s/iter. Total: 0.2675 s/iter. ETA=0:00:02
[02/29 16:27:24] d2.evaluation.evaluator INFO: Total inference time: 0:01:36.360220 (0.269163 s / iter per device, on 4 devices)
[02/29 16:27:24] d2.evaluation.evaluator INFO: Total inference pure compute time: 0:01:32 (0.258837 s / iter per device, on 4 devices)
[02/29 16:27:24] d2.evaluation.sem_seg_evaluation INFO: OrderedDict([('sem_seg', {'mIoU': 82.45621703612494, 'S_mIoU': 82.45621703612494, 'U_mIoU': nan, 'fwIoU': 92.1399667442887, 'IoU-background,crops,bush,shrub,tiles,pavement,rug,carpet,box,boxes,speaker,storage,painting,board,panel,poster,clock,cage,drinking glass,park,plaything,toy,fireplace,bag,bag,bed,bench,book,books,building,buildings,cabinet,drawer,ceiling,computer,computer case,cup,cups,door,fence,floor,flower,grass,lawn,turf,ground,soil,dirt,tiles,keyboard,lamp,mountain,hills,mouse,curtain,platform,sign,street,rock,stone,shelf,sidewalk,sky,clouds,snow,track,train track,tree,trees,wall,water,window,wood,woods': 94.27321523684472, 'BoundaryIoU-background,crops,bush,shrub,tiles,pavement,rug,carpet,box,boxes,speaker,storage,painting,board,panel,poster,clock,cage,drinking glass,park,plaything,toy,fireplace,bag,bag,bed,bench,book,books,building,buildings,cabinet,drawer,ceiling,computer,computer case,cup,cups,door,fence,floor,flower,grass,lawn,turf,ground,soil,dirt,tiles,keyboard,lamp,mountain,hills,mouse,curtain,platform,sign,street,rock,stone,shelf,sidewalk,sky,clouds,snow,track,train track,tree,trees,wall,water,window,wood,woods': 95.74589626879583, 'min(IoU, B-Iou)-background,crops,bush,shrub,tiles,pavement,rug,carpet,box,boxes,speaker,storage,painting,board,panel,poster,clock,cage,drinking glass,park,plaything,toy,fireplace,bag,bag,bed,bench,book,books,building,buildings,cabinet,drawer,ceiling,computer,computer case,cup,cups,door,fence,floor,flower,grass,lawn,turf,ground,soil,dirt,tiles,keyboard,lamp,mountain,hills,mouse,curtain,platform,sign,street,rock,stone,shelf,sidewalk,sky,clouds,snow,track,train track,tree,trees,wall,water,window,wood,woods': 94.27321523684472, 'IoU-aeroplane,airplane,aeroplanes,airplanes': 93.87708977887048, 'BoundaryIoU-aeroplane,airplane,aeroplanes,airplanes': 18.537865457505852, 'min(IoU, B-Iou)-aeroplane,airplane,aeroplanes,airplanes': 18.537865457505852, 'IoU-bicycle,bicycles,bike,bikes': 46.73084455338754, 'BoundaryIoU-bicycle,bicycles,bike,bikes': 26.290935317043846, 'min(IoU, B-Iou)-bicycle,bicycles,bike,bikes': 26.290935317043846, 'IoU-bird,birds': 93.07497326450613, 'BoundaryIoU-bird,birds': 22.418352235746084, 'min(IoU, B-Iou)-bird,birds': 22.418352235746084, 'IoU-boat,boats': 66.96656913175258, 'BoundaryIoU-boat,boats': 7.462592527604504, 'min(IoU, B-Iou)-boat,boats': 7.462592527604504, 'IoU-bottle,bottles,water bottle': 87.69939354522221, 'BoundaryIoU-bottle,bottles,water bottle': 16.0881228082698, 'min(IoU, B-Iou)-bottle,bottles,water bottle': 16.0881228082698, 'IoU-bus,buses': 94.75046518547467, 'BoundaryIoU-bus,buses': 23.027938310771304, 'min(IoU, B-Iou)-bus,buses': 23.027938310771304, 'IoU-car,cars': 84.58261003312651, 'BoundaryIoU-car,cars': 18.670227518783786, 'min(IoU, B-Iou)-car,cars': 18.670227518783786, 'IoU-cat,cats,kitties,kitty': 96.14447221210398, 'BoundaryIoU-cat,cats,kitties,kitty': 22.2089285627606, 'min(IoU, B-Iou)-cat,cats,kitties,kitty': 22.2089285627606, 'IoU-chair,chairs': 48.367881197990286, 'BoundaryIoU-chair,chairs': 29.285828407093785, 'min(IoU, B-Iou)-chair,chairs': 29.285828407093785, 'IoU-cow,cows,calf': 97.92728453931022, 'BoundaryIoU-cow,cows,calf': 63.628414011972225, 'min(IoU, B-Iou)-cow,cows,calf': 63.628414011972225, 'IoU-diningtable,dining table,diningtables,dining tables,plate,plates': 49.898978290294075, 'BoundaryIoU-diningtable,dining table,diningtables,dining tables,plate,plates': 22.905510238387112, 'min(IoU, B-Iou)-diningtable,dining table,diningtables,dining tables,plate,plates': 22.905510238387112, 'IoU-dog,dogs,puppy,puppies': 95.42461487491224, 'BoundaryIoU-dog,dogs,puppy,puppies': 0.0, 'min(IoU, B-Iou)-dog,dogs,puppy,puppies': 0.0, 'IoU-horse,horses,foal': 97.05525243473964, 'BoundaryIoU-horse,horses,foal': 0.0, 'min(IoU, B-Iou)-horse,horses,foal': 0.0, 'IoU-motorbike,motorcycle,motorbikes,motorcycles': 92.67409937300194, 'BoundaryIoU-motorbike,motorcycle,motorbikes,motorcycles': 0.0, 'min(IoU, B-Iou)-motorbike,motorcycle,motorbikes,motorcycles': 0.0, 'IoU-person,child,girl,boy,woman,man,people,childeren,girls,boys,women,men,lady,guy,ladies,guys,clothes': 92.14208654291382, 'BoundaryIoU-person,child,girl,boy,woman,man,people,childeren,girls,boys,women,men,lady,guy,ladies,guys,clothes': 0.0, 'min(IoU, B-Iou)-person,child,girl,boy,woman,man,people,childeren,girls,boys,women,men,lady,guy,ladies,guys,clothes': 0.0, 'IoU-pottedplant,pottedplants,plant pot,plant pots,planter,planters': 72.02537237432682, 'BoundaryIoU-pottedplant,pottedplants,plant pot,plant pots,planter,planters': 0.0, 'min(IoU, B-Iou)-pottedplant,pottedplants,plant pot,plant pots,planter,planters': 0.0, 'IoU-sheep': 95.78104282977688, 'BoundaryIoU-sheep': 0.0, 'min(IoU, B-Iou)-sheep': 0.0, 'IoU-sofa,sofas': 62.377625668514135, 'BoundaryIoU-sofa,sofas': 0.0, 'min(IoU, B-Iou)-sofa,sofas': 0.0, 'IoU-train,trains,locomotive,locomotives,freight train': 90.47780899973968, 'BoundaryIoU-train,trains,locomotive,locomotives,freight train': 0.0, 'min(IoU, B-Iou)-train,trains,locomotive,locomotives,freight train': 0.0, 'IoU-tvmonitor,monitor,tv': 79.32887769181526, 'BoundaryIoU-tvmonitor,monitor,tv': 0.0, 'min(IoU, B-Iou)-tvmonitor,monitor,tv': 0.0, 'mACC': 95.66049305865911, 'pACC': 95.34956096071745, 'Recall': 95.34956096071745, 'S_Recall': 95.34956096071745, 'U_Recall': nan, 'ACC-background,crops,bush,shrub,tiles,pavement,rug,carpet,box,boxes,speaker,storage,painting,board,panel,poster,clock,cage,drinking glass,park,plaything,toy,fireplace,bag,bag,bed,bench,book,books,building,buildings,cabinet,drawer,ceiling,computer,computer case,cup,cups,door,fence,floor,flower,grass,lawn,turf,ground,soil,dirt,tiles,keyboard,lamp,mountain,hills,mouse,curtain,platform,sign,street,rock,stone,shelf,sidewalk,sky,clouds,snow,track,train track,tree,trees,wall,water,window,wood,woods': 94.87431251537835, 'ACC-aeroplane,airplane,aeroplanes,airplanes': 99.31848885520577, 'ACC-bicycle,bicycles,bike,bikes': 97.75649976563568, 'ACC-bird,birds': 97.22996349711997, 'ACC-boat,boats': 97.52538273373507, 'ACC-bottle,bottles,water bottle': 98.79314821646841, 'ACC-bus,buses': 98.75972978777769, 'ACC-car,cars': 96.2578900411693, 'ACC-cat,cats,kitties,kitty': 99.42500818482802, 'ACC-chair,chairs': 82.33061030851961, 'ACC-cow,cows,calf': 98.97156709284344, 'ACC-diningtable,dining table,diningtables,dining tables,plate,plates': 83.05520551531548, 'ACC-dog,dogs,puppy,puppies': 97.94600695337607, 'ACC-horse,horses,foal': 99.089493807006, 'ACC-motorbike,motorcycle,motorbikes,motorcycles': 98.36827134155767, 'ACC-person,child,girl,boy,woman,man,people,childeren,girls,boys,women,men,lady,guy,ladies,guys,clothes': 98.68908506038983, 'ACC-pottedplant,pottedplants,plant pot,plant pots,planter,planters': 86.50282448350103, 'ACC-sheep': 99.15656261236907, 'ACC-sofa,sofas': 94.48157425411046, 'ACC-train,trains,locomotive,locomotives,freight train': 98.08331451478118, 'ACC-tvmonitor,monitor,tv': 92.25541469075279})])
[02/29 16:27:24] d2.engine.defaults INFO: Evaluation results for openvocab_pascal21_sem_seg_val in csv format:
[02/29 16:27:24] d2.evaluation.testing INFO: copypaste: Task: sem_seg
[02/29 16:27:24] d2.evaluation.testing INFO: copypaste: mIoU,S_mIoU,U_mIoU,fwIoU,mACC,pACC,Recall,S_Recall,U_Recall
[02/29 16:27:24] d2.evaluation.testing INFO: copypaste: 82.4562,82.4562,nan,92.1400,95.6605,95.3496,95.3496,95.3496,nan