Classification Analysis Results

Results file: val-results.json

Ground truth file: val-gt.json

Detection threshold: 0.2

Classification confidence threshold: 0.5

Analysis level: sequence

Total sequences: 2487

Ground truth collapsed: single label per sequence

Predictions collapsed: single label per sequence

Overall metrics

Accuracy0.9260
Macro F10.8690
Micro F10.9260
Micro Precision0.9260
Micro Recall0.9260

Column explanations

Predicted as this category: images where this category was among the predictions, and some other category was among the true labels. This category may also be a correct true label for the image; these entries do not necessarily represent errors. For example, if the ground truth for an image is “human,cattle” and the prediction is “human” or “human,cattle”, this image would be included in the "human" link in this column in the “cattle” row. This column is generally useful for understanding the distribution of multi-label or multi-prediction images, but it is not very useful for understanding model errors.

Mispredicted as this category: images where this category was among the predictions, and it was wrong (not present in the ground truth). This column is useful for understanding model errors, specifically false positives for this category.

This was predicted as: images with this true label that also received a prediction of some other category. Other predictions (including the correct one) may also be present. For example, if the ground truth for an image is “cattle”, and the prediction is “human,cattle”, this image would be included in the "human" link in this column in the “cattle” row. This column is generally useful for understanding the distribution of multi-label or multi-prediction images, but it is not very useful for understanding model errors.

Mispredicted as: images with this true label whose predictions did not include this label. This column is useful for understanding model errors, specifically false negatives for this category.

Per-category statistics

Click column headers to sort

CategoryN (GT)N (Pred)PrecisionRecallF1Predicted as this categoryMispredicted as this categoryThis was predicted asMispredicted as
agouti5555330.9740.9350.954collared_peccary (6)
unknown (4)
armadillo (3)
other_bird (1)
collared_peccary (6)
unknown (4)
armadillo (3)
other_bird (1)
unknown (12)
collared_peccary (10)
white-lipped_peccary (6)
other_bird (5)
armadillo (2)
unknown (12)
collared_peccary (10)
white-lipped_peccary (6)
other_bird (5)
armadillo (2)
amazonian_motmot16190.7370.8750.800other_bird (4)
unknown (1)
other_bird (4)
unknown (1)
spixs_guan (1)
unknown (1)
spixs_guan (1)
unknown (1)
armadillo2122020.9550.9100.932unknown (3)
agouti (2)
rodent (2)
spotted_paca (1)
unknown_possum (1)
unknown (3)
rodent (2)
agouti (2)
unknown_possum (1)
spotted_paca (1)
unknown (8)
agouti (3)
rodent (3)
south_american_coati (2)
collared_peccary (1)
unknown (8)
agouti (3)
rodent (3)
south_american_coati (2)
other_bird (1)
cattle43390.9740.8840.927white-lipped_peccary (1)white-lipped_peccary (1)unknown (3)
salvins_curassow (1)
south_american_coati (1)
unknown (3)
south_american_coati (1)
salvins_curassow (1)
collared_peccary5065160.9280.9470.937white-lipped_peccary (17)
agouti (10)
giant_anteater (4)
unknown (3)
armadillo (1)
white-lipped_peccary (17)
agouti (10)
giant_anteater (4)
unknown (3)
armadillo (1)
white-lipped_peccary (14)
unknown (7)
agouti (6)
white-lipped_peccary (14)
unknown (7)
agouti (6)
deer38371.0000.9740.987unknown (1)unknown (1)
giant_anteater18131.0000.7220.839collared_peccary (4)
southern_tamandua (1)
collared_peccary (4)
southern_tamandua (1)
lowland_tapir26290.8971.0000.945unknown (2)
puma (1)
unknown (2)
puma (1)
northern_amazon_red_squirrel14150.7330.7860.759other_bird (1)
other_mammal (1)
salvins_curassow (1)
southern_tamandua (1)
other_bird (1)
southern_tamandua (1)
other_mammal (1)
salvins_curassow (1)
unknown (2)
south_american_coati (1)
unknown (2)
south_american_coati (1)
other_bird3293260.9660.9570.962agouti (5)
unknown (5)
armadillo (1)
unknown (5)
agouti (5)
armadillo (1)
unknown (6)
amazonian_motmot (4)
agouti (1)
northern_amazon_red_squirrel (1)
rodent (1)
unknown (6)
amazonian_motmot (4)
rodent (1)
northern_amazon_red_squirrel (1)
agouti (1)
other_mammal411.0000.2500.400northern_amazon_red_squirrel (1)
primate (1)
unknown (1)
unknown (1)
primate (1)
northern_amazon_red_squirrel (1)
primate13130.9230.9230.923other_mammal (1)other_mammal (1)unknown (1)unknown (1)
puma431.0000.7500.857lowland_tapir (1)lowland_tapir (1)
rodent1911900.9680.9630.966armadillo (3)
other_bird (1)
unknown (1)
unknown_possum (1)
armadillo (3)
other_bird (1)
unknown (1)
unknown_possum (1)
unknown (4)
armadillo (2)
unknown_possum (1)
unknown (4)
armadillo (2)
unknown_possum (1)
salvins_curassow26260.9230.9230.923cattle (1)
spixs_guan (1)
spixs_guan (1)
cattle (1)
northern_amazon_red_squirrel (1)
spixs_guan (1)
spixs_guan (1)
northern_amazon_red_squirrel (1)
small_cat10101.0001.0001.000
south_american_coati61660.8790.9510.913armadillo (2)
southern_tamandua (2)
cattle (1)
northern_amazon_red_squirrel (1)
unknown (1)
armadillo (2)
southern_tamandua (2)
northern_amazon_red_squirrel (1)
white-lipped_peccary (1)
cattle (1)
unknown (2)
white-lipped_peccary (1)
unknown (2)
white-lipped_peccary (1)
southern_tamandua41390.9490.9020.925giant_anteater (1)
spotted_paca (1)
giant_anteater (1)
spotted_paca (1)
south_american_coati (2)
northern_amazon_red_squirrel (1)
spotted_paca (1)
south_american_coati (2)
northern_amazon_red_squirrel (1)
spotted_paca (1)
spixs_guan34350.9140.9410.928amazonian_motmot (1)
other_bird (1)
salvins_curassow (1)
salvins_curassow (1)
amazonian_motmot (1)
other_bird (1)
collared_peccary (1)
salvins_curassow (1)
salvins_curassow (1)
collared_peccary (1)
spotted_paca1901870.9840.9680.976armadillo (1)
southern_tamandua (1)
unknown (1)
armadillo (1)
southern_tamandua (1)
unknown (1)
unknown (3)
armadillo (1)
collared_peccary (1)
southern_tamandua (1)
unknown (3)
collared_peccary (1)
southern_tamandua (1)
armadillo (1)
tayra9100.9001.0000.947agouti (1)agouti (1)
unknown35660.2120.4000.277agouti (12)
armadillo (8)
collared_peccary (7)
other_bird (6)
rodent (4)
agouti (12)
armadillo (8)
collared_peccary (7)
other_bird (6)
rodent (4)
other_bird (5)
agouti (4)
armadillo (3)
collared_peccary (3)
lowland_tapir (2)
other_bird (5)
agouti (4)
armadillo (3)
collared_peccary (3)
lowland_tapir (2)
unknown_possum28270.9630.9290.945rodent (1)rodent (1)armadillo (1)
rodent (1)
armadillo (1)
rodent (1)
unknown_reptile16161.0001.0001.000
white-lipped_peccary68690.6960.7060.701collared_peccary (14)
agouti (6)
south_american_coati (1)
collared_peccary (14)
agouti (6)
south_american_coati (1)
collared_peccary (17)
cattle (1)
south_american_coati (1)
unknown (1)
collared_peccary (17)
cattle (1)
unknown (1)
south_american_coati (1)

Confusion matrix

Rows = true categories, columns = predicted categories. On-diagonal elements indicate a category that was both in the ground truth and among the predictions. An image with multiple correct labels contributes to the diagonal for each correct category. The off-diagonal elements do not necessarily indicate errors; they correspond to the “predicted as this category” and “this was predicted as” columns in the table above.

 

agouti

amazonian_motmot

armadillo

cattle

collared_peccary

deer

giant_anteater

lowland_tapir

northern_amazon_red_squirrel

other_bird

other_mammal

primate

puma

rodent

salvins_curassow

small_cat

south_american_coati

southern_tamandua

spixs_guan

spotted_paca

tayra

unknown

unknown_possum

unknown_reptile

white-lipped_peccary

agouti 519 2 10 5 1 12 6
amazonian_motmot 14 1 1
armadillo 3 193 1 1 3 2 1 8
cattle 38 1 1 3
collared_peccary 6 479 7 14
deer 37 1
giant_anteater 4 13 1
lowland_tapir 26
northern_amazon_red_squirrel 11 1 2
other_bird 1 4 1 315 1 1 6
other_mammal 1 1 1 1
primate 12 1
puma 1 3
rodent 2 184 4 1
salvins_curassow 1 24 1
small_cat 10
south_american_coati 58 2 1
southern_tamandua 1 2 37 1
spixs_guan 1 1 32
spotted_paca 1 1 1 184 3
tayra 9
unknown 4 1 3 3 2 5 1 1 1 14
unknown_possum 1 1 26
unknown_reptile 16
white-lipped_peccary 1 17 1 1 48