Classification Analysis Results

Results file: idaho-camera-traps-2026-06-21-v5a.0.1-ensemble_output_modular_image-level.md-format.within_image_smoothing.seqsmoothing.trimmed.json

Ground truth file: idaho-camera-traps.json

Detection threshold: 0.2

Classification confidence threshold: 0.6

Analysis level: sequence

Total sequences: 1032276

Overall metrics

Accuracy0.9792
Macro F10.2852
Micro F10.9801
Micro Precision0.9798
Micro Recall0.9803

Column explanations

Predicted as this category: images where this category was among the predictions, and some other category was among the true labels. This category may also be a correct true label for the image; these entries do not necessarily represent errors. For example, if the ground truth for an image is “human,cattle” and the prediction is “human” or “human,cattle”, this image would be included in the "human" link in this column in the “cattle” row. This column is generally useful for understanding the distribution of multi-label or multi-prediction images, but it is not very useful for understanding model errors.

Mispredicted as this category: images where this category was among the predictions, and it was wrong (not present in the ground truth). This column is useful for understanding model errors, specifically false positives for this category.

This was predicted as: images with this true label that also received a prediction of some other category. Other predictions (including the correct one) may also be present. For example, if the ground truth for an image is “cattle”, and the prediction is “human,cattle”, this image would be included in the "human" link in this column in the “cattle” row. This column is generally useful for understanding the distribution of multi-label or multi-prediction images, but it is not very useful for understanding model errors.

Mispredicted as: images with this true label whose predictions did not include this label. This column is useful for understanding model errors, specifically false negatives for this category.

Per-category statistics

Click column headers to sort

CategoryN (GT)N (Pred)PrecisionRecallF1Predicted as this categoryMispredicted as this categoryThis was predicted asMispredicted as
animal026560.0000.0000.000empty (2028)
deer (379)
elk (201)
unknown (33)
lagomorph (9)
empty (2028)
deer (379)
elk (201)
unknown (33)
pronghorn (9)
badger200.0000.0000.000animal (1)
empty (1)
empty (1)
animal (1)
bat400.0000.0000.000deer (3)
coyote (1)
deer (3)
coyote (1)
bear5666530.8090.9410.870unknown (68)
other (16)
cattle (11)
elk (11)
empty (11)
unknown (68)
empty (11)
cattle (11)
other (8)
elk (7)
carnivorous mammal (5)
empty (5)
cattle (4)
unknown ungulate (4)
wolf (4)
carnivorous mammal (5)
empty (5)
wolf (4)
unknown ungulate (2)
cattle (2)
below-threshold017220.0000.0000.000empty (1532)
deer (96)
elk (52)
unknown (19)
lagomorph (10)
empty (1532)
deer (96)
elk (52)
unknown (19)
lagomorph (10)
bighorn sheep23110.4500.2900.353other (9)
unknown (2)
unknown (2)empty (12)
deer (2)
unknown ungulate (2)
below-threshold (1)
bovidae family (1)
empty (12)
unknown ungulate (1)
unknown (1)
below-threshold (1)
bird161520.0560.5000.101empty (103)
other (27)
unknown (19)
grouse (3)
crow (2)
empty (103)
unknown (19)
other (18)
grouse (3)
crow (2)
empty (3)
animal (2)
bear (2)
deer (1)
human (1)
empty (3)
animal (2)
deer (1)
bluebird400.0000.0000.000empty (2)
animal (1)
bird (1)
empty (2)
bird (1)
animal (1)
bobcat2562850.8180.9100.862unknown (17)
mountain lion (11)
deer (5)
empty (5)
elk (4)
unknown (17)
mountain lion (11)
empty (5)
deer (4)
wolf (4)
deer (8)
empty (7)
mountain lion (2)
unknown cervid (2)
coyote (1)
empty (7)
deer (2)
fox (1)
unknown ungulate (1)
coyote (1)
bovidae family0130.0000.0000.000elk (4)
deer (3)
empty (2)
pronghorn (2)
bighorn sheep (1)
elk (4)
deer (3)
pronghorn (2)
empty (2)
bighorn sheep (1)
canis species0170.0000.0000.000coyote (5)
wolf (4)
empty (3)
deer (2)
unknown canid (2)
coyote (5)
wolf (4)
empty (3)
deer (2)
unknown canid (2)
carnivorous mammal0270.0000.0000.000unknown (6)
bear (5)
empty (5)
moose (3)
deer (2)
unknown (6)
empty (5)
bear (5)
moose (3)
elk (2)
cattle105520130.5160.9560.670unknown (842)
elk (81)
empty (24)
other (22)
deer (8)
unknown (842)
elk (81)
empty (24)
deer (7)
bear (4)
deer (15)
bear (11)
unknown cervid (6)
elk (5)
human (5)
below-threshold (1)
unknown cervid (1)
empty (1)
unknown (1)
clark's nutcracker110.0000.0000.000empty (1)empty (1)corvidae family (1)corvidae family (1)
corvidae family030.0000.0000.000empty (2)
clark's nutcracker (1)
other (1)
empty (2)
other (1)
clark's nutcracker (1)
corvus species030.0000.0000.000deer (1)
empty (1)
other (1)
raven (1)
empty (1)
other (1)
raven (1)
deer (1)
coyote4725050.7880.8320.809wolf (39)
unknown (24)
unknown canid (11)
deer (8)
empty (7)
wolf (39)
unknown (24)
unknown canid (9)
empty (7)
fox (6)
empty (25)
wolf (22)
fox (7)
canis species (5)
unknown canid (4)
empty (25)
wolf (10)
fox (7)
canis species (5)
below-threshold (3)
crow200.0000.0000.000bird (2)bird (2)
deer25247245050.9620.9330.947empty (445)
elk (303)
unknown (63)
sun (44)
cattle (15)
empty (445)
elk (241)
unknown (63)
cattle (15)
mountain lion (12)
empty (782)
animal (379)
unknown (136)
elk (119)
below-threshold (96)
empty (782)
animal (379)
unknown (136)
below-threshold (96)
unknown cervid (71)
domestic dog0100.0000.0000.000unknown (7)
empty (2)
wolf (1)
unknown (7)
empty (2)
wolf (1)
elk12682120340.9520.8740.911empty (371)
deer (119)
unknown (39)
moose (22)
sun (6)
empty (371)
deer (84)
unknown (39)
moose (22)
cattle (5)
empty (680)
deer (303)
animal (201)
unknown cervid (94)
cattle (81)
empty (680)
animal (201)
deer (79)
unknown (77)
unknown cervid (54)
empty9854439776040.9960.9880.992unknown (1350)
lagomorph (1126)
deer (782)
elk (680)
sun (150)
unknown (1350)
lagomorph (1126)
deer (782)
elk (680)
sun (150)
unknown (6403)
animal (2028)
below-threshold (1532)
vehicle (522)
deer (445)
unknown (6403)
animal (2028)
below-threshold (1532)
vehicle (522)
deer (445)
ermine100.0000.0000.000weasel family (1)weasel family (1)
fisher1170.8570.5450.667empty (1)empty (1)weasel family (5)weasel family (5)
fox40530.5360.7140.612empty (8)
coyote (7)
elk (2)
other (2)
unknown (2)
empty (8)
coyote (7)
elk (2)
other (2)
unknown canid (2)
coyote (6)
empty (2)
animal (1)
deer (1)
mammal (1)
coyote (5)
empty (2)
mammal (1)
unknown (1)
animal (1)
grouse900.0000.0000.000bird (3)
phasianidae family (3)
deer (1)
empty (1)
turkey (1)
bird (3)
phasianidae family (3)
empty (1)
deer (1)
turkey (1)
hawk400.0000.0000.000animal (1)
bird (1)
empty (1)
human (1)
bird (1)
animal (1)
empty (1)
human (1)
horse020.0000.0000.000elk (1)
empty (1)
empty (1)
elk (1)
human04480.0000.0000.000empty (388)
elk (31)
deer (9)
unknown (6)
cattle (5)
empty (388)
elk (31)
deer (9)
unknown (6)
cattle (5)
hummingbird100.0000.0000.000bird (1)bird (1)
lagomorph187700.0000.0000.000empty (1126)
rabbit (702)
unknown (15)
below-threshold (10)
animal (9)
empty (1126)
rabbit (702)
unknown (15)
below-threshold (10)
animal (9)
long-tailed weasel100.0000.0000.000empty (1)empty (1)
magpie1270.0000.0000.000empty (26)
elk (1)
empty (26)
elk (1)
bird (1)bird (1)
mammal01220.0000.0000.000empty (42)
elk (34)
deer (18)
unknown (11)
other (4)
empty (42)
elk (34)
deer (18)
unknown (11)
other (4)
moose4135860.6680.8960.766unknown (173)
elk (11)
other (4)
cattle (2)
deer (2)
unknown (173)
elk (11)
cattle (2)
deer (1)
unknown ungulate (1)
elk (22)
deer (6)
carnivorous mammal (3)
bear (2)
human (2)
elk (7)
unknown cervid (2)
unknown ungulate (1)
empty (1)
mammal (1)
moth100.0000.0000.000empty (1)empty (1)
mountain lion2872900.9060.8440.874unknown (14)
other (5)
bobcat (2)
elk (2)
wolf (2)
unknown (14)
bobcat (2)
wolf (1)
other (1)
moose (1)
deer (12)
bobcat (11)
unknown cat (7)
unknown cervid (4)
animal (2)
bobcat (4)
unknown cat (4)
unknown cervid (2)
animal (2)
deer (2)
other32600.0000.0000.000rabbit (80)
empty (53)
bird (27)
skunk (26)
cattle (22)
rabbit (80)
empty (53)
bird (27)
skunk (26)
cattle (22)
owl220.3330.5000.400empty (1)
other (1)
empty (1)bird (1)bird (1)
passeriformes order010.0000.0000.000empty (1)empty (1)
phasianidae family050.0000.0000.000grouse (3)
other (3)
empty (2)
grouse (3)
other (3)
empty (2)
porcupine250.1670.5000.250unknown (2)
bobcat (1)
elk (1)
other (1)
unknown (2)
elk (1)
bobcat (1)
rabbit (1)rabbit (1)
pronghorn1541530.8770.8080.841empty (14)
elk (2)
bighorn sheep (1)
deer (1)
other (1)
empty (14)
elk (2)
bighorn sheep (1)
other (1)
deer (1)
animal (9)
deer (5)
unknown ungulate (5)
elk (4)
below-threshold (2)
animal (9)
unknown ungulate (4)
below-threshold (2)
empty (2)
deer (1)
rabbit8010550.0670.9270.125lagomorph (702)
empty (177)
unknown (84)
other (80)
deer (10)
lagomorph (702)
empty (177)
unknown (84)
deer (10)
other (5)
unknown (3)
below-threshold (2)
carnivorous mammal (1)
unknown (3)
below-threshold (2)
carnivorous mammal (1)
raccoon5150.2381.0000.385other (6)
elk (4)
deer (2)
empty (1)
mountain lion (1)
elk (4)
deer (2)
mountain lion (1)
empty (1)
unknown (1)
raven530.4000.4000.400other (2)
empty (1)
empty (1)bird (2)
corvus species (1)
bird (2)
corvus species (1)
red-breasted nuthatch100.0000.0000.000bird (1)bird (1)
rodent1160.0000.0000.000squirrel (9)
other (8)
empty (6)
lagomorph (1)
wolf (1)
squirrel (9)
other (8)
empty (6)
wolf (1)
lagomorph (1)
unknown (1)unknown (1)
skunk29320.4830.9660.644other (26)
unknown (3)
empty (1)
unknown (3)
empty (1)
mammal (1)mammal (1)
squirrel60300.3020.2100.248other (14)
empty (8)
deer (2)
unknown (2)
bear (1)
empty (8)
deer (2)
unknown (2)
other (1)
bear (1)
empty (33)
rodent (9)
unknown (2)
animal (1)
below-threshold (1)
empty (33)
rodent (9)
unknown (2)
animal (1)
rabbit (1)
sun20500.0000.0000.000empty (150)
deer (44)
elk (6)
bobcat (2)
animal (1)
empty (150)
deer (44)
elk (6)
bobcat (2)
animal (1)
tilted400.0000.0000.000empty (4)empty (4)
turkey1371430.8990.9710.934unknown (7)
other (4)
deer (2)
grouse (1)
lagomorph (1)
unknown (7)
deer (1)
lagomorph (1)
empty (2)
human (1)
wolf (1)
empty (2)
wolf (1)
unknown280166880.0070.0150.009empty (6403)
deer (136)
elk (77)
lagomorph (15)
other (8)
empty (6403)
deer (136)
elk (77)
lagomorph (15)
other (8)
empty (1350)
cattle (842)
moose (173)
rabbit (84)
bear (68)
empty (1350)
cattle (842)
moose (173)
rabbit (84)
bear (68)
unknown bird of prey400.0000.0000.000empty (2)
below-threshold (1)
bird (1)
unknown (1)
empty (2)
unknown (1)
below-threshold (1)
bird (1)
unknown canid18120.0000.0000.000coyote (4)
empty (3)
deer (2)
bear (1)
elk (1)
coyote (4)
empty (3)
deer (2)
mountain lion (1)
bear (1)
coyote (11)
wolf (6)
canis species (2)
fox (2)
empty (1)
coyote (11)
wolf (6)
fox (2)
canis species (2)
unknown cervid (1)
unknown cat1140.0000.0000.000mountain lion (7)
unknown (2)
cattle (1)
deer (1)
empty (1)
mountain lion (7)
unknown (2)
cattle (1)
wolf (1)
deer (1)
mountain lion (1)mountain lion (1)
unknown cervid122720.0000.0000.000elk (94)
deer (79)
empty (68)
unknown (7)
cattle (6)
elk (94)
deer (79)
empty (68)
unknown (7)
cattle (6)
deer (4)
elk (4)
empty (3)
unknown (1)
wolf (1)
deer (4)
elk (4)
empty (3)
unknown (1)
wolf (1)
unknown ungulate21360.0000.0000.000elk (55)
empty (43)
deer (19)
pronghorn (5)
bear (4)
elk (55)
empty (43)
deer (19)
pronghorn (5)
unknown (4)
deer (1)
moose (1)
deer (1)
moose (1)
varied thrush100.0000.0000.000bird (1)bird (1)
vehicle05250.0000.0000.000empty (522)
deer (2)
unknown (1)
empty (522)
deer (2)
unknown (1)
warbler100.0000.0000.000bird (1)bird (1)
weasel family080.0000.0000.000fisher (5)
other (2)
ermine (1)
squirrel (1)
unknown (1)
fisher (5)
other (2)
unknown (1)
squirrel (1)
ermine (1)
western tanager100.0000.0000.000bird (1)bird (1)
wolf6396760.8720.8790.875unknown (34)
coyote (22)
other (10)
unknown canid (6)
bear (4)
unknown (34)
coyote (16)
unknown canid (6)
deer (3)
bear (3)
coyote (39)
deer (12)
bobcat (4)
canis species (4)
animal (3)
coyote (9)
canis species (4)
animal (3)
bobcat (2)
empty (2)
woodpecker100.0000.0000.000bird (1)bird (1)

Confusion matrix

Rows = true categories, columns = predicted categories. On-diagonal elements indicate a category that was both in the ground truth and among the predictions. An image with multiple correct labels contributes to the diagonal for each correct category. The off-diagonal elements do not necessarily indicate errors; they correspond to the “predicted as this category” and “this was predicted as” columns in the table above.

 

animal

badger

bat

bear

below-threshold

bighorn sheep

bird

bluebird

bobcat

bovidae family

canis species

carnivorous mammal

cattle

clark's nutcracker

corvidae family

corvus species

coyote

crow

deer

domestic dog

elk

empty

ermine

fisher

fox

grouse

hawk

horse

human

hummingbird

lagomorph

long-tailed weasel

magpie

mammal

moose

moth

mountain lion

other

owl

passeriformes order

phasianidae family

porcupine

pronghorn

rabbit

raccoon

raven

red-breasted nuthatch

rodent

skunk

squirrel

sun

tilted

turkey

unknown

unknown bird of prey

unknown canid

unknown cat

unknown cervid

unknown ungulate

varied thrush

vehicle

warbler

weasel family

western tanager

wolf

woodpecker

animal
badger 1 1
bat 1 3
bear 1 543 1 5 4 2 5 1 2 1 1 1 2 4 4
below-threshold
bighorn sheep 1 9 1 2 1 12 1 1 1 2
bird 2 2 10 1 3 1 1
bluebird 1 1 2
bobcat 243 1 8 1 7 1 2 1 2 1
bovidae family
canis species
carnivorous mammal
cattle 11 1 1051 15 5 1 5 2 1 1 6
clark's nutcracker 1
corvidae family
corvus species
coyote 3 1 3 1 5 1 410 2 25 7 1 3 3 1 1 4 22
crow 2
deer 379 2 96 1 5 3 2 2 8 1 8 23688 119 782 1 9 18 2 1 10 2 2 2 136 2 1 79 19 2 4
domestic dog
elk 201 11 52 4 4 2 81 4 303 11499 680 2 1 31 1 34 11 2 1 2 3 4 77 1 94 55 3
empty 2028 11 1532 103 5 2 3 5 24 1 2 1 7 445 2 371 973406 1 8 1 388 26 42 1 1 1 1 2 14 177 1 1 6 1 8 6403 3 1 68 43 522 1
ermine 1
fisher 6 5
fox 1 6 1 2 30 1 1
grouse 3 1 1 3 1
hawk 1 1 1 1
horse
human
hummingbird 1
lagomorph 9 10 1 3 6 2 1126 3 2 702 1 1 15 1 2 2
long-tailed weasel 1
magpie 1
mammal
moose 2 1 1 3 1 6 22 1 2 1 397 1 1 1 2 1
moth 1
mountain lion 2 2 11 1 1 12 1 1 1 2 271 1 1 7 4 1 2
other 7 16 5 9 27 4 1 1 1 22 1 1 5 14 3 53 2 2 4 4 5 1 3 1 1 80 6 2 8 26 14 4 8 2 2 2 10
owl 1 1
passeriformes order
phasianidae family
porcupine 1 1
pronghorn 9 2 2 5 4 2 1 135 2 5
rabbit 2 1 76 3
raccoon 5
raven 2 1 2
red-breasted nuthatch 1
rodent 1
skunk 1 28
squirrel 1 1 33 1 1 9 13 2 1
sun 1 2 1 44 6 150 1
tilted 4
turkey 2 1 134 1
unknown 33 68 19 2 19 17 1 6 842 24 63 7 39 1350 2 6 11 173 14 2 84 1 3 2 7 44 2 7 4 1 1 34
unknown bird of prey 1 1 2 1
unknown canid 2 11 1 2 1 6
unknown cat 1
unknown cervid 4 4 3 1 1
unknown ungulate 1 1
varied thrush 1
vehicle
warbler 1
weasel family
western tanager 1
wolf 3 2 1 4 4 1 2 39 12 1 1 2 1 1 2 1 1 2 1 2 1 611
woodpecker 1