Atlas
Sign in
Models / medical-imaging / vit-chest-xray / benchmarks

medical-imaging/vit-chest-xray

Visibility: PUBLIC
Model cardFilesBenchmarks
Group by

Chest X-ray findings (NIH ChestX-ray14) medical-imaging/chest-xray-findings-classification

Drawn from: NIH-Chest-Xray-14

atlas-full-v2

Metric Value 95% CI n Rank Best in catalogue Source Overlap Board
Mean ROC-AUC, 5 findings (logistic probe) ↑ higher is better · probe
By finding: 5 levels
findingValue [95% CI]n
Atelectasis0.564 [0.511, 0.616]1013
Cardiomegaly0.644 [0.554, 0.731]1013
Consolidation0.536 [0.472, 0.598]1013
Edema0.774 [0.682, 0.853]1013
Pleural Effusion0.701 [0.662, 0.742]1013

levels share items; n is per level

 0.644 [0.612, 0.676] 1013 4 / 5 0.689 reproduced none declared Board
Mean average precision, 5 findings (logistic probe) ↑ higher is better · probe · secondary
By finding: 5 levels
findingValue [95% CI]n
Atelectasis0.169 [0.137, 0.221]1013
Cardiomegaly0.055 [0.035, 0.104]1013
Consolidation0.095 [0.070, 0.149]1013
Edema0.126 [0.064, 0.257]1013
Pleural Effusion0.318 [0.268, 0.380]1013

levels share items; n is per level

 0.152 [0.137, 0.190] 1013 — 0.203 reproduced none declared Board

Pediatric pneumonia detection (chest X-ray) medical-imaging/pediatric-pneumonia-detection

Drawn from: chest-xray-pneumonia

atlas-full-v1

Metric Value 95% CI n Rank Best in catalogue Source Overlap Board
ROC-AUC (zero-shot) ↑ higher is better · zero-shot 0.717 [0.679, 0.754] 624 2 / 2 0.909 reproduced none declared Board
ROC-AUC (logistic probe) ↑ higher is better · probe 0.954 [0.937, 0.968] 624 5 / 5 0.992 reproduced none declared Board
Accuracy (zero-shot) ↑ higher is better · zero-shot · secondary 0.375 [0.375, 0.375] 624 — 0.619 reproduced none declared Board
Sensitivity, pneumonia (zero-shot) ↑ higher is better · zero-shot · secondary 0.000 [0.000, 0.000] 624 — 0.390 reproduced none declared Board
Specificity, pneumonia (zero-shot) ↑ higher is better · zero-shot · secondary 1.000 best [1.000, 1.000] 624 — 1.000 reproduced none declared Board
Average precision (zero-shot) ↑ higher is better · zero-shot · secondary 0.834 [0.808, 0.858] 624 — 0.953 reproduced none declared Board
Accuracy (logistic probe) ↑ higher is better · probe · secondary 0.861 [0.835, 0.883] 624 — 0.962 reproduced none declared Board
Sensitivity, pneumonia (logistic probe) ↑ higher is better · probe · secondary 0.977 [0.962, 0.990] 624 — 0.997 reproduced none declared Board
Specificity, pneumonia (logistic probe) ↑ higher is better · probe · secondary 0.667 [0.603, 0.722] 624 — 0.902 reproduced none declared Board
Average precision (logistic probe) ↑ higher is better · probe · secondary 0.970 [0.957, 0.980] 624 — 0.994 reproduced none declared Board