Cell type annotation (macro F1) single-cell/cell-type-annotation-macro-f1
Drawn from: cellxgene-census
atlas-n100-v1
| Metric | Value | 95% CI | n | Rank | Best in catalogue | Source | Overlap | Board |
|---|---|---|---|---|---|---|---|---|
| Macro F1 (trained from scratch) ↑ higher is better · supervised | 0.714 best | [0.644, 0.785] | 100 | 1 / 1 | 0.714 | reproduced | unknown | Board |
| Accuracy (trained from scratch) ↑ higher is better · supervised · secondary | 0.730 best | [0.670, 0.800] | 100 | — | 0.730 | reproduced | unknown | Board |
Single-cell batch integration (scIB) single-cell/single-cell-batch-integration
Drawn from: cellxgene-census
atlas-n500-v1
| Metric | Value | 95% CI | n | Rank | Best in catalogue | Source | Overlap | Board |
|---|---|---|---|---|---|---|---|---|
| Cell-type ASW (trained from scratch) ↑ higher is better · supervised | 0.610 best | [0.604, 0.615] | 500 | 1 / 1 | 0.610 | reproduced | unknown | Board |
| Batch ASW (trained from scratch) ↑ higher is better · supervised | 0.798 best | [0.787, 0.809] | 500 | 1 / 1 | 0.798 | reproduced | unknown | Board |
| Graph connectivity (trained from scratch) ↑ higher is better · supervised | 0.996 best | [0.991, 1.000] | 500 | 1 / 1 | 0.996 | reproduced | unknown | Board |
| scIB bio conservation, unscaled (trained from scratch) ↑ higher is better · supervised | 0.725 best | [0.714, 0.740] | 500 | 1 / 1 | 0.725 | reproduced | unknown | Board |
| scIB batch correction, unscaled (trained from scratch) ↑ higher is better · supervised | 0.681 best | [0.662, 0.692] | 500 | 1 / 1 | 0.681 | reproduced | unknown | Board |
| scIB total, unscaled (trained from scratch) ↑ higher is better · supervised | 0.707 best | [0.697, 0.717] | 500 | 1 / 1 | 0.707 | reproduced | unknown | Board |
| NMI, k-means (trained from scratch) ↑ higher is better · supervised · secondary | 0.773 best | [0.759, 0.802] | 500 | — | 0.773 | reproduced | unknown | Board |
| ARI, k-means (trained from scratch) ↑ higher is better · supervised · secondary | 0.611 best | [0.583, 0.648] | 500 | — | 0.611 | reproduced | unknown | Board |
| Isolated-label ASW (trained from scratch) ↑ higher is better · supervised · secondary | 0.691 best | [0.681, 0.699] | 500 | — | 0.691 | reproduced | unknown | Board |
| cLISI (trained from scratch) ↑ higher is better · supervised · secondary | 0.942 best | [0.931, 0.950] | 500 | — | 0.942 | reproduced | unknown | Board |
| iLISI (trained from scratch) ↑ higher is better · supervised · secondary | 0.319 best | [0.293, 0.344] | 500 | — | 0.319 | reproduced | unknown | Board |
| kBET acceptance (trained from scratch) ↑ higher is better · supervised · secondary | 0.761 best | [0.727, 0.794] | 500 | — | 0.761 | reproduced | unknown | Board |
| scIB batch correction, unscaled, without PCR (trained from scratch) ↑ higher is better · supervised · secondary | 0.719 best | [0.706, 0.730] | 500 | — | 0.719 | reproduced | unknown | Board |
| scIB total, unscaled, without PCR (trained from scratch) ↑ higher is better · supervised · secondary | 0.723 best | [0.714, 0.734] | 500 | — | 0.723 | reproduced | unknown | Board |
| PCR comparison (trained from scratch) ↑ higher is better · supervised · secondary | 0.529 best | [0.454, 0.574] | 500 | — | 0.529 | reproduced | unknown | Board |