single-cell/cellxgene-census

Visibility: PUBLIC
Dataset cardFilesBenchmarks

2 benchmarks · 98 results. Each benchmark shows the top of its default board (its first primary metric at its default version); ranks are the server's, ties share a rank, and "best" is the best visible result, not a state of the art.

Cell type annotation (macro F1) single-cell/cell-type-annotation-macro-f1

Macro F1 (zero-shot) · ↑ higher is better · zero-shot · atlas-n100-v1

# Model Value [95% CI] Source Overlap
1 single-cell/scgpt 0.688 [0.623, 0.751] best reproduced
overlap

Train/test overlap declared by the evaluator: single-cell/cellxgene-census

2 single-cell/uce 0.688 [0.612, 0.762] reproduced
overlap

Train/test overlap declared by the evaluator: single-cell/cellxgene-census

3 single-cell/geneformer 0.562 [0.499, 0.618] reproduced unknown

3 on this board. Full leaderboard

Single-cell batch integration (scIB) single-cell/single-cell-batch-integration

Cell-type ASW (zero-shot) · ↑ higher is better · zero-shot · atlas-n500-v1

# Model Value [95% CI] Source Overlap
1 single-cell/scimilarity 0.624 [0.618, 0.631] best reproduced
overlap

Train/test overlap declared by the evaluator: single-cell/cellxgene-census

2 single-cell/uce 0.557 [0.554, 0.561] reproduced
overlap

Train/test overlap declared by the evaluator: single-cell/cellxgene-census

3 single-cell/scgpt 0.553 [0.548, 0.557] reproduced
overlap

Train/test overlap declared by the evaluator: single-cell/cellxgene-census

4 single-cell/geneformer 0.549 [0.544, 0.553] reproduced unknown

4 on this board. Full leaderboard