Atlas
Sign in

Benchmarks

45 benchmarks in 8 domains

Literature

2 benchmarks · zero-shot · 4 models
Protocol
Benchmarks: 2 of 2

Mean rank and coverage are recomputed over the benchmarks ticked here. None ticked means all.

Reset

4 models

 Ranked from 2 of 2 benchmarks (a third, at least 2)
# Model ↕ Mean rank ▲ Coverage ↕ BC5CDR chemical NER ↑ Chemical entity F1 (native NER head) ↕ PubMedQA accuracy ↑ Accuracy (option log-likelihood) ↕
Low coverage: below 2 of 2, or nothing to compare with. Listed, not ranked.
— bio-nlp/biogpt-large overlap 0.00 1/2 · 0.622 (1) *
— bio-nlp/biomedical-ner-all 0.00 1/2 0.541 (1) ·
— bio-nlp/bert-base-uncased-clinical-ner 1.00 1/2 0.430 (2) ·
— bio-nlp/biomedlm overlap 1.00 1/2 · 0.508 (2) *

Each cell is the model's value on that benchmark's board, with its rank there in brackets, as the benchmark's own leaderboard ranks it (its primary zero-shot metric, at its default version); hover for the 95% interval, n and source, click to open that board. A * marks a declared train/test overlap. Rows are ordered by mean normalised rank, (rank − 1) / (board size − 1) averaged over the benchmarks the model has a result on (a board of one entry does not count): ranks, never values, so no average mixes units. Filtering hides rows without re-ranking anyone.