1 benchmark · 38 results. Each benchmark shows the top of its default board (its first primary metric at its default version); ranks are the server's, ties share a rank, and "best" is the best visible result, not a state of the art.
PubMedQA accuracy bio-nlp/pubmedqa-accuracy
Accuracy (option log-likelihood) · ↑ higher is better · zero-shot · atlas-full-v1
| # | Model | Value [95% CI] | Source | Overlap |
|---|---|---|---|---|
| 1 | bio-nlp/biogpt-large | 0.622 [0.582, 0.660] best | reproduced | overlapTrain/test overlap declared by the evaluator: PubMed abstracts |
| 2 | bio-nlp/biomedlm | 0.508 [0.478, 0.538] | reproduced | overlapTrain/test overlap declared by the evaluator: PubMed abstracts |
2 on this board. Full leaderboard