Models / rna-ml / rinalmo-mega / benchmarks

rna-ml/rinalmo-mega

Visibility: PUBLIC
Model cardFilesBenchmarks

Protein abundance from coding sequence (E. coli) rna-ml/coding-sequence-protein-abundance

atlas-n100-v1

Metric Value 95% CI n Rank Best in catalogue Source Overlap Board
Spearman ρ (zero-shot pseudo-log-likelihood) ↑ higher is better · zero-shot 0.188 [−0.028, 0.381] 100 7 / 11 0.552 reproduced none declared Board
Spearman ρ (ridge probe) ↑ higher is better · probe 0.585 [0.416, 0.716] 100 5 / 11 0.688 reproduced none declared Board
RMSE (ridge probe) ↓ lower is better · log10 ppm · probe 1.050 [0.907, 1.193] 100 4 / 11 0.973 reproduced none declared Board
Pearson r (ridge probe) ↑ higher is better · probe · secondary 0.577 [0.420, 0.706] 100 — 0.665 reproduced none declared Board
R² (ridge probe) ↑ higher is better · probe · secondary 0.313 [0.117, 0.452] 100 — 0.411 reproduced none declared Board

RNA secondary structure (F1) rna-ml/rna-secondary-structure-f1

Drawn from: rna-secondary-structure-prediction

atlas-n100-v2

Metric Value 95% CI n Rank Best in catalogue Source Overlap Board
Base-pair F1 (2-D pair head) ↑ higher is better · probe 0.585 best [0.530, 0.641] 100 1 / 4 0.585 reproduced
overlap

Train/test overlap declared by the evaluator: rna-ml/rnacentral

Board
Base-pair precision (2-D pair head) ↑ higher is better · probe · secondary 0.591 best [0.536, 0.646] 100 — 0.591 reproduced
overlap

Train/test overlap declared by the evaluator: rna-ml/rnacentral

Board
Base-pair recall (2-D pair head) ↑ higher is better · probe · secondary 0.617 [0.555, 0.679] 100 — 0.633 reproduced
overlap

Train/test overlap declared by the evaluator: rna-ml/rnacentral

Board
Base-pair MCC (2-D pair head) ↑ higher is better · probe · secondary 0.592 best [0.536, 0.648] 100 — 0.592 reproduced
overlap

Train/test overlap declared by the evaluator: rna-ml/rnacentral

Board