Models / rna-ml / rinalmo-giga / benchmarks

rna-ml/rinalmo-giga

Visibility: PUBLIC
Model cardFilesBenchmarks

rna-secondary-structure-prediction rna-ml/rna-secondary-structure-prediction

RNA secondary structure (F1) rna-ml/rna-secondary-structure-f1

Drawn from: rna-secondary-structure-prediction

atlas-n100-v2

Metric Value 95% CI n Rank Best in catalogue Source Overlap Board
Base-pair F1 (2-D pair head) ↑ higher is better · probe 0.584 [0.527, 0.643] 100 2 / 4 0.585 reproduced
overlap

Train/test overlap declared by the evaluator: rna-ml/rnacentral

Board
Base-pair precision (2-D pair head) ↑ higher is better · probe · secondary 0.569 [0.513, 0.626] 100 — 0.591 reproduced
overlap

Train/test overlap declared by the evaluator: rna-ml/rnacentral

Board
Base-pair recall (2-D pair head) ↑ higher is better · probe · secondary 0.631 [0.567, 0.696] 100 — 0.633 reproduced
overlap

Train/test overlap declared by the evaluator: rna-ml/rnacentral

Board
Base-pair MCC (2-D pair head) ↑ higher is better · probe · secondary 0.590 [0.533, 0.649] 100 — 0.592 reproduced
overlap

Train/test overlap declared by the evaluator: rna-ml/rnacentral

Board

Other Benchmarks drawn from no hub dataset you can see

Protein abundance from coding sequence (E. coli) rna-ml/coding-sequence-protein-abundance

atlas-n100-v1

Metric Value 95% CI n Rank Best in catalogue Source Overlap Board
Spearman ρ (zero-shot pseudo-log-likelihood) ↑ higher is better · zero-shot 0.207 [−0.003, 0.404] 100 6 / 11 0.552 reproduced none declared Board
Spearman ρ (ridge probe) ↑ higher is better · probe 0.631 [0.482, 0.752] 100 3 / 11 0.688 reproduced none declared Board
RMSE (ridge probe) ↓ lower is better · log10 ppm · probe 1.007 [0.859, 1.157] 100 3 / 11 0.973 reproduced none declared Board
Pearson r (ridge probe) ↑ higher is better · probe · secondary 0.618 [0.466, 0.736] 100 — 0.665 reproduced none declared Board
R² (ridge probe) ↑ higher is better · probe · secondary 0.368 [0.171, 0.516] 100 — 0.411 reproduced none declared Board