Models / rna-ml / rinalmo-micro / benchmarks

rna-ml/rinalmo-micro

Visibility: PUBLIC
Model cardFilesBenchmarks

rna-secondary-structure-prediction rna-ml/rna-secondary-structure-prediction

RNA secondary structure (F1) rna-ml/rna-secondary-structure-f1

Drawn from: rna-secondary-structure-prediction

atlas-n100-v2

Metric Value 95% CI n Rank Best in catalogue Source Overlap Board
Base-pair F1 (2-D pair head) ↑ higher is better · probe 0.545 [0.488, 0.602] 100 4 / 4 0.585 reproduced
overlap

Train/test overlap declared by the evaluator: rna-ml/rnacentral

Board
Base-pair precision (2-D pair head) ↑ higher is better · probe · secondary 0.531 [0.477, 0.588] 100 — 0.591 reproduced
overlap

Train/test overlap declared by the evaluator: rna-ml/rnacentral

Board
Base-pair recall (2-D pair head) ↑ higher is better · probe · secondary 0.604 [0.542, 0.665] 100 — 0.633 reproduced
overlap

Train/test overlap declared by the evaluator: rna-ml/rnacentral

Board
Base-pair MCC (2-D pair head) ↑ higher is better · probe · secondary 0.553 [0.496, 0.610] 100 — 0.592 reproduced
overlap

Train/test overlap declared by the evaluator: rna-ml/rnacentral

Board

Other Benchmarks drawn from no hub dataset you can see

Protein abundance from coding sequence (E. coli) rna-ml/coding-sequence-protein-abundance

atlas-n100-v1

Metric Value 95% CI n Rank Best in catalogue Source Overlap Board
Spearman ρ (zero-shot pseudo-log-likelihood) ↑ higher is better · zero-shot 0.160 [−0.057, 0.364] 100 9 / 11 0.552 reproduced none declared Board
Spearman ρ (ridge probe) ↑ higher is better · probe 0.565 [0.402, 0.694] 100 6 / 11 0.688 reproduced none declared Board
RMSE (ridge probe) ↓ lower is better · log10 ppm · probe 1.083 [0.940, 1.226] 100 6 / 11 0.973 reproduced none declared Board
Pearson r (ridge probe) ↑ higher is better · probe · secondary 0.547 [0.401, 0.676] 100 — 0.665 reproduced none declared Board
R² (ridge probe) ↑ higher is better · probe · secondary 0.270 [0.072, 0.418] 100 — 0.411 reproduced none declared Board