genomics/hyenadna-medium-450k-seqlen-hf

Visibility: PUBLIC
Model cardFilesBenchmarks

Genomic Benchmarks accuracy genomics/genomic-benchmarks-accuracy

Drawn from: Genomic_Benchmarks_demo_coding_vs_intergenomic_seqs, Genomic_Benchmarks_human_enhancers_cohn, Genomic_Benchmarks_human_nontata_promoters

atlas-full-v1

Metric Value 95% CI n Rank Best in catalogue Source Overlap Board
Accuracy (logistic probe, mean of 3 sets) ↑ higher is better · probe
By dataset: 3 levels
datasetValue [95% CI]n
Coding vs intergenomic sequences (demo)0.832 [0.828, 0.837]25000
Human enhancers (Cohn)0.700 [0.690, 0.711]6948
Human non-TATA promoters0.793 [0.785, 0.801]9034
0.775 [0.770, 0.780] 40982 4 / 5 0.821 reproduced
overlap

Train/test overlap declared by the evaluator: genomics/ucsc-hg38

Board
Macro F1 (logistic probe, mean of 3 sets) ↑ higher is better · probe · secondary
By dataset: 3 levels
datasetValue [95% CI]n
Coding vs intergenomic sequences (demo)0.832 [0.828, 0.837]25000
Human enhancers (Cohn)0.700 [0.689, 0.711]6948
Human non-TATA promoters0.793 [0.784, 0.801]9034
0.775 [0.770, 0.779] 40982 — 0.821 reproduced
overlap

Train/test overlap declared by the evaluator: genomics/ucsc-hg38

Board

Protein abundance from coding sequence (E. coli) rna-ml/coding-sequence-protein-abundance

atlas-n100-v1

Metric Value 95% CI n Rank Best in catalogue Source Overlap Board
Spearman ρ (zero-shot pseudo-log-likelihood) ↑ higher is better · zero-shot −0.022 [−0.238, 0.193] 100 10 / 11 0.552 reproduced none declared Board
Spearman ρ (ridge probe) ↑ higher is better · probe 0.391 [0.215, 0.544] 100 11 / 11 0.688 reproduced none declared Board
RMSE (ridge probe) ↓ lower is better · log10 ppm · probe 1.168 [1.025, 1.304] 100 11 / 11 0.973 reproduced none declared Board
Pearson r (ridge probe) ↑ higher is better · probe · secondary 0.428 [0.275, 0.565] 100 — 0.665 reproduced none declared Board
R² (ridge probe) ↑ higher is better · probe · secondary 0.151 [−0.018, 0.302] 100 — 0.411 reproduced none declared Board