---
title: caduceus-ph_seqlen-131k_d_model-256_n_layer-16
description: "Using Caduceus To use the pre-trained model for masked language modeling, use the following snippet: python from transformers import AutoModelForMaskedLM,"
tags:
- caduceus
- custom_code
- dna
- fill-mask
- long-context
license: apache-2.0
source_url: https://huggingface.co/kuleshov-group/caduceus-ph_seqlen-131k_d_model-256_n_layer-16
---

# caduceus-ph_seqlen-131k_d_model-256_n_layer-16

> **Mirrored metadata.** This card is reproduced on Atlas for discovery. The artifact itself is not hosted here — follow the source link for the files, and refer to the upstream licence for terms of use.

Using Caduceus To use the pre-trained model for masked language modeling, use the following snippet: python from transformers import AutoModelForMaskedLM,

Upstream identifier: `kuleshov-group/caduceus-ph_seqlen-131k_d_model-256_n_layer-16`.

**Source:** https://huggingface.co/kuleshov-group/caduceus-ph_seqlen-131k_d_model-256_n_layer-16

**Licence:** apache-2.0

_This model is part of the Atlas demo catalogue. See the repository history for provenance._