---
title: ClinicalBERT
description: This model card describes the ClinicalBERT model, which was trained on a large multicenter dataset with a large corpus of 1.2B words of diverse diseases we constructed. We then utilized a large-scale corpus of EHRs from over 3 million patient records to fine tune the base language
tags:
- clinical
- distilbert
- fill-mask
- medical
- nlp
source_url: https://huggingface.co/medicalai/ClinicalBERT
---

# ClinicalBERT

> **Mirrored metadata.** This card is reproduced on Atlas for discovery. The artifact itself is not hosted here — follow the source link for the files, and refer to the upstream licence for terms of use.

This model card describes the ClinicalBERT model, which was trained on a large multicenter dataset with a large corpus of 1.2B words of diverse diseases we constructed. We then utilized a large-scale corpus of EHRs from over 3 million patient records to fine tune the base language

Upstream identifier: `medicalai/ClinicalBERT`.

**Source:** https://huggingface.co/medicalai/ClinicalBERT

_This model is part of the Atlas demo catalogue. See the repository history for provenance._