# [PAPER] Med-BERT : pretrained contextualized embeddings on large-scale structured electronic health records for disease prediction

:::info
**Author** : Laila Rasmy, Yang Xiang, Ziqian Xie, Cui Tao & Degui Zhi

**Paper Link** : https://www.nature.com/articles/s41746-021-00455-y

**Code** : https://github.com/ZhiGroup/Med-BERT
:::

## Contributions

* npj | digital medicine
* EHR (Cerner) for 20 million patients in 600 hospitals in the US
* Using BERT-based MLM
* As a domain-specific pretraining task to additionally learn the context beyond the diagnosis code, it predicts the hospitalization period.
* Prediction of heart failure & pancreatic cancer in diabetic patients with a fine-tunned task