# Biomedical Pretraining

BioMistral-7B-mistral7instruct-dare is a large language model for the medical domain, merged using the DARE method from Mistral-7B-Instruct-v0.1 and BioMistral-7B, specializing in biomedical text generation tasks.

CXR-BERT is a specialized language model developed for the chest X-ray domain, optimized for radiology text processing through improved vocabulary and pretraining procedures

Large-scale biomedical language models based on BERT, ALBERT, and ELECTRA, achieving state-of-the-art results in multiple biomedical tasks