# Protein sequence feature extraction

ProtT5-XL-BFD is a self-supervised pre-trained model based on protein sequences, using the T5 architecture, trained on 2.1 billion protein sequences for protein feature extraction and downstream task fine-tuning.

A BERT-based protein sequence pre-training model that extracts biophysical features through self-supervised learning from 2.1 billion protein sequences