Bart Legal Base Es

🚀 BART Legal Spanish ⚖️

BART Legal Spanish (base) is a BART-like model trained on A collection of corpora of the Spanish legal domain. It leverages the power of the BART architecture, which is a transformer encoder-decoder (seq2seq) model. This architecture combines a bidirectional (BERT-like) encoder and an autoregressive (GPT-like) decoder. BART is pre-trained by corrupting text with an arbitrary noising function and then learning to reconstruct the original text.

This model shines when fine-tuned for text generation tasks such as summarization and translation. It also performs well in comprehension tasks like text classification and question answering.

🚀 Quick Start

To use this model with the transformers library, you can follow the code example below.

💻 Usage Examples

Basic Usage

from transformers import BartForConditionalGeneration, BartTokenizer

model_id = "mrm8488/bart-legal-base-es"

model = BartForConditionalGeneration.from_pretrained(model_id, forced_bos_token_id=0)
tokenizer = BartTokenizer.from_pretrained(model_id)

def fill_mask_span(text):
  batch = tokenizer(text, return_tensors="pt")
  generated_ids = model.generate(batch["input_ids"])
  print(tokenizer.batch_decode(generated_ids, skip_special_tokens=True))

text = "Los españoles son <mask> ante la ley."
fill_mask_span(text)
# Output: ['Los españoles son iguales ante la ley.1.ª y 2.ª ante la']

text = "Los proyectos de reforma Constitucional deberán <mask> por una mayoría de tres quintos de cada una de las Cámaras."
fill_mask_span(text)
# Output: ['Los proyectos de reforma Constitucional deberán ser aprobados por una mayoría de tres quintos de cada']

📚 Documentation

Training details

• Dataset: Spanish-legal-corpora - 90% for training / 10% for validation.
• Training script: see here

Evaluation metrics 🧾

Benchmarks 🔨

WIP 🚧

📄 License

This section is not provided in the original document, so it is skipped.

Acknowledgments

• Narrativa
• QBlocks
• jarvislabs

Citation

If you want to cite this model, you can use this:

@misc {manuel_romero_2023,
	author       = { {Manuel Romero} },
	title        = { bart-legal-base-es (Revision c33ed22) },
	year         = 2023,
	url          = { https://huggingface.co/mrm8488/bart-legal-base-es },
	doi          = { 10.57967/hf/0472 },
	publisher    = { Hugging Face }
}

Created by Manuel Romero/@mrm8488 Made with ♥ in Spain