Nougat Small

🚀 Nougat model, small-sized version

A Nougat model trained on PDF-to-markdown conversion, offering efficient academic document transcription.

🚀 Quick Start

Nougat is a model trained to convert PDF documents into Markdown. It was introduced in the paper Nougat: Neural Optical Understanding for Academic Documents by Blecher et al. and first released in this repository.

Disclaimer: The team releasing Nougat did not write a model card for this model, so this model card has been written by the Hugging Face team.

Note: this model corresponds to the "0.1.0-small" version of the original repository.

✨ Features

• Transcribes scientific PDFs into an easy - to - use markdown format.
• Utilizes a Swin Transformer as a vision encoder and an mBART model as a text decoder.

📚 Documentation

Model description

Nougat is a Donut model trained to transcribe scientific PDFs into an easy-to-use markdown format. The model consists of a Swin Transformer as vision encoder, and an mBART model as text decoder.

The model is trained to autoregressively predict the markdown given only the pixels of the PDF image as input.

Nougat high-level overview. Taken from the original paper.

Intended uses & limitations

You can use the raw model for transcribing a PDF into Markdown. See the model hub to look for other fine-tuned versions that may interest you.

How to use

We refer to the docs.

BibTeX entry and citation info

@misc{blecher2023nougat,
      title={Nougat: Neural Optical Understanding for Academic Documents}, 
      author={Lukas Blecher and Guillem Cucurull and Thomas Scialom and Robert Stojnic},
      year={2023},
      eprint={2308.13418},
      archivePrefix={arXiv},
      primaryClass={cs.LG}
}

📄 License

This model is licensed under CC - BY - 4.0.