# BigBird Architecture

A meeting transcript summarization model optimized based on the BigBird-Pegasus architecture, capable of processing meeting records up to 4096 tokens and generating concise summaries

A Japanese BigBird model pre-trained on Japanese Wikipedia, CC-100, and OSCAR datasets, suitable for long sequence processing tasks.

Korean Q&A model fine-tuned on the custom_squad_v2 dataset based on monologg/kobigbird-bert-base

A question-answering model based on the BigBird architecture, specifically optimized and trained for the Natural Questions dataset

This is a Chinese pre-trained model based on the BigBird architecture, optimized for Chinese text processing and supporting long text sequence handling.