T

T5 Efficient Base

Developed by google
T5-Efficient-BASE is a variant of Google's T5 architecture, featuring a deep-narrow design optimized for downstream task performance, with 222.9 million parameters.
Downloads 735
Release Time : 3/2/2022

Model Overview

This model is an improved version of the original T5 architecture, enhancing efficiency by prioritizing model depth over width, suitable for English NLP tasks. Requires fine-tuning for use.

Model Features

Deep-Narrow Architecture
Compared to standard T5, prioritizes increasing model depth over width, improving downstream task performance with the same parameter count.
Efficient Pretraining
Pretrained on the C4 dataset for 524,288 steps using span-based masked language modeling objectives.
Parameter Efficiency Optimization
Achieves better Pareto efficiency through a tall-and-thin design, balancing parameter count, FLOPs, and inference speed.

Model Capabilities

Text Generation
Text Summarization
Question Answering
Text Classification (requires architecture adjustment)

Use Cases

Text Generation
Automatic Summarization
Compress long documents into concise summaries
Question Answering
Open-Domain QA
Answer natural language questions based on given context
Featured Recommended AI Models
AIbase
Empowering the Future, Your AI Solution Knowledge Base
© 2025AIbase