# Rotary Position Embedding

QA model fine-tuned from ModernBERT-base-nli, supporting long-context processing

EVA02 feature/representation model, pretrained on ImageNet-22k via masked image modeling, suitable for image classification and feature extraction tasks.

RoFormerV2 is an enhanced Transformer model based on rotary position embedding, developed by Zhuiyi Technology, supporting Chinese text processing tasks.

RoFormerV2 is an enhanced Transformer model based on rotary position embedding, optimized for Chinese text processing

RoFormer is a Transformer model enhanced by Rotary Position Embedding (RoPE), suitable for Chinese text processing tasks.

RoFormer is a Chinese Transformer model enhanced with Rotary Position Embedding, suitable for text infilling tasks.

GPT-J 6B is a 6-billion-parameter autoregressive language model trained using the Mesh Transformer JAX framework, employing the same tokenizer as GPT-2/3.