Modernbert Ai Detection

🚀 Machine-generated text detection prevents language model collapse

This model offers an approach to prevent model collapse based on importance sampling from a machine-generated text detector, contributing to the stability and effectiveness of language models.

🚀 Quick Start

This model is part of the research presented in the paper Machine-generated text detection prevents language model collapse. The official implementation and training scripts are available in the GitHub repository: GeorgeDrayson/model_collapse

📦 Installation

No specific installation steps are provided in the original document.

💻 Usage Examples

Basic Usage

from transformers import AutoTokenizer, AutoModelForSequenceClassification
import torch

tokenizer = AutoTokenizer.from_pretrained("GeorgeDrayson/modernbert-mage")
model = AutoModelForSequenceClassification.from_pretrained("GeorgeDrayson/modernbert-mage")

text = "Your input text here."
inputs = tokenizer(text, return_tensors="pt")
outputs = model(**inputs)
probabilities = torch.nn.functional.softmax(outputs.logits, dim=-1)
print(f"Probability of machine-generated text: {probabilities[0][1].item():.4f}")

📚 Documentation

📄 License

The model is released under the apache-2.0 license.

📄 Citation

If you use this model or find the research helpful, please cite:

@article{drayson2025machine,
  title={Machine-generated text detection prevents language model collapse},
  author={Drayson, George and Yilmaz, Emine and Lampos, Vasileios},
  journal={arXiv preprint arXiv:2502.15654},
  year={2025}
}