Gliner Medium News V2.1

🚀 Model Card for gliner_medium_news-v2.1

This model is a fine - tuned version of GLiNER, aiming to enhance accuracy across a wide range of topics, especially in long - context news entity extraction. As shown in the table below, these fine - tunings improved the zero - shot accuracy of the base GLiNER model by up to 7.5% across 18 benchmark datasets.

The underlying dataset, AskNews - NER - v0, was designed to diversify global perspectives by ensuring country/language/topic/temporal diversity. All the data used for fine - tuning this model was synthetically generated. WizardLM 13B v1.2 was used for translating and summarizing open - web news articles, while Llama3 70b instruct was used for entity extraction. Both the diversification and fine - tuning methods are presented in our paper on ArXiv.

🚀 Quick Start

Use the code below to get started with the model.

from gliner import GLiNER

model = GLiNER.from_pretrained("EmergentMethods/gliner_medium_news-v2.1")

text = """
The Chihuahua State Public Security Secretariat (SSPE) arrested 35 - year - old Salomón C. T. in Ciudad Juárez, found in possession of a stolen vehicle, a white GMC Yukon, which was reported stolen in the city's streets. The arrest was made by intelligence and police analysis personnel during an investigation in the border city. The arrest is related to a previous detention on February 6, which involved armed men in a private vehicle. The detainee and the vehicle were turned over to the Chihuahua State Attorney General's Office for further investigation into the case. 
"""

labels = ["person", "location", "date", "event", "facility", "vehicle", "number", "organization"]

entities = model.predict_entities(text, labels)

for entity in entities:
    print(entity["text"], "=>", entity["label"])

Output:

Chihuahua State Public Security Secretariat => organization
SSPE => organization
35 - year - old => number
Salomón C. T. => person
Ciudad Juárez => location
GMC Yukon => vehicle
February 6 => date
Chihuahua State Attorney General's Office => organization

✨ Features

• This model is a fine - tune of GLiNER, improving accuracy across a broad range of topics, especially in long - context news entity extraction.
• The underlying dataset enforces country/language/topic/temporal diversity, and all fine - tuning data is synthetically generated.
• It is shockingly compact and can be used for high - throughput production usecases.

📦 Installation

No installation steps are provided in the original document, so this section is skipped.

💻 Usage Examples

Basic Usage

from gliner import GLiNER

model = GLiNER.from_pretrained("EmergentMethods/gliner_medium_news-v2.1")

text = """
The Chihuahua State Public Security Secretariat (SSPE) arrested 35 - year - old Salomón C. T. in Ciudad Juárez, found in possession of a stolen vehicle, a white GMC Yukon, which was reported stolen in the city's streets. The arrest was made by intelligence and police analysis personnel during an investigation in the border city. The arrest is related to a previous detention on February 6, which involved armed men in a private vehicle. The detainee and the vehicle were turned over to the Chihuahua State Attorney General's Office for further investigation into the case. 
"""

labels = ["person", "location", "date", "event", "facility", "vehicle", "number", "organization"]

entities = model.predict_entities(text, labels)

for entity in entities:
    print(entity["text"], "=>", entity["label"])

📚 Documentation

Model Details

Model Description

The synthetic data underlying this news fine - tune was pulled from the AskNews API. We enforced diversity across country/language/topic/time.

Countries:

Entity types:

Topics:

Model Sources

• Repository: To be added
• Paper: To be added
• Demo: To be added

Uses

Direct Use

As the name suggests, this model is aimed at generalist entity extraction. Although we used news to fine - tune this model, it improved accuracy across 18 benchmark datasets by up to 7.5%. This means that the broad and diversified underlying dataset has helped it to recognize and extract more entity types. This model is shockingly compact, and can be used for high - throughput production usecases. Currently, AskNews is using this fine - tune for entity extraction in their system.

Bias, Risks, and Limitations

Although the goal of the dataset is to reduce bias and improve diversity, it is still biased towards western languages and countries. This limitation originates from the abilities of Llama2 for translation and summary generations. Further, any bias originating in Llama2 training data will also be present in this dataset, since Llama2 was used to summarize the open - web articles. Also, any biases present in Llama3 will be present in the present dataset since Llama3 was used to extract entities from the summaries.

Training Details

The training dataset is AskNews - NER - v0. Other training details can be found in the companion paper.

Environmental Impact

• Hardware Type: 1xA4500
• Hours used: 10
• Carbon Emitted: 0.6 kg (According to Machine Learning Impact calculator)

Citation

BibTeX:

To be added

APA:

To be added

Model Authors

Elin Törnquist, Emergent Methods elin at emergentmethods.ai Robert Caulk, Emergent Methods rob at emergentmethods.ai

Model Contact

Elin Törnquist, Emergent Methods elin at emergentmethods.ai Robert Caulk, Emergent Methods rob at emergentmethods.ai

📄 License

This model is licensed under the Apache 2.0 license.