Deberta V3 Large Zeroshot V1.1 All 33

🚀 deberta-v3-large-zeroshot-v1.1-all-33

该模型专为使用Hugging Face管道进行零样本分类而设计。它可以完成一项通用的分类任务：根据给定文本判断一个假设是“真”还是“非真”（即entailment与not_entailment）。此任务格式基于自然语言推理任务（NLI），具有很强的通用性，任何分类任务都可以转化为该任务。

🚀 快速开始

简单的零样本分类管道

#!pip install transformers[sentencepiece]
from transformers import pipeline
text = "Angela Merkel is a politician in Germany and leader of the CDU"
hypothesis_template = "This example is about {}"
classes_verbalized = ["politics", "economy", "entertainment", "environment"]
zeroshot_classifier = pipeline("zero-shot-classification", model="MoritzLaurer/deberta-v3-large-zeroshot-v1.1-all-33")
output = zeroshot_classifier(text, classes_verbalised, hypothesis_template=hypothesis_template, multi_label=False)
print(output)

自定义假设模板示例

from transformers import pipeline
text = "Angela Merkel is a politician in Germany and leader of the CDU"
hypothesis_template = "Merkel is the leader of the party: {}"
classes_verbalized = ["CDU", "SPD", "Greens"]
zeroshot_classifier = pipeline("zero-shot-classification", model="MoritzLaurer/deberta-v3-large-zeroshot-v1.1-all-33")
output = zeroshot_classifier(text, classes_verbalized, hypothesis_template=hypothesis_template, multi_label=False)
print(output)

✨ 主要特性

• 通用分类能力：能够将任何分类任务转化为判断假设“真”或“非真”的任务。
• 基于NLI任务：任务格式基于自然语言推理任务（NLI），具有良好的理论基础。
• 多数据集训练：在33个数据集和387个类别的混合数据上进行训练，具有更广泛的适用性。

📦 安装指南

使用前需安装transformers库：

!pip install transformers[sentencepiece]

📚 详细文档

有关该模型的训练方式和使用方法的详细描述，请参考这篇论文。

🔧 技术细节

训练数据

该模型在混合了33个数据集和387个类别的数据上进行训练，这些数据都已被重新格式化为通用格式：

1. 五个NLI数据集：包含约88.5万条文本，分别是 "mnli"、"anli"、"fever"、"wanli"、"ling"。
2. 28个分类任务：重新格式化为通用NLI格式，使用了约5.1万条清理后的文本以避免过拟合，包括 'amazonpolarity'、'imdb'、'appreviews' 等。

每个数据集的详细信息请参考：https://github.com/MoritzLaurer/zeroshot-classifier/blob/main/datasets_overview.csv

与其他NLI模型相比，该模型预测两个类别（entailment与not_entailment），而不是三个类别（entailment/neutral/contradiction）。

该模型仅在英文数据上进行训练。对于多语言用例，建议使用EasyNMT等库将文本机器翻译为英文。英文模型通常比多语言模型表现更好，并且如果您不熟悉语料库中的所有语言，使用英文数据进行验证会更容易。

数据和训练详情

准备数据以及训练和评估模型的代码完全开源，可查看：https://github.com/MoritzLaurer/zeroshot-classifier/tree/main

超参数和其他详细信息可在Weights & Biases仓库中查看：https://wandb.ai/moritzlaurer/deberta-v3-large-zeroshot-v1-1-all-33/table?workspace=user-

评估指标

所有数据集均报告了平衡准确率。deberta-v3-large-zeroshot-v1.1-all-33在所有数据集上进行训练，每个类别最多使用500条文本以避免过拟合。因此，这些数据集上的指标并非严格的零样本指标，因为模型在训练期间已经看到了每个任务的一些数据。deberta-v3-large-zeroshot-v1.1-heldout表示在相应数据集上的零样本性能。为了计算这些零样本指标，管道运行了28次，每次都将一个数据集排除在训练之外，以模拟零样本设置。

	deberta-v3-large-mnli-fever-anli-ling-wanli-binary	deberta-v3-large-zeroshot-v1.1-heldout	deberta-v3-large-zeroshot-v1.1-all-33
datasets mean (w/o nli)	64.1	73.4	85.2
amazonpolarity (2)	94.7	96.6	96.8
imdb (2)	90.3	95.2	95.5
appreviews (2)	93.6	94.3	94.7
yelpreviews (2)	98.5	98.4	98.9
rottentomatoes (2)	83.9	90.5	90.8
emotiondair (6)	49.2	42.1	72.1
emocontext (4)	57	69.3	82.4
empathetic (32)	42	34.4	58
financialphrasebank (3)	77.4	77.5	91.9
banking77 (72)	29.1	52.8	72.2
massive (59)	47.3	64.7	77.3
wikitoxic_toxicaggreg (2)	81.6	86.6	91
wikitoxic_obscene (2)	85.9	91.9	93.1
wikitoxic_threat (2)	77.9	93.7	97.6
wikitoxic_insult (2)	77.8	91.1	92.3
wikitoxic_identityhate (2)	86.4	89.8	95.7
hateoffensive (3)	62.8	66.5	88.4
hatexplain (3)	46.9	61	76.9
biasframes_offensive (2)	62.5	86.6	89
biasframes_sex (2)	87.6	89.6	92.6
biasframes_intent (2)	54.8	88.6	89.9
agnews (4)	81.9	82.8	90.9
yahootopics (10)	37.7	65.6	74.3
trueteacher (2)	51.2	54.9	86.6
spam (2)	52.6	51.8	97.1
wellformedquery (2)	49.9	40.4	82.7
manifesto (56)	10.6	29.4	44.1
capsotu (21)	23.2	69.4	74
mnli_m (2)	93.1	nan	93.1
mnli_mm (2)	93.2	nan	93.2
fevernli (2)	89.3	nan	89.5
anli_r1 (2)	87.9	nan	87.3
anli_r2 (2)	76.3	nan	78
anli_r3 (2)	73.6	nan	74.1
wanli (2)	82.8	nan	82.7
lingnli (2)	90.2	nan	89.6

局限性和偏差

该模型仅能处理文本分类任务。有关潜在偏差，请参考原始的DeBERTa论文和不同数据集的相关论文。

📄 许可证

基础模型（DeBERTa-v3）根据MIT许可证发布。模型微调所使用的数据集根据多种不同的许可证发布。以下表格提供了用于微调的非NLI数据集的概述、许可证信息、基础论文等详细信息：https://github.com/MoritzLaurer/zeroshot-classifier/blob/main/datasets_overview.csv

引用

如果您在学术研究中使用该模型，请引用以下文献：

@misc{laurer_building_2023,
	title = {Building {Efficient} {Universal} {Classifiers} with {Natural} {Language} {Inference}},
	url = {http://arxiv.org/abs/2312.17543},
	doi = {10.48550/arXiv.2312.17543},
	abstract = {Generative Large Language Models (LLMs) have become the mainstream choice for fewshot and zeroshot learning thanks to the universality of text generation. Many users, however, do not need the broad capabilities of generative LLMs when they only want to automate a classification task. Smaller BERT-like models can also learn universal tasks, which allow them to do any text classification task without requiring fine-tuning (zeroshot classification) or to learn new tasks with only a few examples (fewshot), while being significantly more efficient than generative LLMs. This paper (1) explains how Natural Language Inference (NLI) can be used as a universal classification task that follows similar principles as instruction fine-tuning of generative LLMs, (2) provides a step-by-step guide with reusable Jupyter notebooks for building a universal classifier, and (3) shares the resulting universal classifier that is trained on 33 datasets with 389 diverse classes. Parts of the code we share has been used to train our older zeroshot classifiers that have been downloaded more than 55 million times via the Hugging Face Hub as of December 2023. Our new classifier improves zeroshot performance by 9.4\%.},
	urldate = {2024-01-05},
	publisher = {arXiv},
	author = {Laurer, Moritz and van Atteveldt, Wouter and Casas, Andreu and Welbers, Kasper},
	month = dec,
	year = {2023},
	note = {arXiv:2312.17543 [cs]},
	keywords = {Computer Science - Artificial Intelligence, Computer Science - Computation and Language},
}

合作建议或问题咨询

如果您有合作想法或问题咨询，请通过m{dot}laurer{at}vu{dot}nl联系我，或在LinkedIn上与我交流。

调试与问题解决

请注意，DeBERTa-v3于2021年12月6日发布，较旧版本的HF Transformers在运行该模型时可能会出现问题（例如，分词器可能会出现问题）。使用Transformers >= 4.13可能会解决一些问题。

分类使用的假设

以下表格中的假设用于微调模型。检查这些假设可以帮助用户了解模型所训练的假设类型和任务。您可以通过更改零样本管道的hypothesis_template来制定自己的假设。

wellformedquery

标签	假设
not_well_formed	This example is not a well formed Google query
well_formed	This example is a well formed Google query.

biasframes_sex

标签	假设
not_sex	This example does not contain allusions to sexual content.
sex	This example contains allusions to sexual content.

biasframes_intent

标签	假设
intent	The intent of this example is to be offensive/disrespectful.
not_intent	The intent of this example is not to be offensive/disrespectful.

financialphrasebank

标签	假设
negative	The sentiment in this example is negative from an investor's perspective.
neutral	The sentiment in this example is neutral from an investor's perspective.
positive	The sentiment in this example is positive from an investor's perspective.

rottentomatoes

标签	假设
negative	The sentiment in this example rotten tomatoes movie review is negative
positive	The sentiment in this example rotten tomatoes movie review is positive

amazonpolarity

标签	假设
negative	The sentiment in this example amazon product review is negative
positive	The sentiment in this example amazon product review is positive

imdb

标签	假设
negative	The sentiment in this example imdb movie review is negative
positive	The sentiment in this example imdb movie review is positive

appreviews

标签	假设
negative	The sentiment in this example app review is negative.
positive	The sentiment in this example app review is positive.

yelpreviews

标签	假设
negative	The sentiment in this example yelp review is negative.
positive	The sentiment in this example yelp review is positive.

wikitoxic_toxicaggregated

标签	假设
not_toxicaggregated	This example wikipedia comment does not contain toxic language.
toxicaggregated	This example wikipedia comment contains toxic language.

wikitoxic_obscene

标签	假设
not_obscene	This example wikipedia comment does not contain obscene language.
obscene	This example wikipedia comment contains obscene language.

wikitoxic_threat

标签	假设
not_threat	This example wikipedia comment does not contain a threat.
threat	This example wikipedia comment contains a threat.

wikitoxic_insult

标签	假设
insult	This example wikipedia comment contains an insult.
not_insult	This example wikipedia comment does not contain an insult.

wikitoxic_identityhate

标签	假设
identityhate	This example wikipedia comment contains identity hate.
not_identityhate	This example wikipedia comment does not contain identity hate.

hateoffensive

标签	假设
hate_speech	This example tweet contains hate speech.
neither	This example tweet contains neither offensive language nor hate speech.
offensive	This example tweet contains offensive language without hate speech.

hatexplain

标签	假设
hate_speech	This example text from twitter or gab contains hate speech.
neither	This example text from twitter or gab contains neither offensive language nor hate speech.
offensive	This example text from twitter or gab contains offensive language without hate speech.

spam

标签	假设
not_spam	This example sms is not spam.
spam	This example sms is spam.

emotiondair

标签	假设
anger	This example tweet expresses the emotion: anger
fear	This example tweet expresses the emotion: fear
joy	This example tweet expresses the emotion: joy
love	This example tweet expresses the emotion: love
sadness	This example tweet expresses the emotion: sadness
surprise	This example tweet expresses the emotion: surprise

emocontext

标签	假设
angry	This example tweet expresses the emotion: anger
happy	This example tweet expresses the emotion: happiness
others	This example tweet does not express any of the emotions: anger, sadness, or happiness
sad	This example tweet expresses the emotion: sadness

empathetic

标签	假设
afraid	The main emotion of this example dialogue is: afraid
angry	The main emotion of this example dialogue is: angry
annoyed	The main emotion of this example dialogue is: annoyed
anticipating	The main emotion of this example dialogue is: anticipating
anxious	The main emotion of this example dialogue is: anxious
apprehensive	The main emotion of this example dialogue is: apprehensive
ashamed	The main emotion of this example dialogue is: ashamed
caring	The main emotion of this example dialogue is: caring
confident	The main emotion of this example dialogue is: confident
content	The main emotion of this example dialogue is: content
devastated	The main emotion of this example dialogue is: devastated
disappointed	The main emotion of this example dialogue is: disappointed
disgusted	The main emotion of this example dialogue is: disgusted
embarrassed	The main emotion of this example dialogue is: embarrassed
excited	The main emotion of this example dialogue is: excited
faithful	The main emotion of this example dialogue is: faithful
furious	The main emotion of this example dialogue is: furious
grateful	The main emotion of this example dialogue is: grateful
guilty	The main emotion of this example dialogue is: guilty
hopeful	The main emotion of this example dialogue is: hopeful
impressed	The main emotion of this example dialogue is: impressed
jealous	The main emotion of this example dialogue is: jealous
joyful	The main emotion of this example dialogue is: joyful
lonely	The main emotion of this example dialogue is: lonely
nostalgic	The main emotion of this example dialogue is: nostalgic
prepared	The main emotion of this example dialogue is: prepared
proud	The main emotion of this example dialogue is: proud
sad	The main emotion of this example dialogue is: sad
sentimental	The main emotion of this example dialogue is: sentimental
surprised	The main emotion of this example dialogue is: surprised
terrified	The main emotion of this example dialogue is: terrified
trusting	The main emotion of this example dialogue is: trusting

agnews

标签	假设
Business	This example news text is about business news
Sci/Tech	This example news text is about science and technology
Sports	This example news text is about sports
World	This example news text is about world news

yahootopics

标签	假设
Business & Finance	This example question from the Yahoo Q&A forum is categorized in the topic: Business & Finance
Computers & Internet	This example question from the Yahoo Q&A forum is categorized in the topic: Computers & Internet
Education & Reference	This example question from the Yahoo Q&A forum is categorized in the topic: Education & Reference
Entertainment & Music	This example question from the Yahoo Q&A forum is categorized in the topic: Entertainment & Music
Family & Relationships	This example question from the Yahoo Q&A forum is categorized in the topic: Family & Relationships
Health	This example question from the Yahoo Q&A forum is categorized in the topic: Health
Politics & Government	This example question from the Yahoo Q&A forum is categorized in the topic: Politics & Government
Science & Mathematics	This example question from the Yahoo Q&A forum is categorized in the topic: Science & Mathematics
Society & Culture	This example question from the Yahoo Q&A forum is categorized in the topic: Society & Culture
Sports	This example question from the Yahoo Q&A forum is categorized in the topic: Sports

massive

标签	假设
alarm_query	The example utterance is a query about alarms.
alarm_remove	The intent of this example utterance is to remove an alarm.
alarm_set	The intent of the example utterance is to set an alarm.
audio_volume_down	The intent of the example utterance is to lower the volume.
audio_volume_mute	The intent of this example utterance is to mute the volume.
audio_volume_other	The example utterance is related to audio volume.
audio_volume_up	The intent of the example utterance is turning the audio volume up.
calendar_query	The example utterance is a query about a calendar.
calendar_remove	The intent of the example utterance is to remove something from a calendar.
calendar_set	The intent of the example utterance is to set something in a calendar.
cooking_query	The example utterance is a query about cooking.
cooking_recipe	This example utterance is about cooking recipies.
datetime_convert	The example utterance is related to date time changes or conversion.
datetime_query	The intent of this example utterance is a datetime query.
email_addcontact	The intent of this example utterance is adding an email address to contacts.
email_query	The example utterance is a query about emails.
email_querycontact	The intent of this example utterance is to query contact details.
email_sendemail	The intent of this example utterance is to send an email.
general_greet	This example utterance is a general greet.
general_joke	The intent of the example utterance is to hear a joke.
general_quirky	nan
iot_cleaning	The intent of the example utterance is for an IoT device to start cleaning.
iot_coffee	The intent of the example utterance is for an IoT device to make coffee.
iot_hue_lightchange	The intent of the example utterance is changing the light.
iot_hue_lightdim	The intent of the example utterance is to dim the lights.
iot_hue_lightoff	The example utterance is related to turning the lights off.
iot_hue_lighton	The example utterance is related to turning the lights on.
iot_hue_lightup	The intent of the example utterance is to brighten lights.
iot_wemo_off	The intent of this example utterance is turning an IoT device off.
iot_wemo_on	The intent of the example utterance is to turn an IoT device on.
lists_createoradd	The example utterance is related to creating or adding to lists.
lists_query	The example utterance is a query about a list.
lists_remove	The intent of this example utterance is to remove a list or remove something from a list.
music_dislikeness	The intent of this example utterance is signalling music dislike.
music_likeness	The example utterance is related to liking music.
music_query	The example utterance is a query about music.
music_settings	The intent of the example utterance is to change music settings.
news_query	The example utterance is a query about the news.
play_audiobook	The example utterance is related to playing audiobooks.
play_game	The intent of the example utterance is to start playing a game.
play_music	The intent of the example utterance is for an IoT device to play music.
play_podcasts	The example utterance is related to playing podcasts.
play_radio	The intent of the example utterance is to play something on the radio.
qa_currency	This example utteranceis about currencies.
qa_definition	The example utterance is a query about a definition.
qa_factoid	The example utterance is a factoid question.
qa_maths	The example utterance is a question about maths.
qa_stock	This example utterance is about stocks.
recommendation_events	This example utterance is about event recommendations.
recommendation_locations	The intent of this example utterance is receiving recommendations for good locations.
recommendation_movies	This example utterance is about movie recommendations.
social_post	The example utterance is about social media posts.
social_query	The example utterance is a query about a social network.
takeaway_order	The intent of this example utterance is to order takeaway food.
takeaway_query	This example utterance is about takeaway food.
transport_query	The example utterance is a query about transport or travels.
transport_taxi	The intent of this example utterance is to get a taxi.
transport_ticket	This example utterance is about transport tickets.
transport_traffic	This example utterance is about transport or traffic.
weather_query	This example utterance is a query about the wheather.

banking77

标签	假设
Refund_not_showing_up	This customer example message is about a refund not showing up.
activate_my_card	This banking customer example message is about activating a card.
age_limit	This banking customer example message is related to age limits.
apple_pay_or_google_pay	This banking customer example message is about apple pay or google pay
atm_support	This banking customer example message requests ATM support.
automatic_top_up	This banking customer example message is about automatic top up.
balance_not_updated_after_bank_transfer	This banking customer example message is about a balance not updated after a transfer.
balance_not_updated_after_cheque_or_cash_deposit	This banking customer example message is about a balance not updated after a cheque or cash deposit.
beneficiary_not_allowed	This banking customer example message is related to a beneficiary not being allowed or a failed transfer.
cancel_transfer	This banking customer example message is related to the cancellation of a transfer.
card_about_to_expire	This banking customer example message is related to the expiration of a card.
card_acceptance	This banking customer example message is related to the scope of acceptance of a card.
card_arrival	This banking customer example message is about the arrival of a card.
card_delivery_estimate	This banking customer example message is about a card delivery estimate or timing.
card_linking	nan
card_not_working	This banking customer example message is about a card not working.
card_payment_fee_charged	This banking customer example message is about a card payment fee.
card_payment_not_recognised	This banking customer example message is about a payment the customer does not recognise.
card_payment_wrong_exchange_rate	This banking customer example message is about a wrong exchange rate.
card_swallowed	This banking customer example message is about a card swallowed by a machine.
cash_withdrawal_charge	This banking customer example message is about a cash withdrawal charge.
cash_withdrawal_not_recognised	This banking customer example message is about an unrecognised cash withdrawal.
change_pin	This banking customer example message is about changing a pin code.
compromised_card	This banking customer example message is about a compromised card.
contactless_not_working	This banking customer example message is about contactless not working
country_support	This banking customer example message is about country-specific support.
declined_card_payment	This banking customer example message is about a declined card payment.
declined_cash_withdrawal	This banking customer example message is about a declined cash withdrawal.
declined_transfer	This banking customer example message is about a declined transfer.
direct_debit_payment_not_recognised	This banking customer example message is about an unrecognised direct debit payment.
disposable_card_limits	This banking customer example message is about the limits of disposable cards.
edit_personal_details	This banking customer example message is about editing personal details.
exchange_charge	This banking customer example message is about exchange rate charges.
exchange_rate	This banking customer example message is about exchange rates.
exchange_via_app	nan
extra_charge_on_statement	This banking customer example message is about an extra charge.
failed_transfer	This banking customer example message is about a failed transfer.
fiat_currency_support	This banking customer example message is about fiat currency support
get_disposable_virtual_card	This banking customer example message is about getting a disposable virtual card.
get_physical_card	nan
getting_spare_card	This banking customer example message is about getting a spare card.
getting_virtual_card	This banking customer example message is about getting a virtual card.
lost_or_stolen_card	This banking customer example message is about a lost or stolen card.
lost_or_stolen_phone	This banking customer example message is about a lost or stolen phone.
order_physical_card	This banking customer example message is about ordering a card.
passcode_forgotten	This banking customer example message is about a forgotten passcode.
pending_card_payment	This banking customer example message is about a pending card payment.
pending_cash_withdrawal	This banking customer example message is about a pending cash withdrawal.
pending_top_up	This banking customer example message is about a pending top up.
pending_transfer	This banking customer example message is about a pending transfer.
pin_blocked	This banking customer example message is about a blocked pin.
receiving_money	This banking customer example message is about receiving money.
request_refund	This banking customer example message is about a refund request.
reverted_card_payment?	This banking customer example message is about reverting a card payment.
supported_cards_and_currencies	nan
terminate_account	This banking customer example message is about terminating an account.
top_up_by_bank_transfer_charge	nan
top_up_by_card_charge	This banking customer example message is about the charge for topping up by card.
top_up_by_cash_or_cheque	This banking customer example message is about topping up by cash or cheque.
top_up_failed	This banking customer example message is about top up issues or failures.
top_up_limits	This banking customer example message is about top up limitations.
top_up_reverted	This banking customer example message is about issues with topping up.
topping_up_by_card	This banking customer example message is about topping up by card.
transaction_charged_twice	This banking customer example message is about a transaction charged twice.
transfer_fee_charged	This banking customer example message is about an issue with a transfer fee charge.
transfer_into_account	This banking customer example message is about transfers into the customer's own account.
transfer_not_received_by_recipient	This banking customer example message is about a transfer that has not arrived yet.
transfer_timing	This banking customer example message is about transfer timing.
unable_to_verify_identity	This banking customer example message is about an issue with identity verification.
verify_my_identity	This banking customer example message is about identity verification.
verify_source_of_funds	This banking customer example message is about the source of funds.
verify_top_up	This banking customer example message is about verification and top ups
virtual_card_not_working	This banking customer example message is about a virtual card not working
visa_or_mastercard	This banking customer example message is about types of bank cards.
why_verify_identity	This banking customer example message questions why identity verification is necessary.
wrong_amount_of_cash_received	This banking customer example message is about a wrong amount of cash received.
wrong_exchange_rate_for_cash_withdrawal	This banking customer example message is about a wrong exchange rate for a cash withdrawal.

trueteacher

标签	假设
factually_consistent	The example summary is factually consistent with the full article.
factually_inconsistent	The example summary is factually inconsistent with the full article.

capsotu

标签	假设
Agriculture	This example text from a US presidential speech is about agriculture
Civil Rights	This example text from a US presidential speech is about civil rights or minorities or civil liberties
Culture	This example text from a US presidential speech is about cultural policy
Defense	This example text from a US presidential speech is about defense or military
Domestic Commerce	This example text from a US presidential speech is about banking or finance or commerce
Education	This example text from a US presidential speech is about education
Energy	This example text from a US presidential speech is about energy or electricity or fossil fuels
Environment	This example text from a US presidential speech is about the environment or water or waste or pollution
Foreign Trade	This example text from a US presidential speech is about foreign trade
Government Operations	This example text from a US presidential speech is about government operations or administration
Health	This example text from a US presidential speech is about health
Housing	This example text from a US presidential speech is about community development or housing issues
Immigration	This example text from a US presidential speech is about migration
International Affairs	This example text from a US presidential speech is about international affairs or foreign aid
Labor	This example text from a US presidential speech is about employment or labour
Law and Crime	This example text from a US presidential speech is about law, crime or family issues
Macroeconomics	This example text from a US presidential speech is about macroeconomics
Public Lands	This example text from a US presidential speech is about public lands or water management
Social Welfare	This example text from a US presidential speech is about social welfare
Technology	This example text from a US presidential speech is about space or science or technology or communications
Transportation	This example text from a US presidential speech is about transportation

manifesto

标签	假设
Agriculture and Farmers: Positive	This example text from a political party manifesto is positive towards policies for agriculture and farmers
Anti-Growth Economy: Positive	This example text from a political party manifesto is in favour of anti-growth politics
Anti-Imperialism	This example text from a political party manifesto is anti-imperialistic, for example against controlling other countries and for greater self-government of colonies
Centralisation	This example text from a political party manifesto is in favour of political centralisation
Civic Mindedness: Positive	This example text from a political party manifesto is positive towards national solidarity, civil society or appeals for public spiritedness or against anti-social attitudes
Constitutionalism: Negative	This example text from a political party manifesto is positive towards constitutionalism
Constitutionalism: Positive	This example text from a political party manifesto is positive towards constitutionalism and the status quo of the constitution
Controlled Economy	This example text from a political party manifesto is supportive of direct government control of the economy, e.g. price control or minimum wages
Corporatism/Mixed Economy	This example text from a political party manifesto is positive towards cooperation of government, employers, and trade unions simultaneously
Culture: Positive	This example text from a political party manifesto is in favour of cultural policies or leisure facilities, for example museus, libraries or public sport clubs
Decentralization	This example text from a political party manifesto is for decentralisation or federalism
Democracy	This example text from a political party manifesto favourably mentions democracy or democratic procedures or institutions
Economic Goals	This example text from a political party manifesto is a broad/general statement on economic goals without specifics
Economic Growth: Positive	This example text from a political party manifesto is supportive of economic growth, for example facilitation of more production or government aid for growth
Economic Orthodoxy	This example text from a political party manifesto is for economic orthodoxy, for example reduction of budget deficits, thrift or a strong currency
Economic Planning	This example text from a political party manifesto is positive towards government economic planning, e.g. policy plans or strategies
Education Expansion	This example text from a political party manifesto is about the need to expand/improve policy on education
Education Limitation	This example text from a political party manifesto is sceptical towards state expenditure on education, for example in favour of study fees or private schools
Environmental Protection	This example text from a political party manifesto is in favour of environmental protection, e.g. fighting climate change or 'green' policies or preservation of natural resources or animal rights
Equality: Positive	This example text from a political party manifesto is positive towards equality or social justice, e.g. protection of underprivileged groups or fair distribution of resources
European Community/Union: Negative	This example text from a political party manifesto negatively mentions the EU or European Community
European Community/Union: Positive	This example text from a political party manifesto is positive towards the EU or European Community, for example EU expansion and integration
Foreign Special Relationships: Negative	This example text from a political party manifesto is negative towards particular countries
Foreign Special Relationships: Positive	This example text from a political party manifesto is positive towards particular countries
Free Market Economy	This example text from a political party manifesto is in favour of a free market economy and capitalism
Freedom and Human Rights	This example text from a political party manifesto is in favour of freedom and human rights, for example freedom of speech, assembly or against state coercion or for individualism
Governmental and Administrative Efficiency	This example text from a political party manifesto is in favour of efficiency in government/administration, for example by restructuring civil service or improving bureaucracy
Incentives: Positive	This example text from a political party manifesto is favourable towards supply side economic policies supporting businesses, for example for incentives like subsidies or tax breaks
Internationalism: Negative	This example text from a political party manifesto is sceptical of internationalism, for example negative towards international cooperation, in favour of national sovereignty and unilaterialism
Internationalism: Positive	This example text from a political party manifesto is in favour of international cooperation with other countries, for example mentions the need for aid to developing countries, or global governance
Keynesian Demand Management	This example text from a political party manifesto is for keynesian demand management and demand side economic policies
Labour Groups: Negative	This example text from a political party manifesto is negative towards labour groups and unions
Labour Groups: Positive	This example text from a political party manifesto is positive towards labour groups, for example for good working conditions, fair wages or unions
Law and Order: Positive	This example text from a political party manifesto is positive towards law and order and strict law enforcement
Market Regulation	This example text from a political party manifesto is supports market regulation for a fair and open market, for example for consumer protection or for increased competition or for social market economy
Marxist Analysis	This example text from a political party manifesto is positive towards Marxist-Leninist ideas or uses specific Marxist terminology
Middle Class and Professional Groups	This example text from a political party manifesto favourably references the middle class, e.g. white colar groups or the service sector
Military: Negative	This example text from a political party manifesto is negative towards the military, for example for decreasing military spending or disarmament
Military: Positive	This example text from a political party manifesto is positive towards the military, for example for military spending or rearmament or military treaty obligations
Multiculturalism: Negative	This example text from a political party manifesto is sceptical towards multiculturalism, or for cultural integration or appeals to cultural homogeneity in society
Multiculturalism: Positive	This example text from a political party manifesto favourably mentions cultural diversity, for example for freedom of religion or linguistic heritages
National Way of Life: Negative	This example text from a political party manifesto unfavourably mentions a country's nation and history, for example sceptical towards patriotism or national pride
National Way of Life: Positive	This example text from a political party manifesto is positive towards the national way of life and history, for example pride of citizenship or appeals to patriotism
Nationalisation	This example text from a political party manifesto is positive towards government ownership of industries or land or for economic nationalisation
Non-economic Demographic Groups	This example text from a political party manifesto favourably mentions non-economic demographic groups like women, students or specific age groups
Peace	This example text from a political party manifesto is positive towards peace and peaceful means of solving crises, for example in favour of negotiations and ending wars
Political Authority	This example text from a political party manifesto mentions the speaker's competence to govern or other party's lack of such competence, or favourably mentions a strong/stable government
Political Corruption	This example text from a political party manifesto is negative towards political corruption or abuse of political/bureaucratic power
Protectionism: Negative	This example text from a political party manifesto is negative towards protectionism, in favour of free trade
Protectionism: Positive	This example text from a political party manifesto is in favour of protectionism, for example tariffs, export subsidies
Technology and Infrastructure: Positive	This example text from a political party manifesto is about technology and infrastructure, e.g. the importance of modernisation of industry, or supportive of public spending on infrastructure/tech
Traditional Morality: Negative	This example text from a political party manifesto is negative towards traditional morality, for example against religious moral values, for divorce or abortion, for modern families or separation of church and state
Traditional Morality: Positive	This example text from a political party manifesto is favourable towards traditional or religious values, for example for censorship of immoral behavour, for traditional family values or religious institutions
Underprivileged Minority Groups	This example text from a political party manifesto favourably mentions underprivileged minorities, for example handicapped, homosexuals or immigrants
Welfare State Expansion	This example text from a political party manifesto is positive towards the welfare state, e.g. health care, pensions or social housing
Welfare State Limitation	This example text from a political party manifesto is for limiting the welfare state, for example public funding for social services or social security, e.g. private care before state care

请注意，massive和banking77数据集中的一些行包含nan，因为某些类别过于模糊或不明确，因此在数据中被排除。