span-marker-xlm-roberta-base-fewnerd-fine-superオープンソースモデル

ホーム

Span Marker Xlm Roberta Base Fewnerd Fine Super

tomaarsenによって開発

これはFewNERDデータセットで訓練されたSpanMarkerモデルで、多言語の固有表現認識タスクに使用され、xlm-roberta-baseエンコーダに基づいています。

シーケンスラベリング #多言語エンティティ認識 #細粒度NER #クロスドメインエンティティ抽出

ダウンロード数 148

リリース時間 : 6/15/2023

モデル概要

このモデルはSpanMarkerアーキテクチャを採用し、固有表現認識（NER）タスクに特化しており、英語と多言語のテキスト処理をサポートします。

モデル特徴

多言語サポート

xlm-roberta-baseエンコーダに基づいており、英語と多言語のテキスト処理をサポートします。

細粒度エンティティ認識

芸術、建築、イベント、場所、組織など、66種類の異なるタイプのエンティティを識別できます。

SpanMarkerアーキテクチャ

SpanMarkerアーキテクチャを採用し、固有表現認識タスクに最適化されています。

モデル能力

固有表現認識

多言語テキスト処理

細粒度エンティティ分類

使用事例

情報抽出

ニュース記事のエンティティ認識

ニュース記事から人名、地名、組織名などのエンティティを抽出します。

F1スコア0.6885

学術文献分析

科研論文内の化学物質、生物学用語などの専門エンティティを識別します。

化学物質のF1スコア0.5832、生物学用語のF1スコア0.6497

ビジネスインテリジェンス

会社名認識

商業文書から会社名と組織情報を抽出します。

F1スコア0.6917

製品認識

テキスト内で言及されている製品名とタイプを識別します。

自動車製品のF1スコア0.7234、航空機製品のF1スコア0.6464

🚀 FewNERD上のxlm - roberta - baseを使用したSpanMarker

このモデルは、固有表現認識（Named Entity Recognition）に使用できるSpanMarkerモデルで、FewNERDデータセットで学習されています。このSpanMarkerモデルは、基礎となるエンコーダとして[xlm - roberta - base](https://huggingface.co/xlm - roberta - base)を使用しています。

🚀 クイックスタート

このモデルは、固有表現認識タスクに使用できます。以下のウィジェットを使って、様々な言語での固有表現認識の結果を確認できます。

✨ 主な機能

複数言語（英語を含む）に対応した固有表現認識が可能です。
広範な固有表現のラベルを認識できます。

📚 ドキュメント

モデルの詳細

モデルの説明

属性	詳情
モデルタイプ	SpanMarker
エンコーダ	[xlm - roberta - base](https://huggingface.co/xlm - roberta - base)
最大シーケンス長	256トークン
最大エンティティ長	8単語
学習データセット	[FewNERD](https://huggingface.co/datasets/DFKI - SLT/few - nerd)
言語	en, 多言語
ライセンス	cc - by - sa - 4.0

モデルのソース

リポジトリ：GitHub上のSpanMarker
論文：SpanMarker For Named Entity Recognition

モデルのラベル

ラベル	例
art - broadcastprogram	"The Gale Storm Show : Oh , Susanna", "Corazones", "Street Cents"
art - film	"L'Atlantide", "Shawshank Redemption", "Bosch"
art - music	"Hollywood Studio Symphony", "Atkinson , Danko and Ford ( with Brockie and Hilton )", "Champion Lover"
art - other	"Venus de Milo", "Aphrodite of Milos", "The Today Show"
art - painting	"Cofiwch Dryweryn", "Production/Reproduction", "Touit"
art - writtenart	"The Seven Year Itch", "Time", "Imelda de ' Lambertazzi"
building - airport	"Newark Liberty International Airport", "Luton Airport", "Sheremetyevo International Airport"
building - hospital	"Hokkaido University Hospital", "Yeungnam University Hospital", "Memorial Sloan - Kettering Cancer Center"
building - hotel	"Radisson Blu Sea Plaza Hotel", "The Standard Hotel", "Flamingo Hotel"
building - library	"British Library", "Berlin State Library", "Bayerische Staatsbibliothek"
building - other	"Communiplex", "Henry Ford Museum", "Alpha Recording Studios"
building - restaurant	"Fatburger", "Carnegie Deli", "Trumbull"
building - sportsfacility	"Boston Garden", "Glenn Warner Soccer Facility", "Sports Center"
building - theater	"Pittsburgh Civic Light Opera", "National Paris Opera", "Sanders Theatre"
event - attack/battle/war/militaryconflict	"Jurist", "Easter Offensive", "Vietnam War"
event - disaster	"1693 Sicily earthquake", "1990s North Korean famine", "the 1912 North Mount Lyell Disaster"
event - election	"March 1898 elections", "Elections to the European Parliament", "1982 Mitcham and Morden by - election"
event - other	"Eastwood Scoring Stage", "Union for a Popular Movement", "Masaryk Democratic Movement"
event - protest	"Russian Revolution", "French Revolution", "Iranian Constitutional Revolution"
event - sportsevent	"World Cup", "Stanley Cup", "National Champions"
location - GPE	"Mediterranean Basin", "Croatian", "the Republic of Croatia"
location - bodiesofwater	"Norfolk coast", "Atatürk Dam Lake", "Arthur Kill"
location - island	"Laccadives", "Staten Island", "new Samsat district"
location - mountain	"Ruweisat Ridge", "Miteirya Ridge", "Salamander Glacier"
location - other	"Victoria line", "Northern City Line", "Cartuther"
location - park	"Painted Desert Community Complex Historic District", "Shenandoah National Park", "Gramercy Park"
location - road/railway/highway/transit	"Newark - Elizabeth Rail Link", "NJT", "Friern Barnet Road"
organization - company	"Church 's Chicken", "Texas Chicken", "Dixy Chicken"
organization - education	"MIT", "Belfast Royal Academy and the Ulster College of Physical Education", "Barnard College"
organization - government/governmentagency	"Congregazione dei Nobili", "Diet", "Supreme Court"
organization - media/newspaper	"TimeOut Melbourne", "Al Jazeera", "Clash"
organization - other	"IAEA", "4th Army", "Defence Sector C"
organization - politicalparty	"Al Wafa ' Islamic", "Shimpot≈ç", "Kenseit≈ç"
organization - religion	"UPCUSA", "Jewish", "Christian"
organization - showorganization	"Bochumer Symphoniker", "Mr. Mister", "Lizzy"
organization - sportsleague	"First Division", "NHL", "China League One"
organization - sportsteam	"Tottenham", "Arsenal", "Luc Alphand Aventures"
other - astronomything	"Algol", "Zodiac", "`` Caput Larvae ''"
other - award	"Grand Commander of the Order of the Niger", "Order of the Republic of Guinea and Nigeria", "GCON"
other - biologything	"Amphiphysin", "BAR", "N - terminal lipid"
other - chemicalthing	"carbon dioxide", "sulfur", "uranium"
other - currency	"$", "lac crore", "Travancore Rupee"
other - disease	"hypothyroidism", "bladder cancer", "French Dysentery Epidemic of 1779"
other - educationaldegree	"Master", "Bachelor", "BSc ( Hons ) in physics"
other - god	"El", "Fujin", "Raijin"
other - language	"Breton - speaking", "Latin", "English"
other - law	"United States Freedom Support Act", "Thirty Years ' Peace", "Leahy‚ÄìSmith America Invents Act ( AIA"
other - livingthing	"insects", "patchouli", "monkeys"
other - medical	"amitriptyline", "pediatrician", "Pediatrics"
person - actor	"Tch√©ky Karyo", "Edmund Payne", "Ellaline Terriss"
person - artist/author	"George Axelrod", "Hicks", "Gaetano Donizett"
person - athlete	"Jaguar", "Neville", "Tozawa"
person - director	"Richard Quine", "Frank Darabont", "Bob Swaim"
person - other	"Campbell", "Richard Benson", "Holden"
person - politician	"Rivi√®re", "Emeric", "William"
person - scholar	"Stedman", "Wurdack", "Stalmine"
person - soldier	"Joachim Ziegler", "Krukenberg", "Helmuth Weidling"
product - airplane	"EC135T2 CPDS", "Spey - equipped FGR.2s", "Luton"
product - car	"Phantom", "Corvettes - GT1 C6R", "100EX"
product - food	"V. labrusca", "red grape", "yakiniku"
product - game	"Hardcore RPG", "Airforce Delta", "Splinter Cell"
product - other	"PDP - 1", "Fairbottom Bobs", "X11"
product - ship	"Essex", "Congress", "HMS `` Chinkara ''"
product - software	"Wikipedia", "Apdf", "AmiPDF"
product - train	"55022", "Royal Scots Grey", "High Speed Trains"

評価

メトリクス

ラベル	精度	再現率	F1値
全て	0.6890	0.6879	0.6885
art - broadcastprogram	0.6	0.5771	0.5883
art - film	0.7384	0.7453	0.7419
art - music	0.7930	0.7221	0.7558
art - other	0.4245	0.2900	0.3446
art - painting	0.5476	0.4035	0.4646
art - writtenart	0.6400	0.6539	0.6469
building - airport	0.8219	0.8242	0.8230
building - hospital	0.7024	0.8104	0.7526
building - hotel	0.7175	0.7283	0.7228
building - library	0.74	0.7296	0.7348
building - other	0.5828	0.5910	0.5869
building - restaurant	0.5525	0.5216	0.5366
building - sportsfacility	0.6187	0.7881	0.6932
building - theater	0.7067	0.7626	0.7336
event - attack/battle/war/militaryconflict	0.7544	0.7468	0.7506
event - disaster	0.5882	0.5314	0.5584
event - election	0.4167	0.2198	0.2878
event - other	0.4902	0.4042	0.4430
event - protest	0.3643	0.2831	0.3186
event - sportsevent	0.6125	0.6239	0.6182
location - GPE	0.8102	0.8553	0.8321
location - bodiesofwater	0.6888	0.7725	0.7282
location - island	0.7285	0.6440	0.6836
location - mountain	0.7129	0.7327	0.7227
location - other	0.4376	0.2560	0.3231
location - park	0.6991	0.6900	0.6945
location - road/railway/highway/transit	0.6936	0.7259	0.7094
organization - company	0.6921	0.6912	0.6917
organization - education	0.7838	0.7963	0.7900
organization - government/governmentagency	0.5363	0.4394	0.4831
organization - media/newspaper	0.6215	0.6705	0.6451
organization - other	0.5766	0.5157	0.5444
organization - politicalparty	0.6449	0.7324	0.6859
organization - religion	0.5139	0.6057	0.5560
organization - showorganization	0.5620	0.5657	0.5638
organization - sportsleague	0.6348	0.6542	0.6443
organization - sportsteam	0.7138	0.7566	0.7346
other - astronomything	0.7418	0.7625	0.752
other - award	0.7291	0.6736	0.7002
other - biologything	0.6735	0.6275	0.6497
other - chemicalthing	0.6025	0.5651	0.5832
other - currency	0.6843	0.8411	0.7546
other - disease	0.6284	0.7089	0.6662
other - educationaldegree	0.5856	0.6033	0.5943
other - god	0.6089	0.6913	0.6475
other - language	0.6608	0.7968	0.7225
other - law	0.6693	0.7246	0.6958
other - livingthing	0.6070	0.6014	0.6042
other - medical	0.5062	0.5113	0.5088
person - actor	0.8274	0.7673	0.7962
person - artist/author	0.6761	0.7294	0.7018
person - athlete	0.8132	0.8347	0.8238
person - director	0.675	0.6823	0.6786
person - other	0.6472	0.6388	0.6429
person - politician	0.6621	0.6593	0.6607
person - scholar	0.5181	0.5007	0.5092
person - soldier	0.4750	0.5131	0.4933
product - airplane	0.6230	0.6717	0.6464
product - car	0.7293	0.7176	0.7234