🚀 bert-uncased-keyword-extractor
このモデルは、未知のデータセットでbert-base-uncasedをファインチューニングしたものです。評価セットでは以下の結果を達成しています。
- 損失: 0.1247
- 適合率: 0.8547
- 再現率: 0.8825
- 正解率: 0.9741
- F1値: 0.8684
📚 ドキュメント
モデルの説明
詳細情報はありません。
想定される用途と制限
詳細情報はありません。
学習と評価データ
詳細情報はありません。
学習手順
学習ハイパーパラメータ
学習中に以下のハイパーパラメータが使用されました。
- 学習率: 2e-05
- 学習バッチサイズ: 16
- 評価バッチサイズ: 16
- シード: 42
- オプティマイザ: Adam (betas=(0.9,0.999), epsilon=1e-08)
- 学習率スケジューラの種類: 線形
- エポック数: 8
- 混合精度学習: Native AMP
学習結果
学習損失 |
エポック |
ステップ |
検証損失 |
適合率 |
再現率 |
正解率 |
F1値 |
0.165 |
1.0 |
1875 |
0.1202 |
0.7109 |
0.7766 |
0.9505 |
0.7423 |
0.1211 |
2.0 |
3750 |
0.1011 |
0.7801 |
0.8186 |
0.9621 |
0.7989 |
0.0847 |
3.0 |
5625 |
0.0945 |
0.8292 |
0.8044 |
0.9667 |
0.8166 |
0.0614 |
4.0 |
7500 |
0.0927 |
0.8409 |
0.8524 |
0.9711 |
0.8466 |
0.0442 |
5.0 |
9375 |
0.1057 |
0.8330 |
0.8738 |
0.9712 |
0.8529 |
0.0325 |
6.0 |
11250 |
0.1103 |
0.8585 |
0.8743 |
0.9738 |
0.8663 |
0.0253 |
7.0 |
13125 |
0.1204 |
0.8453 |
0.8825 |
0.9735 |
0.8635 |
0.0203 |
8.0 |
15000 |
0.1247 |
0.8547 |
0.8825 |
0.9741 |
0.8684 |
フレームワークのバージョン
- Transformers 4.19.2
- Pytorch 1.11.0+cu113
- Datasets 2.2.2
- Tokenizers 0.12.1
📄 ライセンス
このモデルはApache-2.0ライセンスの下で提供されています。
タグ
評価指標
ウィジェット
- テキスト: "Broadcom agreed to acquire cloud computing company VMware in a $61 billion (€57bn) cash-and stock deal, massively diversifying the chipmaker’s business and almost tripling its software-related revenue to about 45% of its total sales. By the numbers: VMware shareholders will receive either $142.50 in cash or 0.2520 of a Broadcom share for each VMware stock. Broadcom will also assume $8 billion of VMware's net debt."
- テキスト: "Canadian Natural Resources Minister Jonathan Wilkinson told Bloomberg that the country could start supplying Europe with liquefied natural gas (LNG) in as soon as three years by converting an existing LNG import facility on Canada’s Atlantic coast into an export terminal. Bottom line: Wilkinson said what Canada cares about is that the new LNG facility uses a low-emission process for the gas and is capable of transitioning to exporting hydrogen later on."
- テキスト: "Google is being investigated by the UK’s antitrust watchdog for its dominance in the "ad tech stack," the set of services that facilitate the sale of online advertising space between advertisers and sellers. Google has strong positions at various levels of the ad tech stack and charges fees to both publishers and advertisers. A step back: UK Competition and Markets Authority has also been investigating whether Google and Meta colluded over ads, probing into the advertising agreement between the two companies, codenamed Jedi Blue."
- テキスト: "Shares in Twitter closed 6.35% up after an SEC 13D filing revealed that Elon Musk pledged to put up an additional $6.25 billion of his own wealth to fund the $44 billion takeover deal, lifting the total to $33.5 billion from an initial $27.25 billion. In other news: Former Twitter CEO Jack Dorsey announced he's stepping down, but would stay on Twitter’s board \“until his term expires at the 2022 meeting of stockholders.""