🚀 jobBERT-de
This is a domain-adapted transformer-based language model tailored for German-speaking job advertisements. It addresses the need for a specialized model in the job advertisement domain, offering more accurate language processing for this specific context.
🚀 Quick Start
The model can be used for masked language modeling. However, it is primarily designed to be fine - tuned on a downstream task.
✨ Features
- Domain Adaptation: Adapted to the job advertisement domain through continued in - domain pretraining on 4 million German - speaking job ads from Switzerland (1990 - 2020, 5.9 GB data).
- Vocabulary Enhancement: Empty spots in the base model's vocabulary are filled with frequently used domain - specific words, subtokens, and abbreviations.
📦 Installation
No installation steps were provided in the original README, so this section is skipped.
💻 Usage Examples
No code examples were provided in the original README, so this section is skipped.
📚 Documentation
Overview
| Property |
Details |
| Model Type |
BERT base |
| Language |
German |
| Domain |
Job advertisements |
| Related Model |
agne/jobGBERT |
Intended usage and limitations
⚠️ Important Note
The model is trained on German - speaking job ads from Switzerland. It inherits potential bias from its base model and may contain biases and stereotypes common in job advertisements.
💡 Usage Tip
You can use the model for masked language modeling, but it is intended to be fine - tuned on a downstream task.
License
This model is released under the Creative Commons Attribution - NonCommercial - ShareAlike 4.0 International License (cc - by - nc - sa - 4.0).
Please use the following citation when using our model:
@inproceedings{
title = "Evaluation of Transfer Learning and Domain Adaptation for Analyzing German-Speaking Job Advertisements",
author = "Gnehm, Ann-Sophie and
Bühlmann, Eva and
Clematide, Simon",
booktitle = "Proceedings of the 13th Language Resources and Evaluation Conference",
month = june,
year = "2022",
address = "Marseille, France",
publisher = "European Language Resources Association",
}
About us
Ann - Sophie Gnehm: gnehm [at] soziologie.uzh.ch
Eva Bühlmann: bühlmann [at] soziologie.uzh.ch
Simon Clematide: simon.clematide [at] cl.uzh.ch
The Swiss Job Market Monitor aims to systematically expand scientific knowledge about the job market and improve labor market transparency by informing the general public about current developments on the job market.
Get in touch: Mail Website Zenodo SWISSUbase
🔧 Technical Details
No technical implementation details were provided in the original README, so this section is skipped.
📄 License
This model is released under the Creative Commons Attribution - NonCommercial - ShareAlike 4.0 International License (cc - by - nc - sa - 4.0).
%20--%3e%3cdefs%3e%3cstyle%3e%20.st0%20{%20fill:%20%23061b40;%20}%20.st1%20{%20fill:%20%23306af1;%20}%20.st2%20{%20fill:%20%235ce5cf;%20}%20%3c/style%3e%3c/defs%3e%3cg%3e%3cpath%20class='st0'%20d='M55,10.5h9v3h-9v9h12V7.5h-12v3ZM64,19.5h-6v-3h6v3Z'/%3e%3cpolygon%20class='st0'%20points='69%2016.5%2078%2016.5%2078%2019.5%2069%2019.5%2069%2022.5%2081%2022.5%2081%2013.5%2072%2013.5%2072%2010.5%2081%2010.5%2081%207.5%2069%207.5%2069%2016.5'/%3e%3cpolygon%20class='st0'%20points='95%2010.5%2095%207.5%2083%207.5%2083%2022.5%2095%2022.5%2095%2019.5%2086%2019.5%2086%2016.5%2095%2016.5%2095%2013.5%2086%2013.5%2086%2010.5%2095%2010.5'/%3e%3cpath%20class='st0'%20d='M40,1.5v21h11.6l1.4-1.4v-7.6h0c0,0-1.4-1.5-1.4-1.5l1.4-1.4V2.9l-1.4-1.4h-11.6ZM50,19.5h-7v-6h7v6ZM50,10.5h-7v-6h7v6Z'/%3e%3c/g%3e%3cpath%20class='st1'%20d='M23.1,24L14.7,4.8l-4.9,11.2h3.8l-1.8,4H3.3L12.1,0H2C.9,0,0,.9,0,2v20c0,1.1.9,2,2,2h21.1Z'/%3e%3cpath%20class='st2'%20d='M34,0h-16.8l10.6,24h6.2c1.1,0,2-.9,2-2V2C36,.9,35.1,0,34,0ZM32.5,20h-4V4h4v16Z'/%3e%3c/svg%3e)
