Codeswitch Spaeng Lid Lince

🚀 codeswitch-spaeng-lid-lince

This is a pre - trained model for language identification of Spanish - English code - mixed data. It utilizes data from LinCE to achieve accurate language identification.

🚀 Quick Start

This pre - trained model is designed for the language identification of spanish - english code - mixed data sourced from LinCE. It is trained based on the following repository: https://github.com/sagorbrur/codeswitch.

📦 Installation

To install codeswitch, you can use the following command:

pip install codeswitch

💻 Usage Examples

Basic Usage

There are two methods to identify the language using this model.

Method - 1

from codeswitch.codeswitch import LanguageIdentification
lid = LanguageIdentification('spa-eng') 
text = "" # your code-mixed sentence 
result = lid.identify(text)
print(result)

Method - 2

from transformers import AutoTokenizer, AutoModelForTokenClassification, pipeline

tokenizer = AutoTokenizer.from_pretrained("sagorsarker/codeswitch-spaeng-lid-lince")

model = AutoModelForTokenClassification.from_pretrained("sagorsarker/codeswitch-spaeng-lid-lince")
lid_model = pipeline('ner', model=model, tokenizer=tokenizer)

lid_model("put any spanish english code-mixed sentence")

📄 License

This project is licensed under the MIT license.