Plamo 2 Translate

🚀 PLaMo Translation Model

PLaMo Translation Model is a specialized large - scale language model developed by Preferred Networks for translation tasks. It offers solutions for translation needs and provides multiple model options for users.

🚀 Quick Start

PLaMo Translation Model is a specialized large - scale language model developed by Preferred Networks for translation tasks. For details, please refer to the blog post and press release.

List of models

• plamo - 2 - translate ... Post - trained model for translation
• plamo - 2 - translate - base ... Base model for translation
• plamo - 2 - translate - eval ... Pair - wise evaluation model

PLaMo Translation Model is released under PLaMo community license. Please check the following license and agree to this before downloading.

• (EN) under construction: we apologize for the inconvenience
• (JA) https://www.preferred.jp/ja/plamo-community-license/

⚠️ Important Note

This model has NOT been instruction - tuned for chat dialog or other downstream tasks.

💡 Usage Tip

For commercial users, please check the PLaMo community license and contact us via the following form to use for commercial purposes.

• (EN/JA) https://forms.gle/mTL8tBLrMYXKNZD56

💻 Usage Examples

Basic Usage

Main/Base model

import vllm

# max_model_len/max_num_batched_tokens can be increased when running on a GPU with substantial memory.
# NOTE: Switch to "pfnet/plamo-2-translate-base" to try the base model.
llm = vllm.LLM(model="pfnet/plamo-2-translate", trust_remote_code=True, max_model_len=2000, max_num_batched_tokens=2000)

prompt = r'''<|plamo:op|>dataset
translation
<|plamo:op|>input lang=English
Write the text to be translated here.
<|plamo:op|>output lang=Japanese
'''

responses = llm.generate([prompt] * 1, sampling_params=vllm.SamplingParams(temperature=0, max_tokens=1024, stop=["<|plamo:op|>"]))
# NOTE: This outputs "ここに翻訳するテキストを入力してください。".
print(responses[0].outputs[0].text)

Evaluation model

import vllm

# max_model_len/max_num_batched_tokens can be increased when running on a GPU with substantial memory.
llm = vllm.LLM(model="pfnet/plamo-2-translate-eval", trust_remote_code=True, max_model_len=2000, max_num_batched_tokens=2000)

prompt = r'''<|plamo:op|>dataset
translation evaluation
<|plamo:op|>input lang=English
This is an apple.
<|plamo:op|>output id=A lang=Japanese
これはりんごです。
<|plamo:op|>output id=B lang=Japanese
これはリンゴです。
<|plamo:op|>best
id='''

responses = llm.generate([prompt] * 1, sampling_params=vllm.SamplingParams(temperature=0, max_tokens=1, stop=["<|plamo:op|>"]))
# NOTE: This outputs "A".
print(responses[0].outputs[0].text)

📚 Documentation

Bias, Risks, and Limitations

PLaMo Translation Model is a new technology that carries risks with use. Testing conducted to date has been in English and Japanese, and has not covered, nor could it cover all scenarios. For these reasons, as with all LLMs, PLaMo Translation Model’s potential outputs cannot be predicted in advance, and the model may in some instances produce inaccurate, biased or other objectionable responses to user prompts. Therefore, before deploying any applications of PLaMo Translation Model, developers should perform safety testing and tuning tailored to their specific applications of the model.

Acknowledgement

This model is trained under the project, “Research and Development Project of the Enhanced Infrastructures for Post 5G Information and Communication System” (JPNP 20017), subsidized by the New Energy and Industrial Technology Development Organization (NEDO).

AI policies for Preferred Networks, Inc. group

• (EN) https://www.preferred.jp/en/company/aipolicy/
• (JA) https://www.preferred.jp/ja/company/aipolicy/

📄 License

To download PLaMo 2 8B, you have to agree to our license. PLaMo 2 8B is released under the PLaMo community license. For non - commercial use, please contact us via this form.

The PLaMo community license details are as follows: (English version is under construction. We apologize for the inconvenience.)

PLaMo Community License Agreement

The PLaMo Community License Agreement stipulates the content of the license for using the large - scale language foundation model PLaMo and its derivatives provided by Preferred Networks, Inc., as well as matters that users must comply with. This agreement applies to users' use of PLaMo and its derivatives, and by agreeing to this agreement or using this model, users are bound by this agreement.

Article 1 (Definitions)

(1) "This Agreement" refers to the PLaMo Community License Agreement. (2) "PFN" refers to Preferred Networks, Inc. (3) "This Model" refers to the weights, model code, tokenizer, training scripts of the model named "PLaMo" as separately defined, and those provided by PFN accompanying them. (4) "User" refers to an individual or legal entity that uses this model. (5) "Derivative Model" refers to the weights, model code, and other accompanying items of the model created by modifying or using this model. (6) "Product" refers to the output results of this model or derivative models. (7) "This Model, etc." is a general term for this model, derivative models, and products. (8) "This License" means that PFN permits users to use this model, etc. based on this agreement within the conditions and scope stipulated in this agreement. (9) "Commercial Purpose" refers to the use in business or for profit beyond the scope of private use or academic purposes. Commercial purposes also include the use for the development, modification, or provision (including hosting services and provision via API) of users' products, services, or businesses, as well as the use within users' organizations.

Article 2 (Users)

Users must be 18 years old or older or have reached the age at which they can conclude a contract independently in their country of residence. However, this does not apply if the user's legal guardian or legal representative agrees to the user concluding this agreement.

Article 3 (This License)

(1) PFN permits users to use this model, etc. within the conditions and scope stipulated in this agreement, provided that users agree to this agreement and comply with it. (2) This license is non - exclusive, worldwide, non - assignable, and royalty - free. (3) Users can use this model, etc. for commercial purposes only if they meet all of the following conditions. If a user fails to meet any of these conditions, the user cannot use this model, etc. for commercial purposes from that point on. If the user wishes to use this model, etc. for commercial purposes, they must obtain a commercial license from PFN anew. (i) Register in advance on PFN's official registration page https://forms.gle/mTL8tBLrMYXKNZD56. (ii) The income or sales of the user or its affiliated company in the most recent business year do not exceed 1 billion yen (converted to the user's local currency).

Article 4 (Redistribution and Display Obligations)

(1) When a user provides this model, etc. (including derivative models and their products) to a third party, the following conditions must be met: (i) Provide a copy of this agreement and ensure compliance with the terms of this agreement. (ii) Clearly state "Built with PLaMo" and include it on the relevant website, user interface, blog post, product information page, or product documentation. (iii) Include "PLaMo" in the name of the AI model created using this model, etc.

Article 5 (Use of Products)

(1) Users can publish products on the condition that they clearly indicate that the products are from this model or derivative models. (2) When a model is trained using products, the model is considered a derivative model, and the terms of this agreement apply. It can only be used, distributed, and commercialized under the license conditions of this agreement.

Article 6 (Other Usage Conditions)

Users must not engage in the following acts regarding the use of this model, etc.: (1) Acts that violate laws, regulations, or public order and good morals. (2) Criminal acts or acts related to预告, involvement, promotion, etc. of criminal acts. (3) Acts that infringe on the rights or interests of PFN or third parties. (4) Acts that damage the reputation or credit of PFN or third parties. (5) Acts of spreading information that causes the misunderstanding that the products are PFN's official views, etc. (6) Acts of transmitting false information. (7) Other acts that PFN reasonably deems inappropriate.

Article 7 (Disclaimer of Warranty)

(1) This model and products are provided "as is," and PFN does not provide any warranties regarding their accuracy, authenticity, merchantability, quality, performance, suitability for a specific purpose, non - infringement of rights, etc. (2) Users must not use products as the sole evidence, evaluation, or opinion for decisions regarding important matters such as law, medicine, finance, or personnel evaluation. (3) Users are fully responsible for the use of this model, etc. and its results.

Article 8 (Limitation of Liability)

(1) Regardless of whether it is contractual liability, tort liability, product liability, or other legal liability, PFN's liability for compensation for damages to users regarding this agreement and this model, etc. is limited to ordinary and direct damages (PFN is not liable for lost profits, special damages, indirect damages, etc., regardless of foreseeability). The upper limit of the compensation amount is 500 yen. However, this does not apply if PFN is found to have intentional or gross negligence. (2) Notwithstanding the above paragraph, if a user uses this model, etc. for business purposes, PFN is not liable for any compensation for damages or other liabilities to the user regarding this agreement and this model, etc.

Article 9 (User's Liability)

(1) Users must comply with applicable laws and regulations (including those related to import/export and trade) and this agreement regarding the acquisition and use of this model, etc. (2) If a user causes damage to PFN due to a breach of this agreement or the use of this model, etc., the user must compensate for the damage. (3) If PFN receives a claim for compensation for damages or other claims from a third party due to the user's use of this model, etc., the user must indemnify PFN from such claims and ensure that PFN is not damaged.

Article 10 (Ownership of Rights)

(1) All rights to this model belong to PFN or a third party that has licensed this model to PFN. (2) Among derivative models, the rights to the part modified by the user from this model belong to the user, and the rights to other parts belong to PFN. (3) All rights to products belong to the user.

Article 11 (Contract Term and Termination)

(1) This agreement is in effect from the time the user agrees to this agreement or accesses this model until this agreement is terminated. (2) If a user violates any clause of this agreement, PFN can immediately terminate this agreement, and the user must delete all copies of this model, etc. and immediately stop using them.

Article 12 (Modification of the Agreement)

PFN can modify this agreement (including rules and regulations regarding this model, etc.). When PFN modifies this agreement, it shall notify the content of the modification and the effective date of the modification by a method specified by PFN before the effective date.

Article 13 (Governing Law and Jurisdiction)

(1) The governing law of this agreement is Japanese law. (2) For disputes arising from this model, etc. and this agreement, the Tokyo District Court shall be the exclusive agreed - upon jurisdiction.