Orca 2 13b SFT V4

🚀 微调版Orca-2-13b模型

本项目是对“microsoft/Orca-2-13b”模型进行全量微调后的成果。该模型在多个数据集上进行训练，能提供高质量的文本生成服务，在Open LLM Leaderboard中也取得了不错的成绩。

🚀 快速开始

使用此模型前，请确保遵守微软的研究许可协议，使用前请仔细阅读协议内容。该模型基于ChatML提示模板进行训练。

推理API生成回复时使用的采样参数如下：

• temperature = 0.1
• top_p = 0.14
• top_k = 41
• repetition_penalty = 1.176

✨ 主要特性

• 多语言支持：支持英语、法语、西班牙语、印地语、中文等多种语言，以及代码语言。
• 优质数据集训练：在HuggingFaceH4/no_robots、mlabonne/guanaco-llama2-1k、OpenAssistant/oasst_top1_2023-08-25、totally-not-an-llm/EverythingLM-data-V3等数据集上进行全量微调，测试损失低至0.18。
• 排行榜成绩优异：在Open LLM Leaderboard的llama2 - 13b模型中排名第5。

📦 安装指南

文档未提供安装步骤，暂不展示。

💻 使用示例

基础用法

以下是模型在不同问题上的回复示例：

民间传说示例

<|im_start|>user
Are the stories of Nahanni Valley, like the decapitated men, true?
<|im_end|>
<|im_start|>assistant
The Nahanni Valley in Canada is a remote and rugged region that has long been shrouded in mystery. It is home to the South Nahanni River, which was designated as a UNESCO World Heritage Site due to its exceptional natural beauty and biodiversity. The valley's history includes tales of gold prospectors, fur traders, and indigenous populations, but it also features some unexplained events and legends. One such story involves two prospectors who allegedly encountered an unknown creature that led them into the forest before returning without their heads. This tale has been passed down through generations, but there are no definitive answers regarding its veracity.

It is important to note that these stories may have originated from local folklore or were exaggerated over time. There is no concrete evidence to support the existence of supernatural creatures or paranormal occurrences within the Nahanni Valley. Nonetheless, the area remains a captivating destination for those seeking adventure and exploration. If you have any questions about this topic or need assistance related to traveling to the Nahanni Valley, please feel free to ask!

艾伦·图灵示例

<|im_start|>user
Why was Alan Turing castrated?
<|im_end|>
<|im_start|>assistant
Alan Turing, a renowned mathematician and computer scientist who played a crucial role in breaking the German Enigma code during World War II, faced significant challenges due to his homosexuality. In 1952, he was convicted of "gross indecency" for engaging in a consensual relationship with another man, which led to him being sentenced to hormone therapy designed to reduce his sex drive. This treatment included the administration of estrogen, which had the side effect of causing breast growth.

In an effort to avoid this unwanted physical change, Turing requested that his doctors cease the hormone treatments. However, they ignored his request and continued the therapy without his consent. As a result, Turing's breasts began to grow, leading him to undergo surgery to remove them. The operation, known as a mastectomy, caused considerable pain and discomfort, further contributing to his emotional turmoil.

It is important to note that Turing's castration was not directly carried out by the authorities but rather resulted from the unintended consequences of the forced hormone therapy.

高级用法

文档未提供高级用法示例，暂不展示。

📚 详细文档

文档未提供详细说明，暂不展示。

🔧 技术细节

文档未提供技术实现细节，暂不展示。

📄 许可证

该模型使用其他许可证，请遵守微软的研究许可协议。