Orca 2 13b SFT V4

🚀 微調版Orca-2-13b模型

本項目是對“microsoft/Orca-2-13b”模型進行全量微調後的成果。該模型在多個數據集上進行訓練，能提供高質量的文本生成服務，在Open LLM Leaderboard中也取得了不錯的成績。

🚀 快速開始

使用此模型前，請確保遵守微軟的研究許可協議，使用前請仔細閱讀協議內容。該模型基於ChatML提示模板進行訓練。

推理API生成回覆時使用的採樣參數如下：

• temperature = 0.1
• top_p = 0.14
• top_k = 41
• repetition_penalty = 1.176

✨ 主要特性

• 多語言支持：支持英語、法語、西班牙語、印地語、中文等多種語言，以及代碼語言。
• 優質數據集訓練：在HuggingFaceH4/no_robots、mlabonne/guanaco-llama2-1k、OpenAssistant/oasst_top1_2023-08-25、totally-not-an-llm/EverythingLM-data-V3等數據集上進行全量微調，測試損失低至0.18。
• 排行榜成績優異：在Open LLM Leaderboard的llama2 - 13b模型中排名第5。

📦 安裝指南

文檔未提供安裝步驟，暫不展示。

💻 使用示例

基礎用法

以下是模型在不同問題上的回覆示例：

民間傳說示例

<|im_start|>user
Are the stories of Nahanni Valley, like the decapitated men, true?
<|im_end|>
<|im_start|>assistant
The Nahanni Valley in Canada is a remote and rugged region that has long been shrouded in mystery. It is home to the South Nahanni River, which was designated as a UNESCO World Heritage Site due to its exceptional natural beauty and biodiversity. The valley's history includes tales of gold prospectors, fur traders, and indigenous populations, but it also features some unexplained events and legends. One such story involves two prospectors who allegedly encountered an unknown creature that led them into the forest before returning without their heads. This tale has been passed down through generations, but there are no definitive answers regarding its veracity.

It is important to note that these stories may have originated from local folklore or were exaggerated over time. There is no concrete evidence to support the existence of supernatural creatures or paranormal occurrences within the Nahanni Valley. Nonetheless, the area remains a captivating destination for those seeking adventure and exploration. If you have any questions about this topic or need assistance related to traveling to the Nahanni Valley, please feel free to ask!

艾倫·圖靈示例

<|im_start|>user
Why was Alan Turing castrated?
<|im_end|>
<|im_start|>assistant
Alan Turing, a renowned mathematician and computer scientist who played a crucial role in breaking the German Enigma code during World War II, faced significant challenges due to his homosexuality. In 1952, he was convicted of "gross indecency" for engaging in a consensual relationship with another man, which led to him being sentenced to hormone therapy designed to reduce his sex drive. This treatment included the administration of estrogen, which had the side effect of causing breast growth.

In an effort to avoid this unwanted physical change, Turing requested that his doctors cease the hormone treatments. However, they ignored his request and continued the therapy without his consent. As a result, Turing's breasts began to grow, leading him to undergo surgery to remove them. The operation, known as a mastectomy, caused considerable pain and discomfort, further contributing to his emotional turmoil.

It is important to note that Turing's castration was not directly carried out by the authorities but rather resulted from the unintended consequences of the forced hormone therapy.

高級用法

文檔未提供高級用法示例，暫不展示。

📚 詳細文檔

文檔未提供詳細說明，暫不展示。

🔧 技術細節

文檔未提供技術實現細節，暫不展示。

📄 許可證

該模型使用其他許可證，請遵守微軟的研究許可協議。