# DPO fine-tuning optimization

A fine-tuned model based on Llama-3-8b, optimized using the Gutenberg DPO dataset, suitable for text generation tasks.

Excalibur-7b-DPO is a large language model based on the Excalibur-7b foundation model, fine-tuned with Direct Preference Optimization (DPO), focusing on improving dialogue quality and performance in visual application scenarios.

A large language model fine-tuned on the truthy-dpo-v0.1 dataset based on the WestLake-7B-v2-laser model, specializing in text generation tasks and demonstrating excellent performance in multiple benchmarks.

TinyMistral-248M-Chat is a chat model fine-tuned based on TinyMistral-248M, supporting multi-turn conversations and suitable for various dialogue scenarios.

TinyMistral-248M-Chat is a chat model based on TinyMistral-248M, trained and optimized on multiple datasets, suitable for various conversational tasks.