Smart-Lemon-Cookie-7B-GGUF Open Source Role-Playing Model - An Excellent Choice for Local AI Chatting, with Strong Inference and Tracking Capabilities

Smart Lemon Cookie 7B GGUF

Developed by backyardai

An uncensored role-playing model based on the GGUF format, with excellent reasoning and context tracking capabilities, suitable for local AI chat applications.

Large Language Model

Transformers

#Local role-playing #Long context reasoning #Uncensored creation

Downloads 811

Release Time : 5/10/2024

Model Overview

This is a model based on the GGUF format, suitable for the local AI chat application Backyard AI. It integrates multiple models to obtain powerful role-playing capabilities and story writing skills, and supports efficient operation on various hardware.

Model Features

Advantages of the GGUF format

Can be split between CPU and GPU, compatible with applications based on llama.cpp, suitable for a wider range of hardware.

Role-playing ability

Integrates multiple models to obtain powerful role-playing capabilities and story writing skills.

Local operation

Supports running on local devices without relying on cloud services.

High context length

Supports a training context of 32768 tokens, suitable for long text generation.

Model Capabilities

Text generation

Role-playing

Story writing

Context tracking

Use Cases

Entertainment

Role-playing chat

Have a role-playing conversation with the AI to experience different storylines.

Provide an immersive role-playing experience.

Story creation

Use the model's story writing skills to generate creative stories.

Generate coherent and creative story content.

Education

Language learning

Practice language expression and writing skills through conversations with the AI.

Improve language expression ability and writing level.

🚀 Smart Lemon Cookie 7B-GGUF

This is the official library of GGUF format models for use in the local AI chat app, Backyard AI, offering high - performance and versatile language interaction.

🚀 Quick Start

Click here to download Backyard AI and start using it.
If you need additional models, you can make a request at r/LLM_Quants.

✨ Features

Model Features

Creator: FallenMerick
Original Model: Smart Lemon Cookie 7B
Creation Date: 2024 - 04 - 30
Trained Context: 32768 tokens
Description: An uncensored role - play model from FallenMerick with excellent reasoning and context - following abilities. It is based on the Multi - Verse - Model and merges Silicon Maid and Kunoichi for strong role - playing ability, and LemonadeRP for story - writing skill.

GGUF Format Features

GGUF is a large language model (LLM) format that can be split between CPU and GPU. GGUFs are compatible with applications based on llama.cpp, such as Backyard AI. While other model formats require higher - end GPUs with ample VRAM, GGUFs can be efficiently run on a wider variety of hardware.

GGUF models are quantized to reduce resource usage, with a trade - off of reduced coherence at lower quantizations. Quantization reduces the precision of the model weights by changing the number of bits used for each weight.

Backyard AI Features

Free and Local: It is a free, local AI chat application.
Easy Installation: One - click installation on Mac and PC.
GPU Acceleration: Automatically uses the GPU for maximum speed.
Model Manager: Comes with a built - in model manager.
Character Hub: Has a high - quality character hub.
Tethering: Zero - config desktop - to - mobile tethering.

Backyard AI makes it easy to start chatting with AI using your own characters or one of the many found in the built - in character hub. The model manager helps you find the latest and greatest models without worrying about whether it's the correct format. Backyard AI supports advanced features such as lorebooks, author's note, text formatting, custom context size, sampler settings, grammars, local TTS, cloud inference, and tethering, all implemented in a straightforward and reliable way.

Join us on Discord

📚 Documentation

Model Information Table

Property	Details
Library Name	transformers
Tags	mergekit, merge, mistral, text - generation
Base Model	FallenMerick/Smart - Lemon - Cookie - 7B
Model Name	Smart - Lemon - Cookie - 7B - GGUF
Quantized By	brooketh

Images

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご