Galactica-6.7B-EssayWriter: An Open-Source Large Model for Essay Writing - Helps Complete Various Kinds of Article Creations

Galactica 6.7B EssayWriter

Developed by KnutJaegersberg

A 6.7 billion parameter large language model based on the Galactica architecture, specializing in essay writing tasks, with an average score of 37.75 on the Open LLM Leaderboard.

Large Language Model

Transformers

#Essay Writing Assistance #Few-shot Learning #Academic Text Generation

Downloads 105

Release Time : 11/20/2023

Model Overview

This model is a text generation model optimized based on the Galactica architecture, specifically fine-tuned for essay writing tasks, capable of generating structured text content based on instructions.

Model Features

Instruction Fine-tuning

Specially optimized for essay writing tasks, capable of understanding and executing writing instructions.

Medium-scale Parameters

A balanced design with 6.7 billion parameters, ensuring both generation quality and computational efficiency.

Multi-task Evaluation

Performs consistently across multiple benchmark tests on the Open LLM Leaderboard.

Model Capabilities

Instruction-driven text generation

Essay writing

Text summarization

Question answering tasks

Use Cases

Content Creation

Essay Writing Assistance

Generates structured essay content based on user-provided instructions.

As shown in the example, it can generate article summaries that meet requirements.

Education

Writing Teaching Tool

Helps students understand essay structure and writing techniques.

🚀 Galactica-6.7B-EssayWriter

Galactica-6.7B-EssayWriter is a text - generation model. It provides evaluation results on multiple datasets, which can be used for various NLP tasks.

📚 Documentation

Model Information

Property	Details
Model Type	Galactica-6.7B-EssayWriter
Training Data	ChristophSchuhmann/essays-with-instructions

Evaluation Results on Datasets

The model has been evaluated on several datasets, and here are the detailed results:

AI2 Reasoning Challenge (25 - Shot):
- Task: Text Generation
- Dataset Type: ai2_arc
- Split: test
- Metric: Normalized Accuracy = 40.1
- Source: Open LLM Leaderboard
HellaSwag (10 - Shot):
- Task: Text Generation
- Dataset Type: hellaswag
- Split: validation
- Metric: Normalized Accuracy = 50.29
- Source: Open LLM Leaderboard
MMLU (5 - Shot):
- Task: Text Generation
- Dataset Type: cais/mmlu
- Split: test
- Metric: Accuracy = 33.88
- Source: Open LLM Leaderboard
TruthfulQA (0 - shot):
- Task: Text Generation
- Dataset Type: truthful_qa
- Split: validation
- Metric: mc2 = 40.27
- Source: Open LLM Leaderboard
Winogrande (5 - shot):
- Task: Text Generation
- Dataset Type: winogrande
- Split: validation
- Metric: Accuracy = 58.48
- Source: Open LLM Leaderboard
GSM8k (5 - shot):
- Task: Text Generation
- Dataset Type: gsm8k
- Split: test
- Metric: Accuracy = 3.49
- Source: Open LLM Leaderboard

Overall Evaluation Metrics

Metric	Value
Avg.	37.75
AI2 Reasoning Challenge (25 - Shot)	40.10
HellaSwag (10 - Shot)	50.29
MMLU (5 - Shot)	33.88
TruthfulQA (0 - shot)	40.27
Winogrande (5 - shot)	58.48
GSM8k (5 - shot)	3.49

Visual Representation

image/png

Prompt Example

### Instruction: 
Provide the inputted essay that when summarized resulted in the following summary : The organization's learning and development practices are poor as they involve manual orientation from experienced workers. New employees are not advised of their roles in the organization before assignment of tasks. The orientation process takes long due to lack of a well - coordinated orientation programs.
### Response:

More Details

Detailed results can be found here

📄 License

This project is licensed under the CC - BY - NC - 4.0 license.

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご