Tabula-8B Open-Source Tabular Prediction Model: Freely Utilize Tabular Data for Classification and Regression Predictions

Tabula 8b

Developed by mlfoundations

TabuLa-8B is a foundational model for table data prediction (classification and binned regression), built on Meta Llama 3.

Large Language Model

Transformers

English#Table Prediction #Classification Regression #Llama3 Fine-tuning

Downloads 7,178

Release Time : 6/11/2024

Model Overview

TabuLa-8B is a specialized foundational model for table data prediction, supporting classification and binned regression tasks. The model is fine-tuned from Meta Llama 3 and trained on the T4 dataset using the rtfm framework.

Model Features

Specialized for Table Data

Optimized specifically for table data, suitable for classification and binned regression tasks.

Based on Llama-3

Fine-tuned from the powerful Meta Llama 3 model, inheriting its excellent language understanding and generation capabilities.

Transfer Learning Framework

Trained using the rtfm framework, supporting transfer learning for large-scale table data.

Model Capabilities

Table Data Classification

Table Data Binned Regression

Table Data Prediction

Use Cases

Data Analysis

Customer Classification

Predict customer classification based on feature data

Sales Forecasting

Perform binned regression prediction based on historical sales data

🚀 TabuLa-8B (Tabular Llama-8B)

TabuLa-8B is a foundation model designed for prediction (classification and binned regression) on tabular data, offering solutions and value in tabular data analysis.

🚀 Quick Start

This repository contains the TabuLa-8B (Tabular Llama-8B) model, which is a foundation model for prediction (classification and binned regression) on tabular data. TabuLa-8B is described in the paper "Large Scale Transfer Learning for Tabular Data via Language Modeling.". For more details on the model, see the paper, which includes a Model Card detailing the model architecture, training, and evaluation.

✨ Features

TabuLa-8B is a foundation model for prediction on tabular data.
It is built with Meta Llama 3.
It was trained with rtfm using the T4 dataset.

📦 Installation

No specific installation steps are provided in the original document, so this section is skipped.

💻 Usage Examples

Basic Usage

# Load the model with `transformers`
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("mlfoundations/tabula-8b")
model = AutoModelForCausalLM.from_pretrained("mlfoundations/tabula-8b")

Advanced Usage

For more information on how to prepare data and run inference (including a demo notebook for performing inference on your data), see the examples in rtfm.

📚 Documentation

The details of TabuLa-8B are described in the paper "Large Scale Transfer Learning for Tabular Data via Language Modeling.". The paper includes a Model Card detailing the model architecture, training, and evaluation.

🔧 Technical Details

No specific technical details are provided in the original document, so this section is skipped.

📄 License

TabuLa-8B is fine-tuned from the Llama-3 8B model. As a result, we release it under the Llama 3 license, and by using the model you agree to abide by the Llama 3 Community License Agreement and the Llama 3 Acceptable Use Policy.

Property	Details
Model Type	TabuLa-8B (Tabular Llama-8B)
Training Data	T4 dataset

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご