Boomer 634m

🚀 Boomer-634m Model

Democratizing access to LLMs for the open - source community. Let's advance AI, together.

🚀 Quick Start

We are thrilled to announce the open - sourcing of our boomer - 634m model, an important milestone in our ongoing AI research. This model, with 634 million parameters, was meticulously pre - trained from scratch on a custom synthetic dataset comprising 12 billion tokens.

Here is a quick guide to get you started with boomer - 634m: Please note that, at the moment, trust_remote_code=True is required for running the model.

💻 Usage Examples

Basic Usage

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("budecosystem/boomer-634m",
                                             trust_remote_code=True)
tokenizer = AutoTokenizer.from_pretrained("budecosystem/boomer-634m")

input_ids = tokenizer("Explain why the sky is blue.", return_tensors='pt').to(model.device)["input_ids"]
outputs = model.generate(input_ids, max_new_tokens=216)
print(tokenizer.batch_decode(outputs))

📚 Documentation

The boomer - 634m model has been rigorously evaluated on various benchmarks, showcasing its robust performance across different tasks:

Final thought on Boomer!

Embarking on the journey with boomer - 634m is just the beginning. We are committed to developing more advanced, efficient, and accessible AI models. Join us in this exciting adventure to shape the future of AI.

Acknowledgements

Our heartfelt thanks go to the open - source community and the trailblazers in AI research whose work has paved the way for innovations like boomer - 634m.

📄 License

This project is licensed under the Apache - 2.0 license.