G

Gemma 3 12B Instruct

Intelligence(Relatively Weak)
Speed(Slow)
Input Supported Modalities
Yes
Is Reasoning Model
128,000
Context Window
-
Maximum Output Tokens
-
Knowledge Cutoff
Pricing
- /M tokens
Input
- /M tokens
Output
¥0.45 /M tokens
Blended Price
Quick Simple Comparison
Gemini 2.0 Pro Experimental (Feb '25)
Gemini 1.5 Pro (May '24)
¥2.5
Gemini 1.5 Pro (Sep '24)
¥2.5
Basic Parameters
GPT-4.1 Technical Parameters
Parameter Count
Not Announced
Context Length
128.00k tokens
Training Data Cutoff
Open Source Category
Open Weights (Permissive License)
Multimodal Support
Text Only
Throughput
Release Date
2025-03-12
Response Speed
20.999,731 tokens/s
Benchmark Scores
Below is the performance of claude-monet in various standard benchmark tests. These tests evaluate the model's capabilities in different tasks and domains.
Intelligence Index
3383
Large Language Model Intelligence Level
Coding Index
1551
Indicator of AI model performance on coding tasks
Math Index
-
Capability indicator in solving mathematical problems, mathematical reasoning, or performing math-related tasks
MMLU Pro
59.5
Massive Multitask Multimodal Understanding - Testing understanding of text, images, audio, and video
GPQA
34.9
Graduate Physics Questions Assessment - Testing advanced physics knowledge with diamond science-level questions
HLE
4.8
The model's comprehensive average score on the Hugging Face Open LLM Leaderboard
LiveCodeBench
13.7
Specific evaluation focused on assessing large language models' ability in real-world code writing and solving programming competition problems
SciCode
17.4
The model's capability in code generation for scientific computing or specific scientific domains
HumanEval
83.2
Score achieved by the AI model on the specific HumanEval benchmark test set
Math 500 Score
85.3
Score on the first 500 larger, more well-known mathematical benchmark tests
AIME Score
22
An indicator measuring an AI model's ability to solve high-difficulty mathematical competition problems (specifically AIME level)
AIbase
Empowering the Future, Your AI Solution Knowledge Base
© 2025AIbase