%20--%3e%3cdefs%3e%3cstyle%3e%20.st0%20{%20fill:%20%23061b40;%20}%20.st1%20{%20fill:%20%23306af1;%20}%20.st2%20{%20fill:%20%235ce5cf;%20}%20%3c/style%3e%3c/defs%3e%3cg%3e%3cpath%20class='st0'%20d='M55,10.5h9v3h-9v9h12V7.5h-12v3ZM64,19.5h-6v-3h6v3Z'/%3e%3cpolygon%20class='st0'%20points='69%2016.5%2078%2016.5%2078%2019.5%2069%2019.5%2069%2022.5%2081%2022.5%2081%2013.5%2072%2013.5%2072%2010.5%2081%2010.5%2081%207.5%2069%207.5%2069%2016.5'/%3e%3cpolygon%20class='st0'%20points='95%2010.5%2095%207.5%2083%207.5%2083%2022.5%2095%2022.5%2095%2019.5%2086%2019.5%2086%2016.5%2095%2016.5%2095%2013.5%2086%2013.5%2086%2010.5%2095%2010.5'/%3e%3cpath%20class='st0'%20d='M40,1.5v21h11.6l1.4-1.4v-7.6h0c0,0-1.4-1.5-1.4-1.5l1.4-1.4V2.9l-1.4-1.4h-11.6ZM50,19.5h-7v-6h7v6ZM50,10.5h-7v-6h7v6Z'/%3e%3c/g%3e%3cpath%20class='st1'%20d='M23.1,24L14.7,4.8l-4.9,11.2h3.8l-1.8,4H3.3L12.1,0H2C.9,0,0,.9,0,2v20c0,1.1.9,2,2,2h21.1Z'/%3e%3cpath%20class='st2'%20d='M34,0h-16.8l10.6,24h6.2c1.1,0,2-.9,2-2V2C36,.9,35.1,0,34,0ZM32.5,20h-4V4h4v16Z'/%3e%3c/svg%3e)
Devstral Small (May '25)
Original May 2025 release of Devstral Small, Mistral AI's first open-source coding agent model. 24B parameters achieving 46.8% on SWE-Bench Verified, outperforming GPT-4.1-mini by over 20 percentage points. Released under Apache 2.0 license, runs on single GPU, established foundation for open-source solutions in coding agents and software engineering tasks.
Intelligence(Relatively Weak)
Speed(Medium)
Input Supported Modalities
No
Is Reasoning Model
256,000
Context Window
128,000
Maximum Output Tokens
-
Knowledge Cutoff
Pricing
￥0.72 /M tokens
Input
￥2.16 /M tokens
Output
￥1.08 /M tokens
Blended Price
Quick Simple Comparison
Devstral
￥0.1
Devstral Medium
￥0.4
Devstral Small (May '25)
￥0.1
Basic Parameters
Devstral Small (May '25)Technical Parameters
Parameter Count
24,000.0M
Context Length
256.00k tokens
Training Data Cutoff
Open Source Category
Open Weights (Permissive License)
Multimodal Support
Text Only
Throughput
137
Release Date
2025-05-21
Response Speed
147.68,123 tokens/s
Benchmark Scores
Below is the performance of Devstral Small (May '25) in various standard benchmark tests. These tests evaluate the model's capabilities in different tasks and domains.
Intelligence Index
34.11
Large Language Model Intelligence Level
Coding Index
25.18
Indicator of AI model performance on coding tasks
Math Index
37.53
Capability indicator in solving mathematical problems, mathematical reasoning, or performing math-related tasks
MMLU Pro
63.2
Massive Multitask Multimodal Understanding - Testing understanding of text, images, audio, and video
GPQA
43.4
Graduate Physics Questions Assessment - Testing advanced physics knowledge with diamond science-level questions
HLE
4
The model's comprehensive average score on the Hugging Face Open LLM Leaderboard
LiveCodeBench
25.8
Specific evaluation focused on assessing large language models' ability in real-world code writing and solving programming competition problems
SciCode
24.5
The model's capability in code generation for scientific computing or specific scientific domains
HumanEval
84.8
Score achieved by the AI model on the specific HumanEval benchmark test set
Math 500 Score
68.4
Score on the first 500 larger, more well-known mathematical benchmark tests
AIME Score
6.7
An indicator measuring an AI model's ability to solve high-difficulty mathematical competition problems (specifically AIME level)
GPT 5 Mini
openai
￥1.8
Input tokens/million
￥14.4
Output tokens/million
400k
Context Length
GPT 5 Standard
openai
￥63
Input tokens/million
￥504
Output tokens/million
400k
Context Length
GPT 5 Nano
openai
￥0.36
Input tokens/million
￥2.88
Output tokens/million
400k
Context Length
GPT 5
openai
￥9
Input tokens/million
￥72
Output tokens/million
400k
Context Length
GLM 4.5
chatglm
￥0.43
Input tokens/million
￥1.01
Output tokens/million
131k
Context Length
Gemini 2.0 Flash Lite (Preview)
google
￥0.58
Input tokens/million
￥2.16
Output tokens/million
1M
Context Length
Gemini 1.0 Pro
google
￥3.6
Input tokens/million
￥10.8
Output tokens/million
33k
Context Length
Qwen2.5 Coder Instruct 32B
alibaba
￥0.65
Input tokens/million
￥0.65
Output tokens/million
131k
Context Length