Devstral Small (Jul '25)
Mistral • text#389 of 579 in intelligence
Devstral Small 1.1 is a 24B parameter open-weight language model for software engineering agents, developed by Mistral AI in collaboration with All Hands AI. Finetuned from Mistral Small 3.1 and...
Specifications
Context Window
131K tokens
Input Price/1M
—
#1 of 714
Output Price/1M
—
Parameters
—
Benchmarks
Devstral Small (Jul '25) results on the main AI model evaluation benchmarks. Higher scores indicate better performance.
Agentic
| Benchmark | Score | Maximum | Methodology |
|---|---|---|---|
| Terminal-Bench Hard | 6.0 | 100.0 | — |
Coding
| Benchmark | Score | Maximum | Methodology |
|---|---|---|---|
| LiveCodeBench | 25.0 | 100.0 | Artificial Analysis official API |
| SciCode | 24.0 | 100.0 | — |
| AA Coding Index | 12.1 | 100.0 | Artificial Analysis official API |
Knowledge
| Benchmark | Score | Maximum | Methodology |
|---|---|---|---|
| MMLU-Pro | 62.0 | 100.0 | — |
Long Context
| Benchmark | Score | Maximum | Methodology |
|---|---|---|---|
| AA-LCR | 17.0 | 100.0 | — |
Math
| Benchmark | Score | Maximum | Methodology |
|---|---|---|---|
| MATH-500 | 68.4 | 100.0 | Artificial Analysis official API |
| AA Math Index | 29.3 | 100.0 | Artificial Analysis official API |
| AIME 2025 | 29.0 | 100.0 | Artificial Analysis official API |
overall
| Benchmark | Score | Maximum | Methodology |
|---|---|---|---|
| AA Intelligence Index | 9.1 | 100.0 | Artificial Analysis official API |
Reasoning
| Benchmark | Score | Maximum | Methodology |
|---|---|---|---|
| MMLU Pro | 63.2 | 100.0 | Artificial Analysis official API |
| GPQA Diamond | 41.0 | 100.0 | Artificial Analysis official API |
| IFBench | 35.0 | 100.0 | — |
| HLE | 4.0 | 100.0 | — |
Tool Use
| Benchmark | Score | Maximum | Methodology |
|---|---|---|---|
| Tau²-Bench | 28.0 | 100.0 | — |
Information
- Release date
- July 10, 2025
- Tool Calling
- ✅ Supported
- Vision
- ❌ Not supported
- Audio
- ❌ Not supported
Full Analysis: Devstral Small (Jul '25)
What is Devstral Small (Jul '25)?
Devstral Small (Jul '25) is an AI model developed by Mistral, classified as a text model. It focuses on text processing and natural language generation. As a proprietary model, it is available via Mistral's cloud API. With a context window of 131K tokens, it is suitable for processing long documents such as contracts, books, and complete codebases.
Pricing & Costs in 2026
Devstral Small (Jul '25) does not have public per-token pricing available at this time. Some models offer access via enterprise plans or research programs. Check Mistral's official website for up-to-date availability and pricing.
Benchmarks & Performance
Devstral Small (Jul '25) was evaluated on 15 different benchmarks, covering categories like Agentic, Coding, Knowledge, Long Context, Math, overall, Reasoning, Tool Use. Results show moderate performance across available evaluations.
It's important to note that benchmarks measure specific aspects and don't capture the full user experience. Factors like instruction adherence, behavior in long conversations, and real-world task quality vary significantly between models and aren't always reflected in standard scores.
Recommended Use Cases
Devstral Small (Jul '25) specializes in text, offering advanced capabilities for creating and processing text content.
Comparison with Alternatives
In the 2026 AI model ecosystem, Devstral Small (Jul '25) competes directly with similarly capable models. Mistral competes in this segment against OpenAI, Anthropic, Google, and Meta. The choice between models depends on the specific use case, budget, latency requirements, and need for features like multimodality and tool calling.
For a detailed side-by-side comparison, use our comparison tool or check the overall model ranking.
Frequently Asked Questions
What is Devstral Small (Jul '25)?
Devstral Small (Jul '25) is an AI model developed by Mistral. It is a text model.
How much does Devstral Small (Jul '25) cost?
Devstral Small (Jul '25) does not have public per-token pricing available at this time. Check Mistral's official website for up-to-date information.
How does Devstral Small (Jul '25) compare with other models?
In available benchmarks, Devstral Small (Jul '25) scored: Terminal-Bench Hard: 6/100, LiveCodeBench: 25/100, SciCode: 24/100. See the full table above for a detailed comparison.
Is Devstral Small (Jul '25) open source?
No, Devstral Small (Jul '25) is a proprietary model from Mistral. It is available via cloud API. For open source alternatives, check our open source model ranking.
What is Devstral Small (Jul '25) best for?
Devstral Small (Jul '25) excels at general-purpose language tasks. With its large context window, it handles long documents, codebases, and extended conversations. It supports tool calling for API integrations and automation.
Last updated: September 01, 2026 • View methodology →