---
title: Mistral-Small 4 119B (NVFP4) · DGX Spark Arena
canonical: https://djangodevreng.nl/en/arena/mistral-small-4-119b-nvfp4/
license: CC-BY-4.0
source: https://github.com/djangodevreng/dgx-spark-benchmarks/tree/a948cec23b054c62fef595bad3cdb284066922ac/results/mistral-small-4/mistral-small-4-119b/nvfp4/
source_revision: a948cec23b054c62fef595bad3cdb284066922ac
contract_version: 1
suite_version: 2026-08
minimum_request_success_rate: 0.99
sanity_status: passed
attribution: Django de Vreng, https://djangodevreng.nl
---

# Mistral-Small 4 119B (NVFP4)

Measured on 2026-08-13 with vLLM v0.26.0. In the chat test with ten concurrent requests this profile reaches 11.62 tokens/s per user, with an average of 2.14 seconds to the first token. At 25k context that average wait rises to 38.75 seconds. These runs measure speed and waiting, not the quality of the answers.

## Specs

- Vendor: mistralai
- Architecture: MoE
- Parameters: 119B-A6.5B
- Precision: NVFP4
- Context: 256K
- Measured at: 128K
- VRAM: 83.0 GB
- Engine: vLLM v0.26.0
- Hardware: DGX Spark, NVIDIA GB10, 128 GB unified memory
- Model card: https://huggingface.co/mistralai/Mistral-Small-4-119B-2603-NVFP4
## Quality (model cards)

Knowledge: MMLU-Pro; reasoning: GPQA-Diamond; coding: LiveCodeBench v6. Each value names its exact test. Other tests and missing measurements do not qualify for the total score. External figures are not our own evaluation of this precision.

https://huggingface.co/mistralai/Mistral-Small-4-119B-2603-NVFP4

| Benchmark | Score |
| --- | --- |
|  | — |
|  | — |
| GPQA-Diamond | 71.2 |
## Benchmarks on the DGX Spark

Only complete runs without a failed sanity check count. Open-loop tests require at least 99% request success. Raw results remain visible.

| Test | tokens/s per user | tokens/s total | TTFT (ms) | Request success | Ranking |
| --- | --- | --- | --- | --- | --- |
| 01 Translation missing: en.arena_copy.benches.chat.name | 11.62 | 80.0 | 2136.0 | — | Included |
| 02 Translation missing: en.arena_copy.benches.rag-8k.name | 8.99 | 61.0 | 11125.0 | — | Included |
| 03 Translation missing: en.arena_copy.benches.long-output.name | 12.17 | 83.0 | 697.0 | — | Included |
| 04 Translation missing: en.arena_copy.benches.multi-turn.name | 9.96 | 89.0 | 3512.0 | — | Included |
| 05 Translation missing: en.arena_copy.benches.big-context.name | 4.6 | 22.0 | 38750.0 | — | Included |
| 06 Translation missing: en.arena_copy.benches.concurrency-stress.name | 2.56 | 22.0 | 73818.0 | — | Included |
| 07 Translation missing: en.arena_copy.benches.office-baseline.name | 20.60181818181818 | 1133.1 | 1984.18 | 100.0% | Included |
| 08 Translation missing: en.arena_copy.benches.sharegpt.name | 9.733846153846155 | 126.54 | 402.31 | 100.0% | Included |
| 09 Translation missing: en.arena_copy.benches.reasoning.name | 3.423673469387755 | 167.76 | 763.22 | 100.0% | Included |
| 10 Translation missing: en.arena_copy.benches.monday-peak.name | 35.233333333333334 | 951.3 | 1548.51 | 100.0% | Included |
| 11 Translation missing: en.arena_copy.benches.rate-sweep.name | — | — | — | 100.0% | Included |
## Notes

Model-ID: mistralai/Mistral-Small-4-119B-2603-NVFP4. Container: vllm/vllm-openai:v0.26.0-aarch64-cu129-ubuntu2404. llama-benchy 0.4.0. Source run: 2026-08-13T10:05:20+02:00. KV-cache fp8; max_model_len 131072; gpu_memory_utilization 0,9. Prefix caching off; async scheduling on. Extra server flags: --language-model-only --tokenizer_mode mistral --config_format mistral --load_format mistral --moe-backend marlin --linear-backend marlin --max-num-batched-tokens 8192. 11 of 11 tests have a measurement that counts under the current Arena rules. The sanity check passed. This is a check on a short generated answer, not a substantive evaluation of the benchmark tasks.

---

CC-BY-4.0 (https://creativecommons.org/licenses/by/4.0/). Django de Vreng, https://djangodevreng.nl.
Full arena: https://djangodevreng.nl/en/arena/
Raw runs (GitHub): https://github.com/djangodevreng/dgx-spark-benchmarks/tree/a948cec23b054c62fef595bad3cdb284066922ac/results/mistral-small-4/mistral-small-4-119b/nvfp4/
Source JSON: https://djangodevreng.nl/en/arena/mistral-small-4-119b-nvfp4/source.json