DeepSeek V4 Flash Benchmarks Reveal High Performance on DGX and Mac M2 Ultra

What if the most powerful open-weight model right now runs faster than you think — even on hardware you can buy?

DeepSeek V4 Flash is turning heads with benchmark numbers that put it in elite territory across multiple hardware configurations.

And the results are raising big questions about who really needs cloud inference anymore.

The numbers that matter

> "DeepSeek V4 Flash on dual DGX Sparks hits 40 tokens per second for a single user — and 350 tokens per second aggregate."

According to data shared on the r/LocalLLaMA community, DeepSeek V4 Flash is delivering impressive throughput on Nvidia's DGX hardware.

We're talking about 40 tokens per second for single-user inference on a dual DGX Spark setup.

But the aggregate throughput is where things get wild — 350 tokens per second when handling concurrent requests.

These aren't theoretical projections. They come from hands-on testing by engineers in the Nvidia community threads.

What is DeepSeek V4 Flash?

DeepSeek V4 Flash is the latest iteration of DeepSeek's open-weight large language model family.

It's designed to balance raw performance with efficiency. The "Flash" designation signals a focus on speed-optimized inference.

Why "Flash" matters

In the LLM world, raw intelligence means nothing if you can't serve tokens fast enough.

Users expect near-instant responses. Enterprise deployments need high concurrency.

DeepSeek V4 Flash targets exactly that sweet spot — smart enough to be useful, fast enough to be practical.

>📌 READ MORE: Newsletter IA — DeepSeek V4 Flash benchmark thread

The hardware breakdown

The benchmark data covers three very different hardware setups. Each tells a different story about who can run this model — and how well.

Dual Nvidia DGX Spark

This is Nvidia's purpose-built AI workstation hardware. It's not cheap, but it's the gold standard for local inference.

Here's what the DGX Spark configuration delivered:

• Single-user throughput: ~40 tokens/second
• Aggregate throughput: ~350 tokens/second
• Context window tested: Up to 1M tokens
• Configuration: Dual DGX Spark nodes

The ability to handle a 1 million token context window while maintaining 40 tokens per second for a single user is remarkable.

That's long-document analysis, full codebase reasoning, and extended conversations — all running locally.

Nvidia RTX Pro 6000

The RTX Pro 6000 represents a more accessible tier of Nvidia professional hardware.

As noted in the community discussion, this GPU also shows strong results with DeepSeek V4 Flash.

While the exact token-per-second figures for the RTX Pro 6000 vary depending on quantization and batch size, the card punches well above its weight class.

It's a realistic option for developers and small teams who want local inference without DGX-level investment.

Apple M2 Ultra

Here's where it gets interesting for the Mac crowd.

The Apple M2 Ultra — a chip you can find in a Mac Studio or Mac Pro — is also capable of running DeepSeek V4 Flash.

According to the benchmark data, the M2 Ultra delivers usable inference speeds thanks to its unified memory architecture.

Apple silicon's big advantage? Memory bandwidth and large unified memory pools — up to 192GB on the M2 Ultra.

For a model like DeepSeek V4 Flash, which benefits from keeping the full model in memory, that's a genuine competitive edge.

But it's not all sunshine and rainbows.

The M2 Ultra can't match the DGX Spark on raw throughput. It's a trade-off: accessibility and silence versus brute-force speed.

Why local inference is having a moment

> "The gap between cloud and local AI inference is shrinking faster than anyone expected."

A year ago, running a frontier-class model locally was a pipe dream for most teams.

You needed cloud APIs. You needed expensive GPU clusters. You needed patience.

Now? DeepSeek V4 Flash runs at production-quality speeds on hardware that fits under a desk.

This shift matters for several reasons:

• Data privacy: No tokens leave your network
• Cost control: No per-token API fees at scale
• Latency: No round-trip to a data center
• Customization: Full control over quantization, batching, and fine-tuning

>📌 READ MORE: r/LocalLLaMA — Full benchmark discussion

How it stacks up against the competition

DeepSeek V4 Flash enters a crowded field. Meta's Llama family, Mistral's models, and Qwen from Alibaba are all fighting for the open-weight crown.

Speed versus intelligence

The "Flash" variant prioritizes inference speed. That means it may trade some benchmark accuracy for significantly faster token generation.

For many real-world use cases — chatbots, code completion, document summarization — that's the right trade-off.

Users don't need the absolute smartest model. They need one that's smart enough and fast enough.

The open-weight advantage

Unlike proprietary models from OpenAI or Anthropic, DeepSeek V4 Flash can be downloaded, modified, and deployed without API dependencies.

That's a fundamental difference in the economics of AI deployment.

Every token generated locally is a token you don't pay for through an API. At enterprise scale, the savings add up fast.

The community factor

One detail worth highlighting: these benchmarks come from the community, not from DeepSeek's marketing team.

As credited in the original post, contributors like Aiden (Antirez) and members of the Nvidia community threads did the heavy lifting.

That's significant. Community-driven benchmarks tend to be more honest than vendor-published numbers.

They test real-world conditions. They expose bottlenecks. They share the recipes — not just the results.

Reproducibility matters

The original post emphasizes sharing "recipes and learnings" — the actual configurations, settings, and optimizations used to achieve these numbers.

That's the difference between a headline and something engineers can actually use.

>📌 READ MORE: DeepSeek V4 Flash community benchmarks

What this means for different users

Enterprise teams

If you're running AI workloads at scale, the dual DGX Spark numbers are compelling.

350 tokens per second aggregate means you can serve multiple users simultaneously without cloud dependency.

For regulated industries — healthcare, finance, legal — that local-first approach solves compliance headaches.

Independent developers

The RTX Pro 6000 and M2 Ultra results open doors for solo developers and small studios.

You don't need a server room. You need a powerful workstation and the right configuration.

Researchers

Full model access means full experimentation freedom.

Fine-tuning, ablation studies, architecture modifications — all possible when you own the weights and the hardware.

The cost question

Here's the elephant in the room: none of this hardware is cheap.

A dual DGX Spark setup represents a serious capital investment. The RTX Pro 6000 isn't a consumer card either.

Even the M2 Ultra Mac Studio starts north of $4,000 and climbs quickly with maxed-out memory.

But compare that to ongoing API costs at scale. For teams generating millions of tokens daily, the break-even point arrives sooner than you'd expect.

The math favors local inference for sustained, high-volume workloads. For occasional use, cloud APIs still make more sense.

The verdict

DeepSeek V4 Flash is proving that open-weight models can compete on speed — not just intelligence.

The benchmark data from the community shows real, reproducible performance across hardware tiers ranging from Apple silicon to Nvidia's top-shelf DGX platform.

The era of practical local inference isn't coming. It's here.

The real question now: how long before running your own model locally feels as normal as running your own database?