Rows are measured configurations, not a league table. Prompt length, model, hardware and cache choices all affect throughput. Peak system RAM is process max RSS unless the row says otherwise.
Public benchmark ledger
Explore what changes.
Keep the context.
Compare measured speed by GPU or model, then inspect the quality evidence for each supported model and quantisation profile. Every row keeps the configuration details that make the number meaningful.
4measured configurations
Speed results
RTX PRO 6000 Blackwell · 96 GB
Prefill is prompt processing speed. Decode is Krasis’s internal engine measurement; HTTP round trip includes the local client/server path.
Scroll sideways to inspect every column →
| Hardware | Model | Params | Active params | Attention + KV | Prefill | Decode | HTTP round trip | Peak system RAM | HCS | Min free VRAM |
|---|---|---|---|---|---|---|---|---|---|---|
| 1x RTX PRO 6000 Blackwell 96GB, AMD EPYC 7742 | DeepSeek-V4-Flash-0731 | 304.2B checkpoint / 284B main | 13B main | INT4/BF16/BF16 KV | 152.2 @1K / 320.6 @2K / 906.3 @8.6K / 1,328.2 @23K / 1,204.3 @62K tok/s | 29.38/28.20/28.49 @1K (50/100/250 outputs); 19.41 @62K tok/s | 54.05/35.97/30.60 @1K; 19.41 @62K tok/s | 145.5 GB process RAM (benchmark report) | 6440/11008 (58.5%) | 650 MB |
| 1x RTX PRO 6000 Blackwell 96GB, AMD EPYC 7742 | Qwen3-Coder-Next | 80B total | 3B active | INT4/HQQ4/k4v4 | 11,211.1 tok/s | 91.34 tok/s | 161.82 tok/s | 79.2 GB process RAM (benchmark report) | 24576/24576 (100.0%) | 53,156 MB |
| 1x RTX PRO 6000 Blackwell 96GB, AMD EPYC 7742 | Ornith-1.0-397B | 397B total | 17B active | INT4/HQQ4/k4v4 | 2,354.5 tok/s | 23.58 tok/s | 41.73 tok/s | 201.8 GB process RAM (benchmark report) | 13161/30720 (42.8%) | 1,346 MB |
| 1x RTX PRO 6000 Blackwell 96GB, AMD EPYC 7742 | Step-3.7-Flash | 201.4B total / 199.4B text | 13.9B | INT4/HQQ4/k4v4 | 5,261.0 tok/s | 55.40 tok/s | 112.82 tok/s | 103.4 GB process RAM (benchmark report) | 11121/12096 (91.9%) | 1,274 MB |
Quality compares quantised runs with a BF16 reference. Lower drift is closer to BF16. A blocked row means that exact configuration still awaits the required comparison; it is not presented as a pass.
Data mirrors the public Krasis ledgers at revision 8e068a0.Speed source ↗Quality source ↗