BuildPrivateAI
Thread

agentic-hot-prefix

3 runs
Signed runsThe measured evidence
Model Tok/s Peak VRAM TTFT Verdict
Qwen3.6-35B-A3B-FP8 · FP8
NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition (96GB) · Single GPU
192.4 63.8 GiB 127.8 ms Verdict Great for DGX Sparks
Qwen3.5-122B-A10B-MTP-GGUF · Q4_K_M
NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition (96GB) · Single GPU
144.5 83 GiB 35 ms Verdict Great Mid-Size MoE
Nex-N2-mini · BF16
NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition (96GB) · Single GPU
134.5 81.5 GiB 118.4 ms Verdict Best Small MoE