Home/Topics/compressed-tensors Thread compressed-tensors 1 run Signed runsThe measured evidence Model Tok/s Peak VRAM TTFT Verdict gemma-4-26B-A4B-it-FP8-Dynamic · FP8 NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition (96GB) · Single GPU 185.5 62.8 GiB 320.1 ms Verdict Great for DGX Sparks
