27–43×less proving time vs zkLLM
Historical single-layer comparison. Re-timing pending.
Benchmark details
Per layer and token position. Synthetic layer; newer GPUs; no weight hiding. Timed before a soundness fix. Re-timing pending.
- Ours is not zero knowledge yet; zkLLM hides the weights
- One synthetic layer vs a whole model
- H100 or RTX 6000 Ada vs A100
- zkLLM's time is a sum of per-operation times
- Our proof is larger: for one layer (at 4,096 positions) vs for zkLLM's whole model
- Ours by our own model, not externally reviewed; zkLLM states no bit level
- One-time costs excluded on both sides
Ours: one Llama-8B-width layer over 2,048 positions, 0.220 ms per layer and token position on a rented H100, 0.354 ms on a rented RTX 6000 Ada (cold). zkLLM: its whole LLaMA-2-7B model on an A100, 9.46 ms per layer and token position (620 s ÷ (32 × 2,048)), and it hides the weights. One-time costs excluded on both sides.
9.46 ms ÷ 0.220 ms ≈ 43 (H100); 9.46 ms ÷ 0.354 ms ≈ 27 (RTX 6000 Ada, cold).
Our zero-knowledge path runs end to end, but its proofs are being re-checked after a verifier fix, and it is not faster than published systems. Our fast path is not yet zero knowledge.
