Deterministic Frontier-Scale Language Model Inference with Signed Receipts.

Abstract

We describe a protocol that produces byte-identical outputs from frontier-scale language model inferenceand binds each output to a portable, offline-verifiable signed receipt. The construction has three parts.First, an inference substrate that runs models up to seventy-two billion dense parameters and forty-sevenbillion mixture-of-experts active parameters on NVIDIA H100, with cross-vendor extension to AMDInstinct MI300X. Output hashes match byte-for-byte across fresh process launches in every configurationmeasured; at single-GPU bf16 with eager attention the AMD and NVIDIA hashes are themselves byte-identical, including over fifty-one tokens of compounding frontier-scale generation, and at two-GPUtensor-parallel they differ as predicted by the underlying NCCL-ring versus RCCL-fabric all-reducetopology. Both are individually deterministic. Second, a canonical CBOR receipt schema with an Ed25519signature over a domain-separated message, implemented in Go, Python, and Rust, with cross-languagebyte-identity verified end-to-end and AMD-produced receipts verifying byte-for-byte through a Rustverifier built on x86 NVIDIA hardware. Third, a probabilistic spot-check verifier that re-executes asmall sample of receipts and rejects on mismatch; we prove a soundness lemma of the form 1−(1−f )kand validate it empirically across seventy adversary-verifier configurations with seven hundred thousandMonte Carlo trials. Verification costs about eighty microseconds per receipt on a single core. Eleventhousand sequential warm-model inferences ran without a single byte-identity failure. The contribution isthe construction itself: a primitive that gives issuer-independent fabrication soundness for AI inference atproduction cost, without a hardware-vendor dependency and without zero-knowledge proofs.