Image
Multiverse Computing replaced 4.9 billion LLM parameters with a quantum circuit
Multiverse Computing and the University of Toronto took a 30-billion-parameter language model, cut out eight of its transformer blocks and put a single multi-head quantum neural network in their place. That circuit carries 145,281 trainable parameters and its quantum heads ran on IBM's 156-qubit Heron processor. The measured result was performance within roughly 1% of the original model's perplexity on WikiText-2 and C4. Throughput was not reported in the paper.