Compiler as Bottleneck for Novel Hardware

last updated 2026-05-27
Physics-Native Compute Physics-Native Comp… Coherent Ising Machine Coherent Ising Mach… Memristors Memristors AI Accelerator AI Accelerator Compiler …

A pattern. Novel hardware companies die between tape-out and customer deployment because the compiler that maps generic ML graphs to the hardware’s native primitives isn’t built. The hardware ships; customers can’t use it. The company stalls or pivots.

This is the most reliably recurring failure mode in novel-compute deal flow. Every pre-seed evaluating a hardware play needs the compiler-hire question answered.

The pattern

  1. Architecture validated. Simulations show 10x / 100x / 1000x speedup or energy advantage on a target workload.
  2. First silicon arrives. Hardware works on hand-tuned benchmarks.
  3. Customer pilot starts. Customer brings their actual model (a transformer with custom layers, an Ising problem with non-standard topology, a specific optimisation graph).
  4. Mapping is manual. Hand-translation takes weeks per workload. Customer can’t iterate. Pilot stalls.
  5. Compiler team starts. 12–24 months to build something resembling a generic front-end. Cash burns. Customer attention moves to alternatives.

Notable casualties

Company Hardware What killed it
Mythic Analog flash matrix-mul Hand-tuned model mapping; per-customer porting impossible to scale; pivoted, downsized
Lightelligence Photonic Ising / matmul Compiler for arbitrary transformer architectures absent; pivoted to optical interconnect
HP Labs memristor Resistive RAM crossbars No customer-facing compiler ever shipped; team disbanded after a decade

Notable survivors (and how)

Company Compiler strategy Outcome
Groq Compiler-first development (TSP compiler started years before silicon); LPU shipped with first-customer-ready software Production AI inference accelerator at chip scale
Cerebras CSL (Cerebras Software Language) built in parallel with WSE silicon; PyTorch / TF front-end at GA Shipping WSE-3 with paying customers
Nvidia (historical) CUDA started ~2006, three years before AI take-off; ecosystem moat The moat

Why physics-native compute is especially exposed

Every Physics-Native Compute substrate (CIM, thermodynamic, p-bit, neuromorphic) requires a compiler that maps a graph (transformer, Ising, MAP inference) to a physical configuration (J matrix, varactor states, coupling weights). The mapping is mathematically non-trivial because:

DD signals

Strong proceed signals.

Pass / strong concern signals.

Pre-seed-stage compiler hire pattern

For pre-seed deals in this category, the compiler-hire pipeline should be visible at term-sheet:

Sources

Related concepts

Frontier questions