This morning’s Lightning V2 on Tenstorrent note was on-prem TTS economics on Blackhole. Last night’s Olmo-core 3 was a training-systems ticket. Yesterday morning’s Everspin CXL PERSYST was persistent media. Inference fleets still hit a different wall: decode is memory-bound and HBM beachfront is finite. On October 2, 2026, Credo published a technical post on OmniConnect and the Weaver memory fanout gearbox that claims HBM4-class die-edge bandwidth at roughly 25× the capacity — on organic substrate, without CoWoS.
Primary: Credo Oct 2 blog · Weaver product · OmniConnect · Weaver brief PDF · OCP LSI contribution (Aug 10, 2026). Numbers below are Credo’s unless noted. Treat HBM4 comparisons, beachfront densities, and hybrid leftover-edge examples as vendor architecture claims under the stated configs.
Spec sheet (named numbers)
| OmniConnect / Weaver (Credo) | |
|---|---|
| Technical post | October 2, 2026 (Weaver targeted 2H 2026; 112G VSR offered for design-in earlier) |
| What it is | 112G VSR SerDes + lightweight AXI/FLIT framer; Weaver = LPDDR5X memory fanout chiplet (12 lanes) |
| Reach | ~250 mm (~10 in) VSR |
| Beachfront (blog) | LPDDR5X ~0.18 TB/s/mm; GDDR7 ~0.4; HBM4 ~2.0; OmniConnect ~10× vs parallel LPDDR |
| Die-edge vs HBM4 (blog) | Bandwidth 6.4 TB/s vs 6.1 TB/s; capacity 4.8 TB vs 192 GB (~25×); organic, no CoWoS |
| Product sheet caps | Up to 16 TB/s / 6.4 TB; PDF: up to 8 TB/s / 3.2 TB per edge; LPDDR5X PHY 9.6 GT/s |
| Latency / energy | Blog: ~50 ns RTT incl. FEC; PHY ~0.75 pJ/bit. Product: 40 ns RTT; I/O 1.15 pJ/bit |
| Hybrid leftover-edge (blog) | 2 reticle + 8× HBM4 → 288 GB / 22 TB/s; ~10 mm free edge + Weaver LPDDR6 → +1.5 TB / 3.7 TB/s → 1.8 TB / 25.7 TB/s |
| Open path | AXI framer → OCP Open Chiplet Economy Lightweight Serial Interconnect Workstream (Aug 10, 2026); OCP cites up to 25× density and ~5% more BW vs HBM4 |
That is a different purchase sentence from “another CXL pool” or “move the HBM controller into the stack.” This one is: can I attach LPDDR over a short serial beachfront and keep HBM4-class edge bandwidth without advanced packaging — and what does Credo claim when they try.
Why decode makes the wall visible
Prefill is mostly compute-bound. Decode flips it: each new token pulls a growing KV cache; only a fraction of the cores stay fed. Credo puts the compounding gap in plain numbers — compute ~3× every two years, memory bandwidth closer to 1.6× over the same window — and sketches serving-instance memory from roughly 0.4 TB (2020 dense) to about 1.2 TB (2023 MoE) toward ~5 TB for 2026 agentic workloads (~12× in six years), with KV catching up to weights. MoE residency, long context, and reasoning-token volume all push capacity and bandwidth at once.
Physics Credo is arguing against
Substrate area. Side-by-side LPDDR on a typical 100 mm × 100 mm organic tops out around 256 GB in their framing. HBM4 stacks buy peak bandwidth, not multi-terabyte capacity.
Beachfront. Parallel LPDDR5X at ~0.18 TB/s/mm and GDDR7 at ~0.4 lose to HBM4 at ~2.0 TB/s/mm. Packaging does not grow the perimeter. Once the edge is full, it is full.
OmniConnect’s answer: stop assuming memory must sit immediately beside the die. Serialize the link, keep FLIT / FEC / credit flow (drop speed-hopping / renegotiation), and let memory live out to ~250 mm. Fewer pins → roughly 10× die-edge density vs parallel LPDDR in their claim. The cost is latency — blog ~50 ns RTT with FEC; product sheet 40 ns — still a different class from rack CXL, but not free SRAM.
Weaver vs HBM4 — and beside it
The Oct 2 comparison that matters for a BOM conversation:
- Die-edge bandwidth: Weaver 6.4 TB/s vs HBM4 6.1 TB/s (OCP Aug release rounds to ~5% more BW).
- Capacity: 4.8 TB vs 192 GB HBM4 (~25×) on organic — no interposer, no CoWoS.
- Product-sheet maxima sit higher (16 TB/s / 6.4 TB); treat those as aggregate / multi-edge caps and keep the 6.4 / 4.8 vs HBM4 pair as today’s named bake-off.
Credo does not pitch a forced HBM replacement. Their hybrid example leaves ~10 mm of unused edge on a two-reticle / eight-HBM4 package (288 GB / 22 TB/s) and fills it with Weaver-connected LPDDR6 for +1.5 TB / 3.7 TB/s → 1.8 TB / 25.7 TB/s combined. They also argue sustained BW vs peak: spill HBM → LPDDR and sustained BW drops ~10×; spill to CXL and ~100×. A single-hop Weaver pool is their flatter-curve claim for long-context decode — architecture thesis until independent traces land.
Where it sits next to other boards
| Purchase | Product | What it buys |
|---|---|---|
| On-prem TTS on Blackhole (this AM) | Lightning V2 × Tenstorrent | Measured L40S TTS cost/concurrency bake-off |
| Open MoE trainer (last night) | Ai2 Olmo-core 3 | B300 capacity tax fix; training tok/s |
| Persistent CXL media (yesterday AM) | Everspin PERSYST | Byte-addressable MRAM on CXL |
| Custom HBM base die (shipped) | NVIDIA NVHBM | Move controller into the stack for Fusion partners |
| Fabric / storage KV offload (shipped) | Astera Leo X · Lightbits Inferra | Warm TTFT / prefetch beyond HBM — different hop |
| Near-package LPDDR fanout (this post) | Credo OmniConnect Weaver | Claimed HBM4-class edge BW at ~25× capacity on organic; OCP LSI AXI path |
Do not collapse this into “Credo replaces HBM.” The claim is narrower: serialize the beachfront, match ~HBM4 die-edge bandwidth, unlock multi-terabyte LPDDR without CoWoS, optionally fill leftover edge beside HBM, and late-bind DRAM like DIMMs instead of welding capacity at tape-out.
Caveats
- Vendor architecture claims. Bandwidth, capacity, beachfront, hybrid leftover-edge, and sustained-vs-tiered curves are Credo’s. Independent XPU bring-ups are not this post.
- Blog vs product-sheet deltas. Oct 2 blog: ~50 ns / ~0.75 pJ/bit PHY and the 6.4 / 4.8 vs HBM4 pair; product page: 40 ns / 1.15 pJ/bit I/O and up to 16 TB/s / 6.4 TB. Quote the source next to the number.
- Weaver availability. Unveil targeted 2H 2026 for the gearbox; 112G VSR for design-in. Confirm sampling before a frozen BOM.
- Not a CXL pool, not NVHBM. Near-package VSR fanout ≠ rack CXL or Leo X / Inferra KV offload; NVHBM moves the controller into the HBM stack — same wall, different layer.
- OCP is a contribution path. Aug 10, 2026 LSI Workstream + intended AXI framer — not a finished multi-vendor ecosystem. Product sheet is LPDDR5X; hybrid example uses LPDDR6 — verify when LPDDR6 PHYs ship.
How I would evaluate
- Read the Oct 2 beachfront and hybrid leftover-edge sections next to the Weaver parameter table before quoting 25× or 6.4 TB/s.
- Ask for a package diagram with your die-edge budget after HBM, and what Weaver lane count fits.
- Time a decode-heavy long-context / agent workload sized to force HBM spill on your current tier — that is the cliff Credo is selling against.
- Price late-bound LPDDR serviceability vs welded HBM yield separately from peak FLOPs.
- Track the OCP LSI Workstream for third-party AXI implementations. Keep this board separate from Lightning TTS, Olmo-core training, Everspin CXL MRAM, and Leo X / Inferra — this is near-package memory fanout math.
Bottom line
On October 2, 2026, Credo put a clear systems claim on OmniConnect and Weaver: serialize the memory beachfront with 112G VSR SerDes out to ~250 mm, keep a stripped FLIT/FEC/credit path, and match HBM4 die-edge bandwidth (6.4 TB/s vs 6.1 TB/s) at roughly 25× the capacity (4.8 TB vs 192 GB) on organic packaging without CoWoS — with an optional leftover-edge hybrid that adds 1.5 TB / 3.7 TB/s beside eight HBM4 stacks. Product-sheet caps go to 16 TB/s / 6.4 TB at 40 ns RTT and 1.15 pJ/bit I/O on LPDDR5X. The Aug 10, 2026 OCP LSI Workstream puts the AXI framer on an open path. Treat the sustained-BW cliff argument and LPDDR6 migration as vendor thesis until independent bring-ups show up; the durable ticket is whether leftover die edge and late-bound LPDDR can buy multi-terabyte decode capacity without waiting on another HBM generation.
Create-only. Specs from Credo’s October 2, 2026 OmniConnect technical post, Weaver / OmniConnect product pages and PDF brief, and the August 10, 2026 OCP LSI contribution announcement. Update when third-party package bring-ups, LPDDR6 Weaver SKUs, or multi-vendor LSI implementations ship.
Sources: Credo Oct 2 blog · Weaver · OmniConnect · Weaver PDF · OCP LSI Aug 10, 2026.
Anpoo Sivanadi, Staff Software Engineer