TPU 8i Adds 288GB HBM and 384MB SRAM for Agent Inference
Google's eighth-gen TPUs split into TPU 8t for training (121 ExaFlops, 9,600 chips) and TPU 8i for inference (288GB HBM, 80% better perf-per-dollar).
#hardware
12 posts
HP ZBook Ultra G1a 14: 64GB Unified Memory Hits 8.6 t/s on 32B Local Models
AMD Ryzen AI Max PRO 390 with 64GB unified memory runs 32B models at 8.6 t/s — parity with a 16GB RTX 5080 laptop, no discrete GPU needed.
AMD Threadripper Halo Station: 576GB HBM3E for Trillion-Parameter Workloads
AMD's Threadripper Halo Station packs a 96-core CPU with dual MI350P accelerators and up to 576GB of HBM3E — a $150K desktop that runs trillion-parameter models locally.
NVIDIA's Custom HBM Signals Memory Bandwidth Is the New Constraint
NVIDIA's NVHBM moves memory control to the HBM stack itself, not the GPU. This architectural shift reveals memory bandwidth, not compute cores, is the real scaling bottleneck for AI inference.
Samsung zHBM Cuts I/O Power ~70% — Memory and Compute Merge by 2028
Samsung's three-phase HBM roadmap moves the memory controller into the base die, then stacks the whole DRAM on the processor — cutting I/O power ~70% at zHBM.
16,000 MT/s DDR5 MRDIMMs Just Raised the AI Memory Ceiling
Renesas' Gen 3 MRDIMM pushes server DDR5 to 16,000 MT/s — 25% over Gen 2 on existing boards. Memory-bound decode gains a real ceiling.
Server Memory Hit 70% Price Spike — Buy Before Q3 Peak
SK Hynix chairman confirms 70% DRAM price hike. Conventional DRAM contract prices jumped 90–95% in Q1; Q3 will see another 58–63% increase. Homelab and server buyers need to act now.
AMD EPYC Venice Launches July 22–24: 576 Cores, 12 TB/s Memory Bandwidth
AMD's Zen 6 EPYC Venice debuts next week with up to 576 cores, 12 TB/s memory bandwidth, and native AVX-1024 support. Here's what changes for AI infrastructure.
Your Homelab RAM and SSD Costs Are About to Jump 30–40%
ADATA's chairman warns of a 30% DRAM and 40% NAND jump this quarter. Here's why your build budget needs to shift now.
NVIDIA's First Server CPU Clears the Performance Floor
NVIDIA's Vera CPU benchmarks show it competes directly with EPYC and Xeon, but software maturity and platform lock-in dictate adoption.
AMD GPUs Are Getting 10% Pricier — Here's the Full Picture
AMD has notified its supply chain of a ~10% GPU price increase driven by a DRAM shortage. DRAM contract prices rose 90–95% QoQ in Q1 2026. Here's what to buy, hold, or skip.
DDR5 Tripled Since October — Buy Nothing Yet
DRAM and NAND prices have surged 90–130% since late 2025. A Samsung factory walkout and HBM reallocation mean the crunch won't clear before late 2027 at earliest.