6 posts
NVIDIA's NVHBM moves memory control to the HBM stack itself, not the GPU. This architectural shift reveals memory bandwidth, not compute cores, is the real scaling bottleneck for AI inference.
Nvidia's Vera server CPU, 88 Olympus cores, targets AI inference. A credible alternative for token-heavy workloads, but software matters.
NVIDIA cut RTX 50 supply by 20% and sidelined the 5070 Ti. Street prices are up 19%. Here's how it changes your local AI build.
NVIDIA's next-gen Vera Rubin drops standard CPU memory from 54TB to 28TB per rack. Here's what the LPDDR5X shortage means for AI infrastructure.
NVIDIA's first consumer SoC brings 128 GB of unified memory and native CUDA to Windows laptops — here's what it means for running LLMs locally, and the catches.
NVIDIA's Vera CPU benchmarks show it competes directly with EPYC and Xeon, but software maturity and platform lock-in dictate adoption.