44 Minutes, 176k Tokens: Fable 5.1 Cracks a 370-Year-Old Cipher
Vals AI gave Claude Fable 5.1 Urquhart's unsolved Cyphral Distich: solved in 44 minutes, 176k tokens, zero interjections — and it went on to decode the 285-number Octastich too.
#ai
56 posts
TPU 8i Adds 288GB HBM and 384MB SRAM for Agent Inference
Google's eighth-gen TPUs split into TPU 8t for training (121 ExaFlops, 9,600 chips) and TPU 8i for inference (288GB HBM, 80% better perf-per-dollar).
AMD Threadripper Halo Station: 576GB HBM3E for Trillion-Parameter Workloads
AMD's Threadripper Halo Station packs a 96-core CPU with dual MI350P accelerators and up to 576GB of HBM3E — a $150K desktop that runs trillion-parameter models locally.
10,000 Agents in 88 Hours Prove a 90-Year-Old Navier-Stokes Problem
An unnamed internal model plus ~10,000 coordinating agents closed the Navier-Stokes Millennium Problem in ~88h (130B tokens), with a verified Lean proof. The capability step OpenAI's flagging.
GPT-6 Astra Shifts the Frontier Model Calculus—99.9% on ARC, 100% on Exploits
GPT-6 Astra saturates benchmarks and raises the bar on computer use, coding, and cybersecurity. Teams must now reconsider whether open-weights or smaller fine-tuned agents remain cost-effective.
NVIDIA's Custom HBM Signals Memory Bandwidth Is the New Constraint
NVIDIA's NVHBM moves memory control to the HBM stack itself, not the GPU. This architectural shift reveals memory bandwidth, not compute cores, is the real scaling bottleneck for AI inference.
Gemini 3.8 Flash Cuts Agent Latency—Same Speed, Bigger Reasoning Budget
Google's Gemini 3.8 Flash delivers frontier-level coding and reasoning at Flash speed and cost ($0.75/1M in tokens). A Cyber variant targets vulnerability discovery and patching.
Your 4-Bit Model Can Now Beat Its 16-Bit Original
Quantization-Aware Healing distills a 4-bit model from the pre-compression teacher, winning 7 of 9 benchmarks over its bf16 source.
Granite 4.2 Brings Agentic RL Down to a 3B Open-Weights Model
IBM's Granite 4.2 — 3B/8B/30B, Apache 2.0, 512K context, thinking/non-thinking switch, and agentic RL on 8B/30B with real SWE, terminal, and search environments.
GLM-5.3 Hits 88.2 on Terminal Bench 2.1 as Open-Weights
Z.ai open-sourced GLM-5.3 (753B MoE). 88.2 on Terminal Bench 2.1 and 28.3 on TB 3.0, serving via vLLM/SGLang with a reasoning_effort flag and 23 existing quantizations.
1T-Param Model Hits 1000 tok/s Without Custom Silicon
TileRT 1.5 runs a 1T-param Xiaomi model at 1000+ tokens/s on a single 8x B200 node. Here's the exact stack, commands, and where it fits for low-latency serving.
Ox Alpha: The 'Stealth Model' Nobody Will Claim
On 20 August, a model called Ox Alpha appeared on OpenRouter — free, 1M context, labeled a "stealth model" with an anonymous developer. Within 48 hours the speculation was circling: Z.ai's unreleased GLM, Microsoft's MAI, xAI. What is actually in the record, and why the anonymity is the real story.
Qwen 3.8-27B: 73 on Terminal Bench 2.1 and Still a 24 GB Model
Qwen 3.8-27B is the new dense flagship you can run on a single 24-32 GB GPU. It jumps to 73.0 on Terminal Bench 2.1 (up from 63.4), adds native image and hour-scale video understanding, and ships under Apache 2.0. What changed versus Qwen3.6-27B, how to run it at 4-bit, and the catches I would watch.
DeepSeek V4 Flash 0731: 82.7 on Terminal Bench, at a Third of Pro's Output Price
DeepSeek's re-post-trained DeepSeek-V4-Flash-0731 scores 82.7 on Terminal Bench 2.1 — reportedly beating its own near-6x larger V4-Pro-Preview — and now speaks the Responses API natively for Codex-style harnesses. What actually shipped, how to split high vs max effort, and the verbosity caveat that quietly resets the per-task math.
vLLM 0.27 Removes First-Request Stalls — But Torch 2.13 Is Breaking
vLLM 0.27.0 (Aug 10) ships JIT warmup and runner-owned Triton warmup that eliminate first-request compile stalls, plus Kimi K3 support — but the torch 2.13.0 upgrade is a breaking change that needs migration testing before you bump.
Opus Is Pro+-Only Now That Copilot Pro Meters Every Call
Copilot Pro now meters every model call, Opus moved to Pro+ only, and limits split 5X between tiers — budget for metering.
Hybrid-Attention Models Finally Run Offline in vLLM
vLLM v0.27.0 lets hybrid SWA+full attention models run through offline inference, closing the gap between eval and serving — plus a breaking torch 2.13 upgrade.
Your Long-Running Agents Can Now Survive a Crash
Microsoft Agent Framework ships a batteries-included harness: chat-history persistence after every model call, plan/execute modes, approval, and telemetry — resumable by default.
Worktree Isolation and Crash Recovery Arrive in a Free Terminal Agent
Meta's Muse Code beta brings parallel sub-agents in isolated Git worktrees and a crash-safe event log, offering a free terminal agent alternative to Claude Code.
Retune Draft Models Without Restarting vLLM
vLLM v0.26.0 adds runtime draft-weight updates, so you can retune speculative decoding without restarting the engine and flushing the KV cache.
Your Nova Deployments Are Going Away — Plan the Migration Now
Amazon is deprecating Nova Premier, Omni, Reel and Canvas in a strategic pivot. Audit your Bedrock calls now, before a deadline lands.
Agent Infrastructure Now Targets Memory Bottlenecks—PB-Scale Storage Changes Deployment
Huawei Cloud's new Agentic Infra adds PB-scale memory storage and unified scheduling. What this means for long-horizon agent tasks and where the real constraint sits.
Ruflo's MCP Bridge Exposes 233 Tools Without Auth—CVE-2026-59726
CVE-2026-59726 lets unauthenticated attackers execute shell commands, steal LLM keys, and poison agent memory via Ruflo's exposed /mcp endpoint. Upgrade to 3.16.3 and audit immediately.
Agents Now Call Physics Solvers Like Any Tool
NVIDIA embeds sparse linear algebra solvers into the Agent Toolkit—cuISS, cuDSS, cuEST—so autonomous design agents call physics simulation without leaving the flow. Free libraries, GPU-only execution.
AMD EPYC Venice Launches July 22–24: 576 Cores, 12 TB/s Memory Bandwidth
AMD's Zen 6 EPYC Venice debuts next week with up to 576 cores, 12 TB/s memory bandwidth, and native AVX-1024 support. Here's what changes for AI infrastructure.
Your Coding Agents Are Now a Direct RCE Vector
Straiker's STAR Labs found 36% of successful coding agent attacks achieve remote code execution on developer machines holding source code and cloud keys. MCP ecosystem unvetted.
Your AI Stack Choices Lock You Into Years of Vendor Control
Sovereign AI isn't data residency. It's territorial, operational, technological, legal—and financial control. The three case studies that changed CFO thinking in Q1 2026.
Stacking RL on Already-RL Models Breaks the Ceiling
Cognition's SWE-1.7 adds 12.2 points atop an already-trained base, challenging the field's assumption that RL post-training hits a hard wall.
295B Parameters, 21B Active—Hy3 Proves Size Isn't Agent Performance
Tencent's Hy3 benchmarks between models 2–5x larger by parameter count. 256K context, Apache 2.0, 1 yuan per million input tokens. The catch: vendor benchmarks need independent testing.
Task-Specific Logic Compiles to 23MB Files Running Offline on 600M Models
University of Waterloo's PAW system compiles fuzzy-function specs into 23MB LoRA adapters that match 32B model accuracy on a 600M interpreter—no API calls, no cloud dependency, 30 tok/s on MacBook M3.
Your Agents Must Now Reuse Your Design System
A2UI v0.9 flips the script: agents declare UI intent against your existing design catalog, not invent components. What changes for agentic architectures.
GLM-5.2 Shifts Agentic Coding Economics to 1/6th Frontier Cost
Z.AI's open-weights GLM-5.2 hits 81% on Terminal-Bench, undercutting GPT-5.5 for a fraction of the cost. Here's the benchmark breakdown.
DiffusionGemma Puts 1000+ tok/s on an RTX 5090
Google's open 26B diffusion model hits 700+ tok/s on consumer GPUs with day-zero vLLM support. Here's what the bidirectional architecture changes for local inference.
NVIDIA Halves Vera Rubin Memory — LPDDR5X Shortage Hits First
NVIDIA's next-gen Vera Rubin drops standard CPU memory from 54TB to 28TB per rack. Here's what the LPDDR5X shortage means for AI infrastructure.
CI/CD Workflows Just Leaked Secrets to Untrusted Prompts
Microsoft found Claude Code's GitHub Action exposes runner secrets via the Read tool. Here's the exact attack path and how to lock it down.
OpenAI's $85B Burn Rate Changes the AI Cost Equation
The SEC filing exposes a nine-to-one burn-to-revenue ratio. Here is why local inference is shifting from a privacy play to a hard P&L requirement.
Your API Costs Are About to Correct
OpenAI's IPO filing ends the era of subsidized frontier AI. Here's what the pricing shift means for local inference, enterprise contracts, and your agentic stack.
Low-Code AI Automations: How Gartner Sees the Future of Development
By 2026, 70-75% of enterprise apps will use low-code platforms. AI-powered low-code will drive 80% of app development by 2029, mainly from non-IT users. Yet 40% of agentic AI projects face cancellation due to governance gaps. OutSystems, Mendix, and Appian lead the market. Success requires training, governance, and embedded security.
NVIDIA's First Server CPU Clears the Performance Floor
NVIDIA's Vera CPU benchmarks show it competes directly with EPYC and Xeon, but software maturity and platform lock-in dictate adoption.
Workstations Get 192GB RAM and 160GB VRAM for AI in Q3
AMD's next-gen Ryzen AI Max chips bring desktop AI consolidation, massive unified memory, and high NPU TOPS to compact workstations starting this fall.
Claude Code's /simplify Stopped Fixing Code Yesterday
Claude Code 2.1.147 renamed /simplify to /code-review and dropped the auto-fix behavior. The new command reports bugs at chosen effort levels but no longer changes code.
Your Private MCP Server Is Now Claude-Reachable
Anthropic shipped MCP tunnels on May 19. Claude agents can call internal databases, ticketing systems, and on-prem APIs through one outbound connection — no inbound firewall rules required.
Your vLLM Thinking Budget Was Doing Nothing With MTP On
vLLM 0.21.0 shipped Friday with a quiet fix: thinking_token_budget was being silently ignored when MTP speculative decoding was enabled. If you serve reasoning models with spec decode, you have been paying for it.
Claude Code v2.1.100+ Burns ~20K Phantom Tokens Per Request
A server-side bug in Claude Code v2.1.100+ inflates every request by roughly 20K cache_creation tokens — about 40% overhead. Pin v2.1.98 until fixed.
Your Local Qwen3.6 Throughput Probably Just Halved (and How to Fix It)
llama.cpp renamed the MTP flag on May 13. The old --spec-type mtp is silently ignored. If your tok/s dropped from 140 to 70 you are likely running without speculative decoding.
MCP Server Roundup: Which Are Actually Worth Adding to Your Setup in May 2026
Eighteen months after Anthropic released MCP, the ecosystem is wide enough that picking the wrong servers slows your agent down. Here is the practical short list — what to install, what to skip, and the trap most people fall into.
Speculative Decoding Explained: Why Your Local Model Got 2× Faster in 2026
The same Qwen3.6-27B that ran at 70 tokens/sec on a 4090 in January was running at 140 tokens/sec by April. Nothing changed about the model. Speculative decoding moved from research curiosity to default. Here is what it actually does.
Third-Party Claude Agents Lose the Subscription Subsidy June 15
Anthropic is splitting Claude billing on June 15 — Agent SDK and ACP usage moves to a capped credit pool ($20/$100/$200) at full API rates.
The Local AI Inflection Point: May 2026
Three model releases in three weeks moved local AI from 'good enough for hobbies' to 'good enough for production'. Here's what changed and why it matters.
Running Qwen3.6-27B Locally: Hardware, Quantization, and What Actually Works
A practical guide to running Qwen3.6-27B on consumer hardware in 2026 — memory requirements per quant level, recommended runners, and the MTP trick that doubles your tokens per second.
A 27B Model on a Single GPU Is 10 Points Off Claude Opus 4.7
Qwen3.6-27B running locally now scores within 10 points of frontier closed models on SWE-bench Verified. The benchmark table, lined up side by side.
Claude Opus 4.7: 87.6% on SWE-bench and 1M Context at Standard Pricing
Anthropic shipped Opus 4.7 on April 16, 2026, with a seven-point SWE-bench jump, the 1M context window now generally available with no premium, and a new task budget primitive for agent loops.
Gemma 4: Google's Open Model Family Goes Multimodal
Google released Gemma 4 on April 2, 2026 — four variants from 2B to 31B, with 256K context, native vision and audio, and Apache 2.0 licensing. Here's what it's for, where it fits, and how to run it.
Claude Opus 4.6: A Million-Token Context and a New Agent Team Model
Anthropic released Opus 4.6 on February 5, 2026, with a 1M token context beta, agent teams, adaptive thinking, and developer effort controls — all at the same price as 4.5.
Claude Opus 4.5: Anthropic's New Flagship Model Sets the Bar for AI Coding
Anthropic's latest model achieves state-of-the-art results in agentic coding and brings meaningful improvements across reasoning, mathematics, and everyday tasks.
Google Gemini 3 Pro: The New Leader in Multimodal AI
Google's Gemini 3 Pro brings generative interfaces, 1M token context, and state-of-the-art multimodal reasoning to developers and consumers alike.