Self-Host DeepSeek-V4.1-Flash With DeepInfer on SM100 or Ascend
DeepSeek open-sourced DeepInfer, its production inference framework, under Apache-2.0. It is offline-only, SM100/Ascend 950 only. Env vars and gaps inside.
3 posts
DeepSeek open-sourced DeepInfer, its production inference framework, under Apache-2.0. It is offline-only, SM100/Ascend 950 only. Env vars and gaps inside.
DeepSeek-V4.1-Flash-1017 (MIT, 763B params) lifts Terminal-Bench 4.0 from 31.2 to 42.3. Benchmark table, serving commands, sampling settings and missing details.
DeepSeek's re-post-trained DeepSeek-V4-Flash-0731 scores 82.7 on Terminal Bench 2.1 — reportedly beating its own near-6x larger V4-Pro-Preview — and now speaks the Responses API natively for Codex-style harnesses. What actually shipped, how to split high vs max effort, and the verbosity caveat that quietly resets the per-task math.