News
DeepInfer open-source repo enables offline inference on NVIDIA and Huawei hardware
DeepInfer powers DeepSeek's production services and now supports offline inference for DeepSeek-V4.1-Flash on NVIDIA SM100 GPUs and Huawei Ascend 950 NPUs, featuring KV cache and load balancing components.