DeepEP

The first open-source communication library purpose-built for Mixture-of-Experts (MoE) dispatch and combine operations. Implements custom NVLink kernels within nodes and RDMA InfiniBand across nodes, overlapping MoE communication directly with GPU matrix computation.

https://github.com/deepseek-ai/DeepEP

• Eliminates standard NCCL all-to-all serialization bottlenecks across thousands of GPUs.
• Overlaps expert token dispatch and combine with upstream layer tensor calculations.
• Critical communication foundation for both V3, V4-Pro, and V4.1-Flash clusters.

All libraries