Popular repositories Loading
Repositories
Showing 10 of 65 repositories
- flex_shard Public
Flexible parameter sharding and distributed optimization utilities for PyTorch training
-
- dist_moe Public
Dist-MoE implements Speed-of-Light distributed Mixture-of-Experts forward and backward kernels. They are highly optimized and fused comm-compute kernels for training and inference on SM100+ GPUs
- MSLK Public
MSLK (Meta Superintelligence Labs Kernels) is a collection of PyTorch GPU operator libraries that are designed and optimized for GenAI training and inference, such as FP8 row-wise quantization and collective communications.
-
-
-
-
