Pinned Loading

1. gc-moe gc-moe Public

   GC MoE is a CuTe DSL implementation of FP8/FP4 mixture-of-experts inference with CUDA Green Contexts for NVIDIA Hopper and Blackwell GPUs.

   Python 15 2

2. cuda_auto_tune cuda_auto_tune Public

   NCU-driven iterative optimization workflow for CUDA/CUTLASS/Triton/CuTe DSL kernels.

   Python 25 3

3. decoding_attention decoding_attention Public

   Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.

   C++ 48 4

4. cuda_hgemm cuda_hgemm Public

   Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruction.

   Cuda 575 93

5. cuda_hook cuda_hook Public

   Hooked CUDA-related dynamic libraries by using automated code generation tools.

   C 173 48

6. cuda_hgemv cuda_hgemv Public

   Several optimization methods of half-precision general matrix vector multiplication (HGEMV) using CUDA core.

   Cuda 77 9