sgl-project

Pinned Loading

1. sglang sglang Public

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 38.4k 10.1k

2. sglang-torchtpu sglang-torchtpu Public

   SGLang's TorchTPU Plugin

   Python 74 28

3. SpecForge SpecForge Public

   Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

   Python 1.3k 383

4. sglang-omni sglang-omni Public

   High Performance Serving Runtime For Interactive Super Intelligence System

   Python 1.7k 684

5. mini-sglang mini-sglang Public

   A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.

   Python 5.5k 955

6. sglang-jax sglang-jax Public

   JAX backend for SGL

   Python 374 161