Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 68.5k 12.9k

2. sgl-project/sglang sgl-project/sglang Public

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 22.7k 4.2k

3. volcengine/verl volcengine/verl Public

   verl: Volcano Engine Reinforcement Learning for LLMs

   Python 18.7k 3.1k

4. NVIDIA/Megatron-LM NVIDIA/Megatron-LM Public

   Ongoing research training transformer models at scale

   Python 15k 3.5k

5. aliyun/SimAI aliyun/SimAI Public

   C++ 803 129

6. aliyun/aicb aliyun/aicb Public

   HTML 230 49