榜单积累中
快照数据正在积累,增长榜需要至少 2 个有效快照日。
2026-11-16 · #moe · 6 个仓库 · 按 star 排序repos · by stars
1
SGLang is a high-performance serving framework for large language models and multimodal models.
★ 38,901
2
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
★ 17,219
3
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).
★ 16,105
4
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
★ 15,079
5
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
★ 12,133