榜单积累中
快照数据正在积累,增长榜需要至少 2 个有效快照日。
2026-11-16 · #llm-inference · 10 个仓库 · 按 star 排序repos · by stars
2
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
★ 12,133
4
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
★ 8,941
7
📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉
★ 5,558