GitHub Trending Rank Radar

GitHub 开源项目趋势榜单 · 每日双快照 · 十一种榜单 · 日 / 月 / 年历史回看

GitHub

独立采集 · 开源数据

独立追踪 GitHub 星标的每一次脉动

每日两次快照,用差值还原真实增长——不是又一份热榜镜像。

浏览今日榜单 →
Star 范围 – k

2026-11-16 · #llm-serving · 4 个仓库 · 按 star 排序repos · by stars

1
Python★ 96,966⑂ 24,859👁 604● 19,883⑃ 47,020▤ 109
A high-throughput and memory-efficient inference and serving engine for LLMs
★ 96,966
2
Python★ 15,079⑂ 2,936👁 119● 4,252⑃ 17,811▤ 96
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
★ 15,079
3
Python★ 8,941⑂ 1,065👁 80● 1,186⑃ 4,312▤ 195
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
★ 8,941
4
Python★ 7,862⑂ 635👁 22● 8⑃ 32▤ 28
《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
★ 7,862
当月每日飙升 Top10 摘要

年度月度榜入口