榜单积累中
快照数据正在积累,增长榜需要至少 2 个有效快照日。
2026-11-16 · #inference · 20 个仓库 · 按 star 排序repos · by stars
2
Ultralytics YOLOv5 in PyTorch for object detection, instance segmentation, classification, training, and export.
★ 58,272
4
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
★ 43,326
6
SGLang is a high-performance serving framework for large language models and multimodal models.
★ 38,901
8
ncnn is a high-performance neural network inference framework optimized for the mobile platform
★ 24,052
10
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
★ 17,219
12
Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.
★ 9,657
14
Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.
★ 9,034
16
Native MLX runtime for Laya typed decision models — 7–14 ms short decisions on M3 Max. No text generation, PyTorch, or cloud API.
★ 7,104