rtp-llm is an open-source LLMOps tool from alibaba, licensed under Apache-2.0. With 1.4k stars on GitHub, it was last updated in October 2026. Related topics: gpt, inference and llama.
“RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.”
— alibaba, project description on GitHub
Details
| Category | LLM Frameworks & MLOps |
|---|---|
| GitHub stars | 1,362 |
| Forks | 284 |
| Language | Python |
| License | Apache-2.0 |
| Last updated | |
| Owner | alibaba |
| Repository | alibaba/rtp-llm |
Tags
gptinferencellamallmllm-servingllmopsmodel-serving
Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.