Built in Rust, paddler is an open-source LLMOps tool maintained by intentee. With 1.7k stars on GitHub, it was last updated in October 2026. Related topics: ai, llamacpp and llm.
“Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.”
— intentee, project description on GitHub
Details
| Category | LLM Frameworks & MLOps |
|---|---|
| GitHub stars | 1,679 |
| Forks | 112 |
| Language | Rust |
| License | Apache-2.0 |
| Last updated | |
| Owner | intentee |
| Website | paddler.intentee.com |
| Repository | intentee/paddler |
Tags
aillamacppllmllmopsload-balancer
Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.