spiceai is an open-source LLM inference tool written in Rust, released under the Apache-2.0 license. With 3.1k stars on GitHub, it was last updated in October 2026. Related topics: artificial-intelligence, data and data-federation.
“Add a real-time analytics node to your operational database. Spice is a portable, accelerated SQL query, search, and LLM-inference engine in Rust for data-grounded AI apps and agents.”
— spiceai, project description on GitHub
Details
| Category | Local LLMs & Inference |
|---|---|
| GitHub stars | 3,099 |
| Forks | 237 |
| Language | Rust |
| License | Apache-2.0 |
| Last updated | |
| Owner | spiceai |
| Website | docs.spiceai.org |
| Repository | spiceai/spiceai |
Tags
artificial-intelligencedatadata-federationdevelopersfull-text-searchinfrastructurellm-inferencemachine-learning
Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.