Local LLMs & Inference

kimi-k3-in-c

by FareedKhan-dev · C

kimi-k3-in-c is an open-source LLM inference tool written in C, released under the Apache-2.0 license. The repository has collected 9.1k stars and 1.5k forks; the latest push was in October 2026. Docs and downloads are linked from medium.com.

“A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.”

— FareedKhan-dev, project description on GitHub

Details

CategoryLocal LLMs & Inference
GitHub stars9,098
Forks1,486
LanguageC
LicenseApache-2.0
Last updated
OwnerFareedKhan-dev
Websitemedium.com/@fareedkhandev/building-kimi-k3-in-c-to-run-a-2-8t-model-on-consumer-hardware-a5792cbf3b59
RepositoryFareedKhan-dev/kimi-k3-in-c

Tags

avx2c99cpu-inferencedeep-learningfrom-scratchinference-enginekimi-k3linear-attention

Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.

All Local LLMs & Inference

BentoML

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model…

Local LLMs & Inference8.9k stars

dynamo

A Datacenter Scale Distributed Inference Serving Framework

Local LLMs & Inference8.3k stars

lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Local LLMs & Inference8.1k stars

openevolve

Open-source implementation of AlphaEvolve

Local LLMs & Inference7.6k stars

plano

Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent…

Local LLMs & Inference7.1k stars

turbo-fieldfare

Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

Local LLMs & Inference6.9k stars