Local LLMs & Inference

awesome-hosting

by dalisoft

View on GitHub

awesome-hosting is an open-source LLM inference tool from dalisoft, licensed under MIT. With 944 stars on GitHub, it was last updated in October 2026. Related topics: ai, clawdbot and cloud.

“List of awesome hosting sorted by minimal plan price”

— dalisoft, project description on GitHub

Details

CategoryLocal LLMs & Inference
GitHub stars944
Forks137
LicenseMIT
Last updated
Ownerdalisoft
Repositorydalisoft/awesome-hosting

Tags

aiclawdbotclouddatabasedeepseek-r1freehostingiaas

Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.

All Local LLMs & Inference

chatllm.cpp

Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)

Local LLMs & Inference933 stars

ZhiLight

A highly optimized LLM inference acceleration engine for Llama and its variants.

Local LLMs & Inference907 stars

llm_note

LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.

Local LLMs & Inference893 stars

LLM.swift

LLM.swift is a simple and readable library that allows you to interact with large language models locally…

Local LLMs & Inference882 stars

lws

LeaderWorkerSet: An API for deploying a group of pods as a unit of replication

Local LLMs & Inference882 stars

gpt4all

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

Local LLMs & Inference77k stars