Local LLMs & Inference

AI-Compass

by tingaicompass · Python

AI-Compass is an open-source LLM inference tool published on GitHub by tingaicompass. It has 983 GitHub stars and 128 forks, and was last updated in October 2026. Docs and downloads are linked from blog.csdn.net.

““AI-Compass”将为社区指引在 AI 技术海洋中航行的方向,无论你是初学者还是进阶开发者,都能在这里找到通往 AI 各大方向的路径。旨在帮助开发者系统性地了解 AI 的核心概念、主流技术、前沿趋势,并通过实践掌握从理论到落地的全过程。”

— tingaicompass, project description on GitHub

Details

CategoryLocal LLMs & Inference
GitHub stars983
Forks128
LanguagePython
Last updated
Ownertingaicompass
Websiteblog.csdn.net/sinat_39620217?spm=1011.2124.3001.5343
Repositorytingaicompass/AI-Compass

Tags

agentaillmllm-inferencellm-trainingnlprlrlhf

Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.

All Local LLMs & Inference

awesome-hosting

List of awesome hosting sorted by minimal plan price

Local LLMs & Inference944 stars

chatllm.cpp

Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)

Local LLMs & Inference933 stars

ZhiLight

A highly optimized LLM inference acceleration engine for Llama and its variants.

Local LLMs & Inference907 stars

llm_note

LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.

Local LLMs & Inference893 stars

LLM.swift

LLM.swift is a simple and readable library that allows you to interact with large language models locally…

Local LLMs & Inference882 stars

lws

LeaderWorkerSet: An API for deploying a group of pods as a unit of replication

Local LLMs & Inference882 stars