Local LLMs & Inference

LLM.swift

by eastriverlee · Swift

Built in Swift, LLM.swift is an open-source LLM inference tool maintained by eastriverlee. With 882 stars on GitHub, it was last updated in July 2026. Related topics: gguf, ios and llm.

“LLM.swift is a simple and readable library that allows you to interact with large language models locally with ease for macOS, iOS, watchOS, tvOS, and visionOS.”

— eastriverlee, project description on GitHub

Details

CategoryLocal LLMs & Inference
GitHub stars882
Forks125
LanguageSwift
LicenseMIT
Last updated
Ownereastriverlee
Repositoryeastriverlee/LLM.swift

Tags

ggufiosllmllm-inferencemacosswifttvosvisionos

Repository facts from the GitHub public API, refreshed October 18, 2026. The quoted tagline is written by the project owner; the summary above is generated from public facts.

All Local LLMs & Inference

lws

LeaderWorkerSet: An API for deploying a group of pods as a unit of replication

Local LLMs & Inference882 stars

gpt4all

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

Local LLMs & Inference77k stars

ray

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for…

Local LLMs & Inference44k stars

gitleaks

Find secrets with Gitleaks 🔑

Local LLMs & Inference30k stars

llm-action

本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)

Local LLMs & Inference25k stars

litgpt

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Local LLMs & Inference14k stars