zats/local-llm
Apple's FoundationModels for the web. Chrome and Safari, macOS and iOS
This project helps web developers integrate powerful, private AI capabilities directly into their web applications. It takes local language models running on macOS devices and makes them accessible via a simple JavaScript API, enabling features like text generation or summarization. Web developers who want to create AI-powered web experiences without sending user data to external servers would use this.
No commits in the last 6 months.
Use this if you are a web developer building a modern web application and want to incorporate on-device AI functionality while prioritizing user privacy and avoiding API costs.
Not ideal if your application requires server-side AI processing, needs to run on non-macOS platforms, or doesn't involve web technologies.
Stars
15
Forks
1
Language
Swift
License
MIT
Category
Last pushed
Jul 09, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/zats/local-llm"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
Meridius-Labs/apple-on-device-ai
Apple foundation model bindings for NodeJS (supports Vercel AI SDK)
blacktop/go-foundationmodels
Pure Go wrapper for Apple's Foundation Models
IvanCampos/Foundation-Models-Playgrounds
Playground examples to demonstrate Foundation Models Framework
timokoethe/Localight
A SwiftUI-based iOS 26 app featuring a fully local chatbot powered by Apple’s Foundation Models....
Arthur-Ficial/apfel
Apple Intelligence from the command line. On-device LLM via FoundationModels framework. No API...