Jewelzufo/granitepi-4-nano
Run IBM Granite 4.0 locally on Raspberry Pi 5 with Ollama.This is a privacy-first AI. Your data never leaves your device because it runs 100% locally. There are no cloud uploads and no third-party tracking.
This project helps individuals and small organizations run a powerful AI model, IBM Granite 4.0, directly on a Raspberry Pi 5. It takes your text prompts and generates responses or completes tasks, entirely on your device, ensuring privacy. This is ideal for anyone who needs AI capabilities without sending sensitive data to cloud services.
Use this if you need a private, offline AI assistant for text generation, coding help, or general knowledge queries, and you want to utilize affordable, local hardware like a Raspberry Pi 5.
Not ideal if you need an AI for image generation, video analysis, or complex real-time applications that require more powerful, dedicated AI hardware.
Stars
10
Forks
1
Language
Shell
License
Apache-2.0
Category
Last pushed
Mar 06, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/Jewelzufo/granitepi-4-nano"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
containers/ramalama
RamaLama is an open-source developer tool that simplifies the local serving of AI models from...
av/harbor
One command brings a complete pre-wired LLM stack with hundreds of services to explore.
RunanywhereAI/runanywhere-sdks
Production ready toolkit to run AI locally
runpod-workers/worker-vllm
The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
foldl/chatllm.cpp
Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)