leftmove/cria
Run LLMs locally with as little friction as possible.
This tool helps developers integrate Large Language Models (LLMs) directly into their Python applications with minimal setup. It takes natural language prompts or structured messages as input and returns text-based responses from an LLM. Developers can use this to add AI capabilities, such as content generation or intelligent assistants, to their software without relying on external APIs or internet connectivity.
121 stars. No commits in the last 6 months.
Use this if you are a Python developer who wants to run LLMs locally and programmatically within your applications, prioritizing ease of use and offline capability.
Not ideal if you are an end-user without programming skills, or if your application requires highly specific or specialized LLM features not supported by local models.
Stars
121
Forks
5
Language
Python
License
MIT
Category
Last pushed
May 03, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/leftmove/cria"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
ludwig-ai/ludwig
Low-code framework for building custom LLMs, neural networks, and other AI models
withcatai/node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema...
mudler/LocalAI
:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and...
zhudotexe/kani
kani (カニ) is a highly hackable microframework for tool-calling language models. (NLP-OSS @ EMNLP 2023)
SciSharp/LLamaSharp
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.