aratan/ApiCloudLLaMA
The idea is to make an api that everyone can consume in their GPT4-like applications but with free models, to democratize its use.
Api Cloud LLaMA helps developers integrate powerful language model capabilities into their applications without incurring costs associated with proprietary services like GPT-4. By running this local API, developers can send text prompts and receive generated text responses from open-source language models. This is ideal for developers building new applications or adding AI features, who want to leverage large language models.
No commits in the last 6 months.
Use this if you are a developer looking to add language model functionality to your applications using open-source models, without relying on external, often costly, third-party APIs.
Not ideal if you are an end-user without programming skills, as this project requires technical setup and API interaction via code.
Stars
13
Forks
—
Language
Go
License
GPL-3.0
Category
Last pushed
Sep 05, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/aratan/ApiCloudLLaMA"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
ludwig-ai/ludwig
Low-code framework for building custom LLMs, neural networks, and other AI models
withcatai/node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema...
mudler/LocalAI
:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and...
zhudotexe/kani
kani (カニ) is a highly hackable microframework for tool-calling language models. (NLP-OSS @ EMNLP 2023)
SciSharp/LLamaSharp
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.