trzy/llava-cpp-server
LLaVA server (llama.cpp).
This tool helps developers integrate LLaVA, a large language and vision model, into their applications. It takes an image and a text prompt as input and returns a text response describing the image or answering questions about it. This is designed for software developers building applications that need to understand and interact with visual information.
183 stars. No commits in the last 6 months.
Use this if you are a developer looking to add image understanding capabilities to your applications using a local LLaVA model via a simple API.
Not ideal if you are a non-technical user looking for a ready-to-use application to analyze images, as this requires development skills to set up and integrate.
Stars
183
Forks
11
Language
C++
License
MIT
Category
Last pushed
Oct 20, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/trzy/llava-cpp-server"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
ludwig-ai/ludwig
Low-code framework for building custom LLMs, neural networks, and other AI models
withcatai/node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema...
mudler/LocalAI
:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and...
zhudotexe/kani
kani (カニ) is a highly hackable microframework for tool-calling language models. (NLP-OSS @ EMNLP 2023)
SciSharp/LLamaSharp
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.