gsuuon/ad-llama
Structured inference with Llama 2 in your browser
This project helps web developers build interactive AI applications that run directly in a user's browser, without needing a powerful server. It takes natural language prompts and specific formatting instructions, then outputs structured text, like a character's name, description, and class, in a predictable JSON format. Web developers creating browser-based tools that need to generate structured data using AI would use this.
No commits in the last 6 months. Available on npm.
Use this if you are a web developer building browser-based applications that require generating structured text output from AI models directly in the user's browser.
Not ideal if you need to integrate AI with server-side applications, or if your primary audience is not a web developer.
Stars
52
Forks
2
Language
TypeScript
License
MIT
Category
Last pushed
Nov 01, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/gsuuon/ad-llama"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
containers/ramalama
RamaLama is an open-source developer tool that simplifies the local serving of AI models from...
av/harbor
One command brings a complete pre-wired LLM stack with hundreds of services to explore.
RunanywhereAI/runanywhere-sdks
Production ready toolkit to run AI locally
runpod-workers/worker-vllm
The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
foldl/chatllm.cpp
Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)