wizzard0/llama2.ts
Llama2 inference in one TypeScript file
This project helps developers integrate Llama2-like transformer models directly into their TypeScript applications. It takes a pre-trained model binary and an initial text prompt, then generates new text based on the model's understanding. It's intended for software engineers, web developers, or anyone building applications that require local, lightweight text generation capabilities.
No commits in the last 6 months.
Use this if you are a developer looking to experiment with or embed small-scale Llama2 text generation capabilities directly within a TypeScript or JavaScript environment.
Not ideal if you are an end-user without programming experience, or if you need to train large language models or deploy high-performance, large-scale inference solutions.
Stars
20
Forks
2
Language
JavaScript
License
MIT
Category
Last pushed
May 29, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/wizzard0/llama2.ts"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
containers/ramalama
RamaLama is an open-source developer tool that simplifies the local serving of AI models from...
av/harbor
One command brings a complete pre-wired LLM stack with hundreds of services to explore.
RunanywhereAI/runanywhere-sdks
Production ready toolkit to run AI locally
runpod-workers/worker-vllm
The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
foldl/chatllm.cpp
Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)