mybigday/llama.node
Node.js binding of llama.cpp
This project helps JavaScript and Node.js developers integrate large language models (LLMs) like LLaMA directly into their applications. It takes a pre-trained LLaMA model file and allows developers to send text prompts, receiving generated text completions. This is ideal for developers building chat applications, content generation tools, or other AI-powered features in their Node.js environments.
Use this if you are a JavaScript or Node.js developer who needs to embed a large language model's text generation capabilities directly into your application, leveraging local hardware acceleration.
Not ideal if you are looking for a pre-built end-user application or if you prefer to use cloud-based LLM APIs rather than managing local model inference.
Stars
19
Forks
4
Language
C++
License
—
Category
Last pushed
Mar 11, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/mybigday/llama.node"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
ludwig-ai/ludwig
Low-code framework for building custom LLMs, neural networks, and other AI models
withcatai/node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema...
mudler/LocalAI
:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and...
zhudotexe/kani
kani (カニ) is a highly hackable microframework for tool-calling language models. (NLP-OSS @ EMNLP 2023)
SciSharp/LLamaSharp
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.