rahuldshetty/llm.js
Run Large-Language Models (LLMs) 🚀 directly in your browser!
This project helps web developers integrate Large Language Models (LLMs) directly into web browsers. It takes various LLM model files as input and allows their output to be displayed within a web application, even on smartphones. Web developers looking to add AI capabilities to their browser-based tools would use this.
228 stars. No commits in the last 6 months. Available on npm.
Use this if you are a web developer who wants to run LLMs directly in your users' browsers without requiring server-side processing.
Not ideal if you are looking for a pre-built application that uses LLMs, rather than a development tool to build such an application.
Stars
228
Forks
15
Language
JavaScript
License
Apache-2.0
Category
Last pushed
Sep 08, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/rahuldshetty/llm.js"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Compare
Higher-rated alternatives
mlc-ai/web-llm
High-performance In-browser LLM Inference Engine
e2b-dev/desktop
E2B Desktop Sandbox for LLMs. E2B Sandbox with desktop graphical environment that you can...
geekjr/quickai
QuickAI is a Python library that makes it extremely easy to experiment with state-of-the-art...
Azure-Samples/llama-index-javascript
This sample shows how to quickly get started with LlamaIndex.ai on Azure 🚀
AkagawaTsurunaki/zerolan-core
ZerolanCore integrates many open-source, locally deployable AI models, and aims to integrate a...