mrdiamonddirt/local-llama-chrome-extension
A chrome extention for quering a local llm model using llama-cpp-python, includes a pip package for running the server, 'pip install local-llama' to install
This tool helps you quickly get answers or generate text using an AI model directly within your web browser. You highlight text on a webpage, and the extension sends it to a local AI model on your computer, displaying the AI's response in a popup. It's designed for anyone who frequently uses large language models for tasks like summarizing, drafting emails, or brainstorming while browsing.
No commits in the last 6 months.
Use this if you want to interact with a powerful AI model for text-based tasks directly from your Chrome browser, using a model that runs on your own computer.
Not ideal if you need a cloud-based AI solution, are uncomfortable running local server software, or do not have the technical knowledge to install Python packages and download AI models.
Stars
18
Forks
1
Language
JavaScript
License
—
Category
Last pushed
Oct 09, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/mrdiamonddirt/local-llama-chrome-extension"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
mishushakov/llm-scraper
Turn any webpage into structured data using LLMs
Mobile-Artificial-Intelligence/maid
Maid is a free and open source application for interfacing with llama.cpp models locally, and...
run-llama/LlamaIndexTS
Data framework for your LLM applications. Focus on server side solution
JHubi1/ollama-app
A modern and easy-to-use client for Ollama
serge-chat/serge
A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.