ausboss/Local-LLM-Langchain
Load local LLMs effortlessly in a Jupyter notebook for testing purposes alongside Langchain or other agents. Contains Oobagooga and KoboldAI versions of the langchain notebooks with examples.
This helps Python developers who are prototyping or experimenting with large language models (LLMs) in a Jupyter notebook environment. It allows you to integrate a locally hosted LLM โ such as those run via Oobabooga's text generation web UI or KoboldAI โ into your Langchain projects. You provide a locally running LLM, and it gives you a custom LLM wrapper instance that behaves like other Langchain LLMs, enabling text generation and agent testing.
213 stars. No commits in the last 6 months.
Use this if you are a developer testing Langchain applications and want to use your own locally hosted LLMs instead of external API-based models like OpenAI.
Not ideal if you are looking for a production-ready deployment solution or are not comfortable working with Python, Jupyter notebooks, and local LLM setups.
Stars
213
Forks
24
Language
Jupyter Notebook
License
—
Category
Last pushed
Jun 25, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/ausboss/Local-LLM-Langchain"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
PaddlePaddle/PaddleNLP
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
meta-llama/llama-cookbook
Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started...
arcee-ai/mergekit
Tools for merging pretrained large language models.
changyeyu/LLM-RL-Visualized
๐100+ ๅๅ LLM / RL ๅ็ๅพ๐๏ผใๅคงๆจกๅ็ฎๆณใไฝ่ ๅทจ็ฎ๏ผ๐ฅ๏ผ100+ LLM/RL Algorithm Maps ๏ผ
mindspore-lab/step_into_llm
MindSpore online courses: Step into LLM