abhinand5/gptq_for_langchain
A guide about how to use GPTQ models with langchain
This guide helps developers integrate private, quantized open-source language models (LLMs) like WizardLM into applications built with LangChain. It provides practical steps and examples for setting up these models to process text input and generate responses, ensuring data privacy by running on local hardware. The target users are developers who want to leverage powerful LLMs within their applications without relying on external APIs.
No commits in the last 6 months.
Use this if you are a developer looking to build applications with open-source LLMs using LangChain, where data privacy and local execution are critical.
Not ideal if you are a non-developer seeking an out-of-the-box application, or if you prefer using cloud-based LLM APIs.
Stars
40
Forks
11
Language
Jupyter Notebook
License
GPL-3.0
Category
Last pushed
Aug 19, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/abhinand5/gptq_for_langchain"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
LangChain-OpenTutorial/LangChain-OpenTutorial
LangChain, LangGraph Open Tutorial for everyone!
langchain-ai/docs
๐ฆ๐ Docs for LangChain projects
teddylee777/langchain-kr
LangChain ๊ณต์ Document, Cookbook, ๊ทธ ๋ฐ์ ์ค์ฉ ์์ ๋ฅผ ๋ฐํ์ผ๋ก ์์ฑํ ํ๊ตญ์ด ํํ ๋ฆฌ์ผ์ ๋๋ค. ๋ณธ ํํ ๋ฆฌ์ผ์ ํตํด LangChain์ ๋ ์ฝ๊ณ ...
ravsau/langchain-notes
notes on langchain
Azure-Samples/function-python-ai-langchain
Simple starting point function to host LangChains with LLMs and other tools in an Azure Function.