anakin87/llama2-haystack
Using Llama2 with Haystack, the NLP/LLM framework.
This is an experimental guide for developers who want to integrate the Llama 2 language model into the Haystack NLP framework. It walks through loading Llama 2 with 4-bit quantization and configuring it within Haystack's PromptNode. The output is a functional chat session with Llama 2 via Haystack.
No commits in the last 6 months.
Use this if you are a developer looking for an experimental approach to connect Llama 2 with Haystack for building custom NLP applications.
Not ideal if you are looking for a stable, officially supported, or production-ready integration of Llama 2 with Haystack.
Stars
16
Forks
1
Language
Jupyter Notebook
License
—
Category
Last pushed
Jul 21, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/anakin87/llama2-haystack"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
PaddlePaddle/PaddleNLP
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
meta-llama/llama-cookbook
Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started...
arcee-ai/mergekit
Tools for merging pretrained large language models.
changyeyu/LLM-RL-Visualized
๐100+ ๅๅ LLM / RL ๅ็ๅพ๐๏ผใๅคงๆจกๅ็ฎๆณใไฝ่ ๅทจ็ฎ๏ผ๐ฅ๏ผ100+ LLM/RL Algorithm Maps ๏ผ
mindspore-lab/step_into_llm
MindSpore online courses: Step into LLM