kuvaus/LlamaGPTJ-chat

Simple chat program for LLaMa, GPT-J, and MPT models.

48
/ 100
Emerging

This is a simple command-line program that allows you to chat interactively with large language models like GPT-J, LLaMA, and MPT directly on your computer. You provide a model file, type your questions or prompts, and the program generates text responses. This tool is for researchers, developers, or enthusiasts who want to experiment with these models offline.

219 stars. No commits in the last 6 months.

Use this if you want to run and interact with large language models locally on your machine without an internet connection or cloud services.

Not ideal if you are looking for a user-friendly graphical interface or a solution that doesn't require downloading and managing large model files.

AI-experimentation natural-language-processing offline-AI language-model-testing
Stale 6m No Package No Dependents
Maintenance 0 / 25
Adoption 10 / 25
Maturity 16 / 25
Community 22 / 25

How are scores calculated?

Stars

219

Forks

49

Language

C++

License

MIT

Last pushed

Aug 02, 2023

Commits (30d)

0

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/kuvaus/LlamaGPTJ-chat"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.