Zuellni/ComfyUI-ExLlama-Nodes

ExLlamaV2 nodes for ComfyUI.

42
/ 100
Emerging

This tool helps creative professionals or AI enthusiasts generate text locally on their computer using powerful language models. You provide a prompt or a conversation history, and it outputs newly generated text. It's designed for users who want fine-grained control over text generation within a visual node-based workflow.

122 stars. No commits in the last 6 months.

Use this if you are already working with ComfyUI and want to integrate a local, efficient large language model for generating text directly within your existing visual workflows.

Not ideal if you need to use very large language models that require cloud-based GPUs or if you are looking for a simple, standalone chat interface.

creative-writing story-generation chatbot-prototyping content-creation visual-programming
Stale 6m No Package No Dependents
Maintenance 0 / 25
Adoption 10 / 25
Maturity 16 / 25
Community 16 / 25

How are scores calculated?

Stars

122

Forks

18

Language

Python

License

MIT

Last pushed

Dec 06, 2024

Commits (30d)

0

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/Zuellni/ComfyUI-ExLlama-Nodes"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.