Aesthisia/LLMinator
Gradio based tool to run opensource LLM models directly from Huggingface
This tool helps AI developers and researchers quickly run and test various open-source Large Language Models (LLMs) from Hugging Face directly on their local machines. You provide the name of an LLM from Hugging Face, and it outputs a working chatbot interface where you can interact with and evaluate the model's performance and responses. It's designed for machine learning engineers, data scientists, and AI product developers who need to prototype and experiment with different LLMs.
No commits in the last 6 months.
Use this if you need a straightforward, local environment to experiment with and compare different open-source LLMs before deploying them.
Not ideal if you're looking for a cloud-based solution or a production-ready deployment platform for large-scale LLM inference.
Stars
97
Forks
19
Language
Python
License
MIT
Category
Last pushed
Jun 27, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/Aesthisia/LLMinator"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
posit-dev/chatlas
Your friendly guide to building LLM chat apps in Python with less effort and more clarity.
xming521/WeClone
🚀 One-stop solution for creating your AI twin from chat history 💡 Fine-tune LLMs with your chat...
ooyinet/WeClone
🚀从聊天记录创造数字分身的一站式解决方案💡 使用聊天记录微调大语言模型，让大模型有“那味儿”，并绑定到聊天机器人，实现自己的数字分身。 数字克隆/数字分身/数字永生/LLM/聊天机器人/LoRA
vemonet/libre-chat
🦙 Free and Open Source Large Language Model (LLM) chatbot web UI and API. Self-hosted, offline...
qqqqqf-q/MirrorFlow
从对话数据到训练:数字分身 + 模型蒸馏 From Dialogue Data to Training Closed-Loop: Digital Twin + Model Distillation