teddylee777/langserve_ollama
무료로 한국어🇰🇷 파인튜닝 모델 받아서 로컬 LLM 호스팅. LangServe, Ollama, streamlit + RAG
This project helps individuals and small teams host open-source Korean large language models (LLMs) on their own computers without relying on external cloud services. You download a pre-trained Korean LLM, set it up with the provided tools, and then you can interact with it locally or expose it as an API for your applications. It's designed for data scientists, researchers, or developers who need to customize or privately use Korean LLMs.
194 stars. No commits in the last 6 months.
Use this if you need to run a Korean fine-tuned LLM on your local machine for privacy, cost control, or custom application development.
Not ideal if you need to deploy large-scale, production-ready LLM services with high availability and scalability.
Stars
194
Forks
142
Language
Python
License
—
Category
Last pushed
Dec 21, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/teddylee777/langserve_ollama"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
Chainlit/chainlit
Build Conversational AI in minutes ⚡️
FullStackWithLawrence/aws-openai
Example ChatGPT chatbots using Langchain and OpenAI
mfmezger/conversational-agent-langchain
FastAPI Backend for a Conversational Agent using Cohere, (Azure) OpenAI, Langchain & Langgraph...
kvncampos/nautobot-ai-ops
Nautobot AI Plugin - Large Language Models (LLM), Model Context Protocol (MCP), Middleware and...
haseeb-heaven/langchain-coder
Web Application that can generate code and fix bugs and run using various LLM's (GPT,Gemini,PALM)