sinanuozdemir/odsc-llmops
Sinan Ozdemir's ODSC West Workshop: LLMs from Protoype to Production
This workshop material guides AI practitioners through optimizing Large Language Models (LLMs) for production environments. You'll learn techniques like quantization and distillation to make LLMs faster and more memory-efficient, taking them from experimental prototypes to deployable solutions. It's designed for machine learning engineers and data scientists looking to implement LLMs in real-world applications.
No commits in the last 6 months.
Use this if you need to deploy and manage LLMs efficiently in production, especially when dealing with resource constraints or performance requirements.
Not ideal if you are looking for an introductory guide to LLMs or general prompt engineering without a focus on production deployment.
Stars
14
Forks
2
Language
Jupyter Notebook
License
—
Category
Last pushed
Oct 30, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/generative-ai/sinanuozdemir/odsc-llmops"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
Sinapsis-AI/sinapsis
Modular and Universal AI
eseckel/ai-for-grant-writing
A curated list of resources for using LLMs to develop more competitive grant applications.
amruthaa08/Generative_AI_LLMs
Generative AI with Large Language Models on Coursera offered by Deeplearning.AI and AWS.
futuroptimist/token.place
Peer-to-peer generative-AI platform that matches LLM users with volunteers donating spare compute.
panyatan/mergekit
🛠️ Merge pre-trained language models efficiently with `mergekit`, using minimal resources and...