weiserlab/TinyLLM
Bringing Language Models to the Most Resource Constrained Devices
This framework helps you create specialized language models that can run on small, inexpensive devices, like those used in smart homes or factories. You provide your specific data, such as sensor readings or environmental observations, and it produces a compact model that can analyze this data directly on the device. Engineers working with embedded systems, IoT developers, and researchers in sensing applications would find this useful.
No commits in the last 6 months.
Use this if you need to deploy AI models on devices with limited memory and processing power, especially for tasks like analyzing sensor data locally.
Not ideal if you need a large, general-purpose language model or if your application runs on powerful cloud servers with ample computational resources.
Stars
50
Forks
6
Language
Python
License
Apache-2.0
Category
Last pushed
Dec 23, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/weiserlab/TinyLLM"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
NX-AI/xlstm
Official repository of the xLSTM.
sinanuozdemir/oreilly-hands-on-gpt-llm
Mastering the Art of Scalable and Efficient AI Model Deployment
DashyDashOrg/pandas-llm
Pandas-LLM
wxhcore/bumblecore
An LLM training framework built from the ground up, featuring a custom BumbleBee architecture...
MiniMax-AI/MiniMax-01
The official repo of MiniMax-Text-01 and MiniMax-VL-01, large-language-model &...