ejhusom/MELODI
Use local Large Language Models (LLMs) while monitoring energy usage.
This project helps you understand the environmental cost of running local Large Language Models (LLMs) by measuring the energy consumed during the inference process. You feed in prompts to your chosen LLM and it outputs detailed energy consumption data. This is for researchers, MLOps engineers, or anyone optimizing the efficiency of AI models.
Use this if you need to quantify the energy footprint of specific LLM inference tasks on your local machine.
Not ideal if you are looking for an LLM itself or a tool to simply track general system power usage without specific LLM inference monitoring.
Stars
16
Forks
—
Language
Jupyter Notebook
License
—
Category
Last pushed
Dec 08, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/ejhusom/MELODI"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
AI-Planning/l2p
Library for LLM-driven action model acquisition via natural language
datawhalechina/self-llm
《开源大模型食用指南》针对中国宝宝量身打造的基于Linux环境快速微调（全参数/Lora）、部署国内外开源大模型（LLM）/多模态大模型（MLLM）教程
microsoft/LMOps
General technology for enabling AI capabilities w/ LLMs and MLLMs
theaniketgiri/create-llm
The fastest way to build and start training your own LLM. CLI tool that scaffolds...
liguodongiot/llm-action
本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）