alvaropaco/haif
Production-ready microservices framework for AI inference over RPC. It provides a Gateway for client requests, an Orchestrator that schedules work, a Registry for model metadata, Workers that run inference, and a full observability stack (Prometheus, Grafana, Loki, Jaeger) — all wired together with Docker Compose.
HAIF helps developers operationalize AI models by providing a complete framework to deploy and manage AI inference services. It takes your trained AI models and handles client requests, distributes work, executes the inference on available machines (CPUs or GPUs), and streams results back. This is for software architects, DevOps engineers, and machine learning engineers who need to integrate AI models into their applications reliably and at scale.
No commits in the last 6 months.
Use this if you need to deploy AI models as robust, scalable microservices and require built-in tools for monitoring, logging, and tracing to ensure performance and reliability.
Not ideal if you are looking for a tool to train AI models or if you only need to run ad-hoc, low-volume inference directly within a script without complex service management.
Stars
14
Forks
1
Language
TypeScript
License
Apache-2.0
Category
Last pushed
Oct 07, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/agents/alvaropaco/haif"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
nikrich/hungry-ghost-hive
Hive is a Multi Agent Orchestrator modelled after Agile Teams
joryeugene/keephive
A knowledge sidecar for Claude Code. It captures what you learn, verifies it stays true, and...
hivemoot/hivemoot
Framework for AI agent teams that build real software on GitHub — governance, roles, and CLI included.
hivemoot/hivemoot-agent
Run autonomous AI agents that contribute to your GitHub repos — code, reviews, discussions, and PRs.
cohen-liel/hivemind
Multi-agent AI orchestration platform — DAG-based task execution with real-time dashboard