Apple Silicon Llm Inference MLOps Tools
There are 5 apple silicon llm inference tools tracked. 1 score above 70 (verified tier). The highest-rated is mosecorg/mosec at 70/100 with 893 stars. 1 of the top 10 are actively maintained.
Get all 5 projects as JSON
curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=mlops&subcategory=apple-silicon-llm-inference&limit=20"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
| # | Tool | Score | Tier |
|---|---|---|---|
| 1 |
mosecorg/mosec
A high-performance ML model serving framework, offers dynamic batching and... |
|
Verified |
| 2 |
jeremyarancio/VLM-Batch-Deployment
Batch Deployment for Document Parsing with AWS Batch & Qwen-2.5-VL |
|
Emerging |
| 3 |
SemiAnalysisAI/InferenceX-app
Dashboard for InferenceX™, Open Source Continuous Inference |
|
Experimental |
| 4 |
amanparuthi8/gpu-llm-india-2026
Should you buy a DGX Spark or rent H100s? Run on Mac Mini or TAALAS cluster?... |
|
Experimental |
| 5 |
DunaSpice/JetsonMind
Production-ready AI inference system for NVIDIA Jetson devices with MCP... |
|
Experimental |