SearchSavior/OpenArc
Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.
OpenArc helps you run various AI models like large language models (LLMs), vision-language models (VLMs), and speech-to-text (Whisper) on your own Intel-powered computer. It takes these models and makes them accessible through an interface similar to OpenAI, allowing you to get text generation, image analysis, audio transcription, or speech synthesis directly from your device. Data scientists, AI researchers, and developers who want to deploy local, private AI solutions on Intel hardware would find this useful.
341 stars.
Use this if you need to run and serve a variety of AI models (LLMs, VLMs, speech, embeddings, rerankers) locally on your Intel CPU, GPU, or NPU devices, with an OpenAI-compatible API.
Not ideal if you prefer cloud-based AI services, or if your primary hardware is not Intel-based.
Stars
341
Forks
18
Language
Python
License
Apache-2.0
Category
Last pushed
Feb 22, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/SearchSavior/OpenArc"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
alibaba/MNN
MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering...
xorbitsai/inference
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source,...
tensorzero/tensorzero
TensorZero is an open-source stack for industrial-grade LLM applications. It unifies an LLM...