modelbox-ai/modelbox
A high performance, high expansion, easy to use framework for AI application. 为AI应用的开发者提供一套统一的高性能、易用的编程框架，快速基于AI全栈服务、开发跨端边云的AI行业应用，支持GPU，NPU加速。
This framework helps AI application developers quickly build efficient, high-performance AI inference applications for various scenarios, from edge devices to cloud environments. It takes trained AI models and application logic as input, streamlining the process to output ready-to-deploy AI services or applications. It's designed for AI application developers who need to integrate multiple models and complex logic into a single, performant application.
160 stars. No commits in the last 6 months.
Use this if you are an AI application developer looking to simplify the integration of multiple AI models, data preprocessing, and post-processing into a high-performance, deployable AI application across diverse hardware.
Not ideal if you are solely focused on AI model training or need a framework primarily for data analysis rather than application deployment.
Stars
160
Forks
49
Language
C++
License
Apache-2.0
Category
Last pushed
Jun 06, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/modelbox-ai/modelbox"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
tensorflow/tensorflow
An Open Source Machine Learning Framework for Everyone
microsoft/tensorwatch
Debugging, monitoring and visualization for Python Machine Learning and Data Science
KomputeProject/kompute
General purpose GPU compute framework built on Vulkan to support 1000s of cross vendor graphics...
hailo-ai/hailort-drivers
The Hailo PCIe driver is required for interacting with a Hailo device over the PCIe interface
NVIDIA/nvshmem
NVIDIA NVSHMEM is a parallel programming interface for NVIDIA GPUs based on OpenSHMEM. NVSHMEM...