kykosic/actix-pytorch-example
An example of using Torch rust bindings to serve trained machine learning models via Actix Web
This project provides a complete example for taking a trained machine learning model, specifically one that recognizes handwritten digits, and deploying it as a web service. You input an image (PNG or JPG) containing a handwritten digit, and the service outputs the predicted digit (0-9) and a confidence score. This is useful for machine learning engineers or MLOps practitioners who need to serve PyTorch models efficiently.
No commits in the last 6 months.
Use this if you are a machine learning engineer looking for a robust example of how to deploy a PyTorch model for inference as a high-performance RESTful API using Rust.
Not ideal if you are looking for a simple Python-only deployment solution or a pre-built, production-ready inference server without any Rust development.
Stars
17
Forks
—
Language
Python
License
—
Category
Last pushed
Aug 15, 2021
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/kykosic/actix-pytorch-example"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
tracel-ai/burn
Burn is a next generation tensor library and Deep Learning Framework that doesn't compromise on...
sonos/tract
Tiny, no-nonsense, self-contained, Tensorflow and ONNX inference
pykeio/ort
Fast ML inference & training for ONNX models in Rust
elixir-nx/ortex
ONNX Runtime bindings for Elixir
robertknight/rten
ONNX neural network inference engine