dhpollack/huggingface_libtorch
Minimal example of using a traced huggingface transformers model with libtorch
This project helps software developers integrate pre-trained natural language processing (NLP) models into C++ applications for tasks like sentiment analysis. It takes a Hugging Face Transformers model, previously trained in Python, and allows it to be used in a C++ environment. This is for developers building high-performance or resource-constrained applications that need to leverage advanced NLP.
No commits in the last 6 months.
Use this if you are a C++ developer who needs to incorporate a trained Hugging Face Transformer model into a C++ application for tasks like text classification, without the overhead of Python.
Not ideal if you are an end-user looking for a ready-to-use NLP tool or if your primary development environment is not Linux or C++.
Stars
35
Forks
13
Language
C++
License
—
Category
Last pushed
Sep 17, 2020
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/dhpollack/huggingface_libtorch"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
huggingface/transformers-bloom-inference
Fast Inference Solutions for BLOOM
Tencent/TurboTransformers
a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc)...
mit-han-lab/lite-transformer
[ICLR 2020] Lite Transformer with Long-Short Range Attention
mit-han-lab/hardware-aware-transformers
[ACL'20] HAT: Hardware-Aware Transformers for Efficient Natural Language Processing
LibreTranslate/Locomotive
Toolkit for training/converting LibreTranslate compatible language models 🚂