smpanaro/more-ane-transformers
Run transformers (incl. LLMs) on the Apple Neural Engine.
If you're an AI developer working on a Mac, this project lets you run large language models (LLMs) like GPT directly on your Apple Neural Engine. It takes pre-converted CoreML models as input and generates text or other transformer outputs, utilizing your Mac's specialized hardware for faster, more efficient processing. This is designed for developers who want to leverage Apple Silicon's machine learning capabilities for their applications.
No commits in the last 6 months.
Use this if you are a developer with an Apple Silicon Mac and want to efficiently run large transformer models, including LLMs, with hardware acceleration and minimal CPU usage.
Not ideal if you are not a developer, do not have an Apple Silicon Mac, or need to run models larger than approximately 2.8 billion parameters.
Stars
63
Forks
2
Language
Python
License
—
Category
Last pushed
Nov 22, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/smpanaro/more-ane-transformers"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
ThilinaRajapakse/simpletransformers
Transformers for Information Retrieval, Text Classification, NER, QA, Language Modelling,...
jsksxs360/How-to-use-Transformers
Transformers 库快速入门教程
google/deepconsensus
DeepConsensus uses gap-aware sequence transformers to correct errors in Pacific Biosciences...
Denis2054/Transformers-for-NLP-2nd-Edition
Transformer models from BERT to GPT-4, environments from Hugging Face to OpenAI. Fine-tuning,...
abhimishra91/transformers-tutorials
Github repo with tutorials to fine tune transformers for diff NLP tasks