ShivamRajSharma/Transformer-Architectures-From-Scratch
Implementation of transformers based architecture in PyTorch.
This project provides pre-built code for advanced AI models that can understand and generate text or analyze images. It helps you take raw text or image data and produce things like translations, summaries, sentiment classifications, generated sentences, or image classifications. This is for AI/ML practitioners and researchers who need to implement or experiment with state-of-the-art transformer architectures.
No commits in the last 6 months.
Use this if you are an AI developer or researcher looking for readily available, from-scratch PyTorch implementations of various transformer models for natural language processing or computer vision tasks.
Not ideal if you are an end-user without programming experience looking for a plug-and-play application for tasks like machine translation or image classification.
Stars
55
Forks
17
Language
Python
License
MIT
Category
Last pushed
Dec 06, 2020
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/ShivamRajSharma/Transformer-Architectures-From-Scratch"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
huggingface/transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in...
kyegomez/LongNet
Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"
pbloem/former
Simple transformer implementation from scratch in pytorch. (archival, latest version on codeberg)
NVIDIA/FasterTransformer
Transformer related optimization, including BERT, GPT
kyegomez/SimplifiedTransformers
SimplifiedTransformer simplifies transformer block without affecting training. Skip connections,...