rishabkr/Attention-Is-All-You-Need-Explained-PyTorch
A paper implementation and tutorial from scratch combining various great resources for implementing Transformers discussesd in Attention in All You Need Paper for the task of German to English Translation.
This is a detailed code implementation and tutorial for understanding how Transformer models work for language translation. It takes German text as input and translates it into English, demonstrating the underlying mechanics of neural machine translation. It's designed for machine learning engineers or researchers who want to understand the 'Attention Is All You Need' paper and its practical application from scratch.
No commits in the last 6 months.
Use this if you are a machine learning engineer or researcher trying to deeply understand and implement Transformer models for sequence-to-sequence tasks like language translation.
Not ideal if you are looking for a pre-built tool to simply translate text or a high-level library to integrate into an application without understanding the internals.
Stars
19
Forks
7
Language
Jupyter Notebook
License
—
Category
Last pushed
Jun 22, 2021
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/rishabkr/Attention-Is-All-You-Need-Explained-PyTorch"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
lucidrains/x-transformers
A concise but complete full-attention transformer with a set of promising experimental features...
kanishkamisra/minicons
Utility for behavioral and representational analyses of Language Models
lucidrains/simple-hierarchical-transformer
Experiments around a simple idea for inducing multiple hierarchical predictive model within a GPT
lucidrains/dreamer4
Implementation of Danijar's latest iteration for his Dreamer line of work
Nicolepcx/Transformers-in-Action
This is the corresponding code for the book Transformers in Action