biswajitsahoo1111/D2L_Attention_Mechanisms_in_TF
This repository contains Tensorflow 2 code for Attention Mechanisms chapter of Dive into Deep Learning (D2L) book.
This project provides practical, runnable code examples for understanding how attention mechanisms work in deep learning. It translates complex theoretical concepts from the 'Dive into Deep Learning' book into concrete implementations using Tensorflow 2. Machine learning engineers and researchers can use this to grasp and apply advanced neural network architectures.
No commits in the last 6 months.
Use this if you are a machine learning engineer or researcher looking for hands-on Tensorflow 2 code to learn about attention mechanisms, self-attention, and transformer models.
Not ideal if you are a practitioner without a background in deep learning or if you are looking for a plug-and-play solution without needing to understand the underlying code.
Stars
13
Forks
1
Language
Jupyter Notebook
License
—
Category
Last pushed
Jan 22, 2022
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/biswajitsahoo1111/D2L_Attention_Mechanisms_in_TF"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
philipperemy/keras-attention
Keras Attention Layer (Luong and Bahdanau scores).
tatp22/linformer-pytorch
My take on a practical implementation of Linformer for Pytorch.
ematvey/hierarchical-attention-networks
Document classification with Hierarchical Attention Networks in TensorFlow. WARNING: project is...
datalogue/keras-attention
Visualizing RNNs using the attention mechanism
thushv89/attention_keras
Keras Layer implementation of Attention for Sequential models