rishikksh20/FNet-pytorch
Unofficial implementation of Google's FNet: Mixing Tokens with Fourier Transforms
FNet is a specialized tool for machine learning practitioners working with sequence data, such as text or time series. It processes this data using an efficient method based on Fourier Transforms to prepare it for tasks like classification or prediction. This project is ideal for researchers and engineers who build and experiment with neural network models.
262 stars. No commits in the last 6 months.
Use this if you are a machine learning researcher or engineer looking for an alternative, computationally efficient way to process sequence data within your deep learning models.
Not ideal if you are looking for a plug-and-play solution for a specific data analysis problem, as this requires familiarity with neural network architectures and PyTorch.
Stars
262
Forks
37
Language
Python
License
MIT
Category
Last pushed
May 18, 2021
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/nlp/rishikksh20/FNet-pytorch"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
xv44586/toolkit4nlp
transformers implement (architecture, task example, serving and more)
luozhouyang/transformers-keras
Transformer-based models implemented in tensorflow 2.x(using keras).
ufal/neuralmonkey
An open-source tool for sequence learning in NLP built on TensorFlow.
graykode/xlnet-Pytorch
Simple XLNet implementation with Pytorch Wrapper
uzaymacar/attention-mechanisms
Implementations for a family of attention mechanisms, suitable for all kinds of natural language...