realamirhe/tsnn
Probably the world most FC implementation of transformers with SNNs
This project aims to implement transformer networks using spiking neural networks (SNNs), representing a third generation of natural language processing networks. It takes text data as input and processes it through a novel neural network architecture to produce enhanced language understanding. This would be used by researchers and practitioners in advanced AI and machine learning who are exploring energy-efficient or biologically inspired computational models for language tasks.
No commits in the last 6 months.
Use this if you are an AI researcher or a machine learning engineer interested in exploring cutting-edge, energy-efficient neural network architectures for natural language processing.
Not ideal if you are looking for a plug-and-play solution for standard NLP tasks or a library for conventional deep learning models.
Stars
7
Forks
—
Language
Python
License
—
Category
Last pushed
Jul 22, 2022
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/nlp/realamirhe/tsnn"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
xv44586/toolkit4nlp
transformers implement (architecture, task example, serving and more)
luozhouyang/transformers-keras
Transformer-based models implemented in tensorflow 2.x(using keras).
ufal/neuralmonkey
An open-source tool for sequence learning in NLP built on TensorFlow.
graykode/xlnet-Pytorch
Simple XLNet implementation with Pytorch Wrapper
uzaymacar/attention-mechanisms
Implementations for a family of attention mechanisms, suitable for all kinds of natural language...