graykode/xlnet-Pytorch
Simple XLNet implementation with Pytorch Wrapper
This project helps machine learning engineers and researchers implement and experiment with the XLNet language model. It takes raw text data as input and produces a pre-trained XLNet model, which can then be fine-tuned for various natural language understanding tasks. This is for users who want to apply or study advanced transformer-based language models.
581 stars. No commits in the last 6 months.
Use this if you are a machine learning engineer or researcher looking for a straightforward PyTorch implementation of XLNet for pre-training with your own data or for understanding its architecture.
Not ideal if you need a plug-and-play solution for immediate natural language processing tasks without involvement in model architecture or pre-training details.
Stars
581
Forks
104
Language
Jupyter Notebook
License
Apache-2.0
Category
Last pushed
Jul 03, 2019
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/nlp/graykode/xlnet-Pytorch"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
xv44586/toolkit4nlp
transformers implement (architecture, task example, serving and more)
luozhouyang/transformers-keras
Transformer-based models implemented in tensorflow 2.x(using keras).
ufal/neuralmonkey
An open-source tool for sequence learning in NLP built on TensorFlow.
uzaymacar/attention-mechanisms
Implementations for a family of attention mechanisms, suitable for all kinds of natural language...
Vishnunkumar/doc_transformers
Document processing using transformers