JoaoLages/RATransformers
RATransformers π- Make your transformer (like BERT, RoBERTa, GPT-2 and T5) Relation Aware!
This project helps machine learning engineers and NLP researchers improve how transformer models understand and extract information from structured data like tables. It takes your existing transformer model and adds a layer that understands relationships within the input, allowing the model to perform better on tasks like answering questions about tabular data. The output is a more accurate, "relation-aware" transformer model.
No commits in the last 6 months. Available on PyPI.
Use this if you are a machine learning engineer or NLP researcher working with transformer models on tasks involving structured or semi-structured data, such as tables, and want to enhance their comprehension of inherent relationships within that data.
Not ideal if you are looking for a pre-trained, ready-to-use model for general text processing without a focus on structured data relationships or if you are not familiar with transformer model fine-tuning.
Stars
42
Forks
5
Language
Python
License
MIT
Category
Last pushed
Dec 14, 2022
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/JoaoLages/RATransformers"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
ThilinaRajapakse/simpletransformers
Transformers for Information Retrieval, Text Classification, NER, QA, Language Modelling,...
jsksxs360/How-to-use-Transformers
Transformers εΊεΏ«ιε ₯ι¨ζη¨
google/deepconsensus
DeepConsensus uses gap-aware sequence transformers to correct errors in Pacific Biosciences...
Denis2054/Transformers-for-NLP-2nd-Edition
Transformer models from BERT to GPT-4, environments from Hugging Face to OpenAI. Fine-tuning,...
abhimishra91/transformers-tutorials
Github repo with tutorials to fine tune transformers for diff NLP tasks