thevasudevgupta/bigbird
Google's BigBird (Jax/Flax & PyTorch) @ 🤗Transformers
This project helps developers integrate Google's BigBird models into their applications using the Hugging Face Transformers library. It provides pre-trained models and training scripts for tasks like question answering and summarization. The output includes trained BigBird models for use in various natural language processing applications. This is designed for AI/ML engineers and researchers working with large text datasets.
No commits in the last 6 months.
Use this if you are a machine learning engineer looking to implement or fine-tune long-context transformer models for question answering or text summarization.
Not ideal if you are an end-user without programming experience looking for a ready-to-use application.
Stars
49
Forks
9
Language
Jupyter Notebook
License
MIT
Category
Last pushed
Mar 20, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/thevasudevgupta/bigbird"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
SKTBrain/KoBERT
Korean BERT pre-trained cased (KoBERT)
monologg/KoELECTRA
Pretrained ELECTRA Model for Korean
monologg/KoBERT-Transformers
KoBERT on 🤗 Huggingface Transformers 🤗 (with Bug Fixed)
VinAIResearch/PhoBERT
PhoBERT: Pre-trained language models for Vietnamese (EMNLP-2020 Findings)
KB-AI-Research/KB-ALBERT
KB국민은행에서 제공하는 경제/금융 도메인에 특화된 한국어 ALBERT 모델