microsoft/COCO-LM
[NeurIPS 2021] COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining
This project offers tools to fine-tune existing COCO-LM language models for specific natural language understanding (NLU) tasks. You provide a pre-trained COCO-LM model and your domain-specific text datasets, and the output is a more accurate language model tailored to tasks like text classification, question answering, or natural language inference. It's designed for researchers and practitioners working on advanced AI applications involving text understanding.
118 stars. No commits in the last 6 months.
Use this if you are a machine learning researcher or engineer looking to improve the performance of language models for specific NLU benchmarks or custom text-based applications.
Not ideal if you are an end-user without a technical background in machine learning or if you need a ready-to-use application rather than a model fine-tuning toolkit.
Stars
118
Forks
12
Language
Python
License
MIT
Category
Last pushed
Jul 25, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/microsoft/COCO-LM"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
galilai-group/stable-pretraining
Reliable, minimal and scalable library for pretraining foundation and world models
CognitiveAISystems/MAPF-GPT
[AAAI-2025] This repository contains MAPF-GPT, a deep learning-based model for solving MAPF...
UKPLab/gpl
Powerful unsupervised domain adaptation method for dense retrieval. Requires only unlabeled...
larslorch/avici
Amortized Inference for Causal Structure Learning, NeurIPS 2022
svdrecbd/mhc-mlx
MLX + Metal implementation of mHC: Manifold-Constrained Hyper-Connections by DeepSeek-AI.