FranxYao/Language-Model-Pretraining-for-Text-Generation
LM pretraining for generation, reading list, resources, conference mappings.
This is a curated collection of cutting-edge research papers and resources focused on training large language models specifically for generating text. It helps researchers and engineers understand and apply state-of-the-art techniques to build systems that can create human-like text outputs, like summaries or translations. You would use this if you are developing or studying advanced natural language generation applications.
No commits in the last 6 months.
Use this if you are a researcher or practitioner in natural language processing looking for foundational and recent work on pre-training language models for text generation tasks.
Not ideal if you are looking for an off-the-shelf tool or code to directly run a text generation task without deep understanding of the underlying models.
Stars
20
Forks
1
Language
—
License
—
Category
Last pushed
Feb 25, 2020
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/FranxYao/Language-Model-Pretraining-for-Text-Generation"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
Lightning-AI/litgpt
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
liangyuwang/Tiny-DeepSpeed
Tiny-DeepSpeed, a minimalistic re-implementation of the DeepSpeed library
catherinesyeh/attention-viz
Visualizing query-key interactions in language + vision transformers (VIS 2023)
microsoft/Text2Grad
🚀 Text2Grad: Converting natural language feedback into gradient signals for precise model...
huangjia2019/llm-gpt
From classic NLP to modern LLMs: building language models step by step. 异æ¥å›¾ä¹¦ï¼šã€Š GPT图解 å¤§æ¨¡åž‹æ˜¯æ€Žæ ·æž„å»ºçš„ã€‹-...