IDSIA/lmtool-fwp
PyTorch Language Modeling Toolkit for Fast Weight Programmers
This toolkit helps machine learning researchers rapidly prototype and experiment with different language modeling architectures, particularly those involving 'Fast Weight Programmers.' It takes text datasets and model configurations as input, allowing you to train and evaluate various Transformer models or explore novel 'Fast Weight Programmer' designs. It's designed for researchers focused on advancing the state-of-the-art in neural network architectures for natural language processing.
No commits in the last 6 months.
Use this if you are a machine learning researcher developing new language models or exploring variations of Transformer architectures, especially those based on 'Fast Weight Programmers' and linear attention mechanisms.
Not ideal if you are a practitioner looking for an out-of-the-box solution for common NLP tasks like text classification or sentiment analysis, or if you require robust multi-GPU training with the latest PyTorch DistributedDataParallel.
Stars
19
Forks
4
Language
Python
License
Apache-2.0
Category
Last pushed
Jun 11, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/IDSIA/lmtool-fwp"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
galilai-group/stable-pretraining
Reliable, minimal and scalable library for pretraining foundation and world models
CognitiveAISystems/MAPF-GPT
[AAAI-2025] This repository contains MAPF-GPT, a deep learning-based model for solving MAPF...
UKPLab/gpl
Powerful unsupervised domain adaptation method for dense retrieval. Requires only unlabeled...
larslorch/avici
Amortized Inference for Causal Structure Learning, NeurIPS 2022
svdrecbd/mhc-mlx
MLX + Metal implementation of mHC: Manifold-Constrained Hyper-Connections by DeepSeek-AI.