mrcabbage972/simple-toolformer
A Python implementation of Toolformer using Huggingface Transformers
This is an experimental project for AI researchers and students exploring how language models can learn to use external tools, like a calculator, to solve problems. It takes a base language model and training data, and the goal is to produce a fine-tuned model that can automatically decide when and how to interact with tools to improve its performance on specific tasks, such as solving math word problems. This helps those studying advanced AI model capabilities.
No commits in the last 6 months.
Use this if you are an AI researcher or student interested in experimenting with methods for language models to self-supervise tool use, especially for educational or research purposes.
Not ideal if you need a production-ready system for deploying a language model that uses external tools, as this implementation is still under active development and not yet verified end-to-end.
Stars
14
Forks
2
Language
Python
License
MIT
Category
Last pushed
Mar 20, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/mrcabbage972/simple-toolformer"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
microsoft/LoRA
Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
jadore801120/attention-is-all-you-need-pytorch
A PyTorch implementation of the Transformer model in "Attention is All You Need".
bhavnicksm/vanilla-transformer-jax
JAX/Flax implimentation of 'Attention Is All You Need' by Vaswani et al....
kyegomez/SparseAttention
Pytorch Implementation of the sparse attention from the paper: "Generating Long Sequences with...
AbdelStark/attnres
Rust implementation of Attention Residuals from MoonshotAI/Kimi