naity/finetune-esm
Scalable Protein Language Model Finetuning with Distributed Learning and Advanced Training Techniques such as LoRA.
This project helps computational biologists and researchers accelerate the training of protein language models like ESM-2 for predicting protein functions. It takes protein sequences as input and outputs a model that can predict the biological functions of new proteins, specifically their Gene Ontology (GO) terms. This is designed for scientists working with large-scale protein data who need to customize existing models.
No commits in the last 6 months.
Use this if you need to efficiently adapt large protein language models for specific biological prediction tasks using your own protein sequence datasets.
Not ideal if you are looking for a pre-trained, ready-to-use model without needing to perform custom training or have limited computational resources.
Stars
34
Forks
3
Language
Jupyter Notebook
License
MIT
Category
Last pushed
Apr 12, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/naity/finetune-esm"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
OptimalScale/LMFlow
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
adithya-s-k/AI-Engineering.academy
Mastering Applied AI, One Concept at a Time
jax-ml/jax-llm-examples
Minimal yet performant LLM examples in pure JAX
young-geng/scalax
A simple library for scaling up JAX programs
riyanshibohra/TuneKit
Upload your data → Get a fine-tuned SLM. Free.