Lucky-Wang-Chenlong/CodeSync
[ICML25] CODESYNC: Synchronizing Large Language Models with Dynamic Code Evolution at Scale
This project helps evaluate how well large language models can adapt to changes in software libraries. It automatically generates training sets and benchmarks by tracking API updates, finding real-world API uses, and synthesizing new API calls. Software engineers, AI researchers, and developers working with LLMs for code generation would find this valuable.
No commits in the last 6 months.
Use this if you need to automatically create robust datasets and benchmarks to test how well your large language models handle evolving code APIs.
Not ideal if you are looking for a tool to directly assist with code migration or refactoring for human developers.
Stars
25
Forks
2
Language
Python
License
—
Category
Last pushed
Jul 31, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/Lucky-Wang-Chenlong/CodeSync"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
aalok-sathe/surprisal
A unified interface for computing surprisal (log probabilities) from language models! Supports...
EvolvingLMMs-Lab/lmms-engine
A simple, unified multimodal models training engine. Lean, flexible, and built for hacking at scale.
reasoning-machines/pal
PaL: Program-Aided Language Models (ICML 2023)
FunnySaltyFish/Better-Ruozhiba
【逐条处理完成】人为审核+修改每一条的弱智吧精选问题QA数据集
microsoft/monitors4codegen
Code and Data artifact for NeurIPS 2023 paper - "Monitor-Guided Decoding of Code LMs with Static...