aixcoder-plugin/nl2code-dataset
Aix-bench, the Java benchmark for code synthesis problem.
This benchmark helps developers evaluate how well AI models can generate Java code from natural language descriptions. It provides carefully selected Java method descriptions and their corresponding signatures. Developers can use these to test a model's ability to produce correct and high-quality Java code.
No commits in the last 6 months.
Use this if you are developing or evaluating AI models that generate Java code from English or Chinese natural language descriptions and need a standardized way to test their performance.
Not ideal if you are looking for a dataset to train an AI model for a language other than Java, or if your primary interest is in generating code for entire applications rather than individual methods.
Stars
51
Forks
1
Language
Java
License
MIT
Category
Last pushed
Aug 19, 2022
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/ai-coding/aixcoder-plugin/nl2code-dataset"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
k4black/codebleu
Pip compatible CodeBLEU metric implementation available for linux/macos/win
LiveCodeBench/LiveCodeBench
Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of...
EdinburghNLP/code-docstring-corpus
Preprocessed Python functions and docstrings for automated code documentation (code2doc) and...
hendrycks/apps
APPS: Automated Programming Progress Standard (NeurIPS 2021)
solis-team/Hydra
[FSE 2026] Do Not Treat Code as Natural Language: Implications for Repository-Level Code...