mradovic38/tiny-starcoder-evaluation

Evaluation of the Tiny Starcoder Fill-in-the-Middle code completion model, utilizing dataset generation, manual scoring, and various automatic metrics to assess performance.

11
/ 100
Experimental

No commits in the last 6 months.

Stale 6m No Package No Dependents
Maintenance 0 / 25
Adoption 0 / 25
Maturity 11 / 25
Community 0 / 25

How are scores calculated?

Stars

—

Forks

—

Language

Jupyter Notebook

License

MIT

Category

creative-text-generation

Last pushed

Jan 14, 2025

Commits (30d)

0

GitHub
Creative Text Generation · 30 models

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/transformers/mradovic38/tiny-starcoder-evaluation"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

worldbank/REaLTabFormer

A suite of auto-regressive and Seq2Seq (sequence-to-sequence) transformer models for tabular and...

48

MagedSaeed/generate-sequences

A python package made to generate sequences (greedy and beam-search) from Pytorch (not...

46

tlkh/t2t-tuner

Convenient Text-to-Text Training for Transformers

43

NohTow/PPL-MCTS

Repository for the code of the "PPL-MCTS: Constrained Textual Generation Through...

38

styfeng/TinyDialogues

Code & data for the EMNLP 2024 paper: Is Child-Directed Speech Effective Training Data for...

38

Explore Transformer Models

All categories Trending Transformer directory Insights