cognitiveailab/BYTESIZED32
Byte-sized text games for code generation tasks on virtual environments
This project helps AI researchers evaluate how well large language models can generate executable code for interactive text-based virtual environments. It takes descriptions of desired game elements (like objects, actions, and distractions) as input and outputs Python code for text games, alongside detailed evaluation metrics. Researchers focused on code generation, virtual environments, or AI agent training would use this to benchmark and refine their language models.
No commits in the last 6 months.
Use this if you are an AI researcher looking to systematically test and evaluate large language models' ability to generate functional and coherent code for text-based virtual environments.
Not ideal if you are a game developer looking to create interactive text games for human players, or if you need a tool for general-purpose code generation outside of text game environments.
Stars
20
Forks
—
Language
Python
License
Apache-2.0
Category
Last pushed
Jul 08, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/cognitiveailab/BYTESIZED32"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
microsoft/debug-gym
A Text-Based Environment for Interactive Debugging
elizaOS/characterfile
A simple file format for character data
FlamxGames/godot-ai-assistant-hub
Embed AI assistants in Godot with the ability to read and write code in Godot's Code Editor.
TavernAI/TavernAI
Atmospheric adventure chat for AI language models (KoboldAI, NovelAI, Pygmalion, OpenAI chatgpt, gpt-4)
vegu-ai/talemate
Roleplay with AI with a focus on strong narration, consistent world and game state tracking.