xlang-ai/OSWorld-G

[NeurIPS 2025 Spotlight] Scaling Computer-Use Grounding via UI Decomposition and Synthesis

32
/ 100
Emerging

This project helps AI developers who are building agents that interact with computers by generating precise UI interaction data. It takes raw screenshots or UI element descriptions and outputs annotated data showing where an AI agent should click, along with visual feedback. The primary users are AI researchers and developers focused on creating or evaluating autonomous computer-use agents.

157 stars.

Use this if you are developing or benchmarking AI models that need to accurately understand and interact with graphical user interfaces.

Not ideal if you are looking for an off-the-shelf AI agent to perform tasks or if you are not involved in AI model development or evaluation.

AI agent development Human-computer interaction research UI automation (AI) Machine learning dataset generation AI model benchmarking
No License No Package No Dependents
Maintenance 6 / 25
Adoption 10 / 25
Maturity 8 / 25
Community 8 / 25

How are scores calculated?

Stars

157

Forks

6

Language

TypeScript

License

Last pushed

Nov 06, 2025

Commits (30d)

0

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/xlang-ai/OSWorld-G"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.