allenporter/home-assistant-datasets

This package is a collection of datasets for evaluating AI Models in the context of Home Assistant.

48
/ 100
Emerging

This package helps AI model developers and researchers evaluate the performance of conversational AI agents within a smart home context. It provides synthetic home environments and device states as input, runs various AI models (like OpenAI or Google) through Home Assistant, and then collects and evaluates their responses, such as device actions or summaries. The output helps users track how different models, prompts, or tools improve over time.

191 stars. Available on PyPI.

Use this if you are developing or fine-tuning AI models for smart home voice control and need a standardized way to test their accuracy in controlling devices or understanding home states.

Not ideal if you are an end-user looking to simply install and use a smart home AI system, as this is a development and evaluation tool.

smart-home-AI conversational-AI-evaluation home-automation-testing natural-language-understanding AI-model-benchmarking
No License
Maintenance 10 / 25
Adoption 10 / 25
Maturity 17 / 25
Community 11 / 25

How are scores calculated?

Stars

191

Forks

13

Language

Jupyter Notebook

License

Last pushed

Feb 21, 2026

Commits (30d)

0

Dependencies

7

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/allenporter/home-assistant-datasets"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.