datasets and home-assistant-datasets
The larger platform provides general-purpose dataset infrastructure and tools that the specialized package uses to distribute and manage Home Assistant-specific evaluation datasets.
About datasets
huggingface/datasets
🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools
This tool helps AI practitioners quickly get and prepare datasets for training and evaluating machine learning models. You provide a dataset name or your own data files (like images, audio, or text), and it outputs a ready-to-use dataset that can be fed directly into your model. It's designed for machine learning engineers and data scientists working with AI.
About home-assistant-datasets
allenporter/home-assistant-datasets
This package is a collection of datasets for evaluating AI Models in the context of Home Assistant.
This package helps AI model developers and researchers evaluate the performance of conversational AI agents within a smart home context. It provides synthetic home environments and device states as input, runs various AI models (like OpenAI or Google) through Home Assistant, and then collects and evaluates their responses, such as device actions or summaries. The output helps users track how different models, prompts, or tools improve over time.
Scores updated daily from GitHub, PyPI, and npm data. How scores work