CHATS-lab/KokoMind

KokoMind: Can LLMs Understand Social Interactions?

36
/ 100
Emerging

This project provides a unique dataset and evaluation tools for researchers studying how well large language models (LLMs) understand complex social interactions. It takes multi-party social scenarios as input and helps you assess an LLM's ability to answer questions about theory of mind, social norms, emotions, relationships, and more. This is ideal for AI researchers, cognitive scientists, and anyone evaluating the social intelligence of AI models.

104 stars. No commits in the last 6 months.

Use this if you need to rigorously test and compare different LLMs' capabilities in comprehending nuanced social situations and human-like interactions.

Not ideal if you are looking for a pre-trained model to deploy directly into an application or if you need to generate social interactions rather than evaluate understanding.

AI evaluation social intelligence cognitive science natural language understanding LLM benchmarking
Stale 6m No Package No Dependents
Maintenance 0 / 25
Adoption 9 / 25
Maturity 16 / 25
Community 11 / 25

How are scores calculated?

Stars

104

Forks

8

Language

JavaScript

License

Apache-2.0

Last pushed

Oct 03, 2023

Commits (30d)

0

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/CHATS-lab/KokoMind"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.