nuaa-nlp/Character100
Code and data for COLING2024 paper "Characteristic AI Agents via Large Language Models".
This project helps researchers and developers evaluate and compare 'characteristic' AI agents, which are large language models designed to mimic specific personas or styles. It provides datasets of question-response pairs for training and testing, along with metrics to assess how well an AI agent maintains its assigned characteristics. Researchers in natural language processing or AI ethics would use this to ensure AI agents behave as intended.
No commits in the last 6 months.
Use this if you are developing AI agents with distinct personalities or styles and need a standardized way to benchmark their performance and consistency.
Not ideal if you are looking for a general-purpose tool to train or evaluate basic conversational AI without a focus on specific character imitation.
Stars
25
Forks
1
Language
Python
License
—
Category
Last pushed
Nov 29, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/agents/nuaa-nlp/Character100"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
google-deepmind/concordia
A library for generative social simulation
Mai-xiyu/Minecraft_AI
AI Play Minecraft
mikelma/craftium
A framework for creating rich, 3D, Minecraft-like single and multi-agent environments for AI...
cocacola-lab/MineLand
Simulating Large-Scale Multi-Agent Interactions with Limited Multimodal Senses and Physical Needs
rezaho/MARSYS
Multi-Agent Reasoning Systems