12kimih/HiCUPID
[ACL 2025] Exploring the Potential of LLMs as Personalized Assistants: Dataset, Evaluation, and Analysis
HiCUPID helps AI researchers and developers train and assess Large Language Models (LLMs) to create more personalized AI assistants. It provides a specialized dataset of conversational interactions and an automated evaluation model. This allows users to input an LLM and receive scores on how well it adapts to individual user preferences and maintains consistent personas.
No commits in the last 6 months.
Use this if you are developing or fine-tuning LLMs and need a robust way to train and benchmark their ability to act as truly personalized AI assistants.
Not ideal if you are looking for a pre-built, ready-to-deploy personalized assistant, as this is a toolkit for evaluating and improving models.
Stars
14
Forks
—
Language
Python
License
Apache-2.0
Category
Last pushed
Jun 03, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/12kimih/HiCUPID"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
filipnaudot/llmSHAP
llmSHAP: a multi-threaded explainability framework using Shapley values for LLM-based outputs.
microsoft/automated-brain-explanations
Generating and validating natural-language explanations for the brain.
CAS-SIAT-XinHai/CPsyCoun
[ACL 2024] CPsyCoun: A Report-based Multi-turn Dialogue Reconstruction and Evaluation Framework...
wesg52/universal-neurons
Universal Neurons in GPT2 Language Models
ICTMCG/LLM-for-misinformation-research
Paper list of misinformation research using (multi-modal) large language models, i.e., (M)LLMs.