hellohaptik/HINT3
This repository contains datasets and code for the paper "HINT3: Raising the bar for Intent Detection in the Wild" accepted at EMNLP-2020's Insights Workshop https://insights-workshop.github.io/ Preprint for the paper is available here https://arxiv.org/abs/2009.13833
This project helps conversational AI developers and researchers evaluate how well different Natural Language Understanding (NLU) platforms identify user intent in real-world chatbot conversations. It provides datasets from live chatbots and allows you to compare the performance of platforms like Rasa, Dialogflow, LUIS, Haptik, and BERT-based classifiers. The primary users are NLU engineers, data scientists, and AI researchers working on chatbot development.
No commits in the last 6 months.
Use this if you need to benchmark the accuracy of various NLU platforms in identifying user intent from real user queries in diverse chatbot domains.
Not ideal if you're looking for a pre-built chatbot or a tool to deploy an NLU model directly into a production environment.
Stars
32
Forks
7
Language
Jupyter Notebook
License
—
Category
Last pushed
Mar 24, 2021
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/nlp/hellohaptik/HINT3"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
yuanxiaosc/BERT-for-Sequence-Labeling-and-Text-Classification
This is the template code to use BERT for sequence lableing and text classification, in order to...
sz128/slot_filling_and_intent_detection_of_SLU
slot filling, intent detection, joint training, ATIS & SNIPS datasets, the Facebook’s...
dborrelli/chat-intents
Clustering sentence embeddings to extract message intent
asappresearch/dialog-intent-induction
Code and data for paper "Dialog Intent Induction with Deep Multi-View Clustering", Hugh Perkins...
taishan1994/pytorch_bert_intent_classification_and_slot_filling
基于pytorch的中文意图识别和槽位填充