Sreyan88/RECAP
Code for ICASSP 2024 Paper: RECAP: Retrieval-Augmented Audio Captioning
This system helps you automatically describe audio content in plain language, even for sounds it hasn't encountered before. You provide an audio clip, and it generates descriptive text captions. This is ideal for sound archivists, media analysts, or content creators who need to categorize or understand vast collections of audio.
No commits in the last 6 months.
Use this if you need to generate accurate, detailed text descriptions for a wide variety of audio events, including novel or complex sounds, without extensive fine-tuning.
Not ideal if you primarily need to transcribe speech or identify specific musical elements rather than general environmental or event sounds.
Stars
15
Forks
—
Language
Python
License
—
Category
Last pushed
Jun 23, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/rag/Sreyan88/RECAP"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
illuin-tech/colpali
The code used to train and run inference with the ColVision models, e.g. ColPali, ColQwen2, and ColSmol.
AnswerDotAI/byaldi
Use late-interaction multi-modal models such as ColPali in just a few lines of code.
jolibrain/colette
Multimodal RAG to search and interact locally with technical documents of any kind
nannib/nbmultirag
Un framework in Italiano ed Inglese, che permette di chattare con i propri documenti in RAG,...
OpenBMB/VisRAG
Parsing-free RAG supported by VLMs