DEV-D-GR8/SignSense
This repository contains a transformer-based model for real-time American Sign Language (ASL) recognition. The model leverages transformer architecture to interpret ASL gestures and utilizes the Gemini-Pro LLM API for constructing sentences from recognized ASL signs.
This project helps bridge communication gaps by translating American Sign Language (ASL) gestures into written sentences in real-time. It takes live video of someone signing ASL and outputs the corresponding English sentences, making conversations more accessible. This tool is designed for anyone communicating with ASL users, such as educators, customer service professionals, or family members.
No commits in the last 6 months.
Use this if you need to understand spoken English from live ASL signs in real-time video.
Not ideal if you need to translate other sign languages or require offline, pre-recorded video analysis.
Stars
12
Forks
3
Language
Jupyter Notebook
License
MIT
Category
Last pushed
Jun 24, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/DEV-D-GR8/SignSense"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
NVlabs/MambaVision
[CVPR 2025] Official PyTorch Implementation of MambaVision: A Hybrid Mamba-Transformer Vision Backbone
sign-language-translator/sign-language-translator
Python library & framework to build custom translators for the hearing-impaired and translate...
kyegomez/Jamba
PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"
autonomousvision/transfuser
[PAMI'23] TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Driving;...
kyegomez/MultiModalMamba
A novel implementation of fusing ViT with Mamba into a fast, agile, and high performance...