SSumit.
AI / ML

Sign Verse

AI-powered web app converting sign-language gestures into text and bilingual (English + Hindi) audio.

Sign Verse
Overview

Sign-Verse is an AI-powered web application (currently under development) that bridges the communication gap between the hearing- and speech-impaired community and the general population by converting sign-language gestures into text and bilingual audio (English and Hindi). Built with deep-learning models and a modern, responsive interface, Sign-Verse makes communication more inclusive and accessible.

Highlights
  • Real-time gesture recognition
    Live camera feed classified frame-by-frame using a deep-learning model.
  • Bilingual TTS
    Recognised text spoken back in English or Hindi for accessibility.
  • Responsive UI
    Works on mobile browsers so it can be used anywhere.
Challenges

Getting reliable gesture recognition across lighting conditions and low-end devices.

Learnings

Model quantisation and inference-in-the-browser tradeoffs; designing UX for accessibility-first apps.