Contributor :

Janesh Kapoor

Mentor :

Keerthiseelan
PlanetRead-AR Glasses, aims to solve the problem of accessibility for individuals with hearing impairments by creating an XR-based solution that enables users to “”read”” what they can’t hear in real-time. The primary issue is that people with hearing loss often struggle with accessing verbal communication, especially in dynamic environments like movie halls, lectures, etc. By integrating XR technology with real-time speech-to-text transcription, the project leverages XR glasses to display subtitles of spoken words in the user’s field of vision. Using advanced speech recognition algorithms, this system captures verbal communication and converts it into on-screen text, allowing users to follow along effortlessly. The solution enhances inclusivity by enabling seamless communication in various contexts, from daily conversations to professional settings, making verbal information more accessible to those with hearing challenges.

Contributor :

Janesh Kapoor

Mentor :

Keerthiseelan
PlanetRead-AR Glasses, aims to solve the problem of accessibility for individuals with hearing impairments by creating an XR-based solution that enables users to “”read”” what they can’t hear in real-time. The primary issue is that people with hearing loss often struggle with accessing verbal communication, especially in dynamic environments like movie halls, lectures, etc. By integrating XR technology with real-time speech-to-text transcription, the project leverages XR glasses to display subtitles of spoken words in the user’s field of vision. Using advanced speech recognition algorithms, this system captures verbal communication and converts it into on-screen text, allowing users to follow along effortlessly. The solution enhances inclusivity by enabling seamless communication in various contexts, from daily conversations to professional settings, making verbal information more accessible to those with hearing challenges.

About Contributor

Janesh Kapoor is an XR developer and a fourth-year Computer Science and Bioscience student at IIIT Delhi, India. With a passion for leveraging technology to solve real-world problems, Janesh regularly utilizes his Meta Quest 2 virtual reality headset to present innovative solutions at hackathons. Currently, he is working as an undergraduate researcher under the mentorship of Dr. Anuj Grover, Dr. Kalpana Shankhwar, Dr. A. Shariff, and Dr. Aarti from IIIT and AIIMS Delhi, developing an XR-based surgical simulator platform for young doctors and medical professionals. Janesh is excited to contribute to the Code for Government Tech program.

About Mentor

Keerthiseelan holds a B.Tech in Electronics and Communication Engineering from Achariya College of Engineering and Technology. Currently, he is a Senior Software Developer working at PlanetRead, with experience across various technologies such as Node.js, Angular, and WordPress. His passion for developing innovative and impactful software solutions, along with his interest in solving real-world challenges, brought him to C4GT. Keerthiseelan is excited to leverage his skills to contribute to meaningful projects and make a positive impact.

Key Impact Takeaways:

  1. This project provides real-time transcription and sign language interpretation for immersive virtual reality experiences.
  2. It aims to create an inclusive ecosystem for users with hearing impairments, enhancing accessibility in multimedia and training content.
  3. The project integrates cutting-edge XR technology and AI-based systems to support skill development and vocational training.
  4. It has the potential to impact over 100k users across India who require enhanced accessibility solutions in VR environments.
  5. The project will be showcased at upcoming VR and accessibility tech conferences as a pioneering solution and will remain open source for future developers and users to make it better.
  6. Eliminates the inconvenience of accessibility shows being scheduled at impractical times, as accessibility users can access the features during any regular screening.

Contributor Experience