Glovatrix, an Indian startup, is developing AI gloves to help speech-impaired people speak again.

Ever since the global explosion of generatives. Artificial intelligence In 2022, technology has become the talk of the town. It is not only AI based on the Large Language Model (LLM) but all the different branches of the technology that have seen rapid growth in both development and application. AI has also left the digital realm and entered the real world, helping to improve people’s lives. From language translation tools Early detection From diseases, it has affected all sectors of society.

Glovatrix, an Indian startup based out of Pune, also aims to solve a similar pain for people who suffer from speech and hearing impairments. According to one Reports According to the World Health Organization (WHO), there are 1.5 billion people in the world who suffer from some level of hearing loss. Although the organization does not keep such figures for speech disorders, it is likely in the millions. In many cases, these people depend on either written communication or sign language to communicate. While the former can make communication very slow, the latter requires an interpreter at the listener’s disposal to translate sign language into spoken words.

This situation can often result in difficulties getting a job, especially one that is customer facing or requires a lot of communication. But that’s where companies like Glovatrix come in. An Indian startup is working on an AI-powered device called Fifth Sense that can convert gestures from sign language into speech in near real-time and help people with speech disorders effectively and without speaking. Helps to communicate. Help. We, at Gadgets 360, spoke to the startup’s cofounders to learn more about the product and the technology behind it.

Glovatrix, an Indian AI startup

Glovatrix was founded in 2021 by co-founders Aishwarya Karnataka and Parikshat Sohoni, and both serve as the company’s joint CEOs. Karnataka met a hearing-impaired child in 2009, who inspired him to learn sign language and their conversation planted the seed to make a difference for those who suffer a similar fate. The seed blossomed into Fifth Sense when he met fellow co-founder Sohoni, a data scientist with extensive experience in predictive analytics, who had experienced these struggles within his own family and hence the immediate need. succeeded in resonating.

The duo is working with an engineer to form a team of three from a shared office space in Baner, Pune. Explaining his vision, Karnataka said, “Our vision is to facilitate seamless communication between people of all abilities and to enable every deaf and hard of hearing person to express and hear in their natural language – sign language. Capacity is to be provided.”

Fifth Sense, AI-Powered Gloves
Photo credit: Glowatrix

Fifth Sense, an AI-powered glove for the speech-impaired

From a form factor perspective, the AI-powered device looks like a glove with a smartwatch on top. Sohoni told us that the AI ​​gloves are made using a lightweight fabric that can be worn for 6-8 hours without any discomfort. The top of the glove has an opening where the fingers can protrude so the user can use a smartphone or any other task that requires a better grip. Fabric comes equipped with a Smart watch And multiple sensors to capture any signals. The fabric can be separated and washed separately.

Coming to the hardware, Sohoni explained that the company sources the components used in the device from different countries, and then manufactures it separately based on the company’s in-house design. This is a standard model adopted by most wearable companies operating in India.

But it’s the software, where Glovatrix has really innovated. The system has two parts that enable seamless two-way communication. The first is the device itself which is powered by AI, and the second is a companion app. “The AI ​​architecture was developed entirely in-house because we had no reference to look to,” Sohoney said. Interestingly, Glovatrix does not use generative AI and instead uses machine learning and a variety of analysis algorithms for its gesture-to-speech interface.

When a gesture is made, the companion app converts it to audio and plays it for listeners. It also acts as a receiver when a hearing impaired person has to listen to a speaker without sign language. The app listens to the voice and then converts it into text for the user to read. Interestingly, the app not only picks up spoken words but also other sounds like the doorbell ringing. The company also claims that the device works in near real-time, allowing for fluid communication.

How Glovatrix is ​​solving privacy and connectivity challenges.

Common issues that are seen with such smart devices are connectivity and privacy. Most smart devices, especially those that use AI, compute and process on a server. This means that a fast working internet is crucial for a lag-free experience. Similarly, smart devices have to collect a lot of user data to offer their functionality. Keeping this data on a server can also raise privacy concerns in the event of a breach.

Glovatrix has found a solution to both problems. The entire receiving portion of the app is done on-device, meaning audio collected by the user for conversion to text never leaves the device. This part is also lag-free as it does not require active internet connectivity. On the sign-to-speech side, Sohoni said some key words and individual alphabets will also be added to the app to overcome connectivity issues. However, since AI models require powerful computational processing, the rest will be on the cloud which will require a stable internet connection. Notably, the company’s cloud is also built locally and should help improve server-device connectivity for Indian customers.

One thing to note here is that while the AI ​​is trained in Indian Sign Language and converts the text into Hindi and Marathi, the in-app text translation tool produces audio in English and most Indian regional languages. Will be able to.

Finding Product Market Fit

Fifth Sense is currently a prototype, and Sohoni revealed that the company will begin its first pilot tests soon. The startup is also confident that it will be able to achieve product-market fit in the next six months.

Even as the product is not ready for market, Glovatrix has already seen the impact of its device. He claims that a speech-impaired man was able to land a job after using his fifth sense to communicate with his interviewer.

And how expensive can the product be? The approach with AI gloves is to keep the price point competitive so it can reach the masses, Sohoney said. Although they did not reveal a specific price, they said it could cost as much as a mid-range smartphone. Additionally, to reduce cost, Glovatrix is ​​also considering a subscription-based revenue model that can further reduce the cost burden on the end user.

---