6 artificial intelligence tools that are making the world more inclusive.

Key points:

• Artificial intelligence uses data to enable computers to mimic human capabilities
• AI tools like Be My AI, Seeing AI, Voiceitt2, Magic ToDo, Hand Talk, and DROVE are enhancing inclusivity for people with disability
• These tools range from connecting users with tech support, describing the world visually, translating speech and text, aiding daily tasks, bridging communication barriers, to empowering wheelchair navigation.

You’ve likely come across the term ‘artificial intelligence’ (AI) quite often lately – it’s a hot topic. 

AI harnesses vast amounts of data to enable computers and other devices to function in ways that mimic human capabilities. It’s capable of incredible feats such as learning, reading, writing and even engaging in conversations with users. 

AI is also playing a role in making the world more inclusive and easier to navigate for people with disability. 

The Leap in! Crew is excited to share some of the impressive tools that use AI to help people with disability live their best lives.

1. Be My AI

Be My AI is a feature in Be My Eyes that is driven by artificial intelligence. Be My Eyes connects users who are blind or have low vision with a sighted person who helps troubleshoot technical issues. 

Be My AI removes the need for the sighted person altogether! Instead, it uses information from a photo the user shares to understand the problem and, using AI, generates instructions to recommend a solution.

The first rollout of Be My AI has been through Microsoft’s Disability Answer Desk and the results have been impressive. Based on data gathered by Microsoft, Be My AI has been able to offer solutions to users in an average of four minutes, which is twice as fast as issues resolved through phone calls with human agents.

2. Seeing AI

Seeing AI tells you about the world around you using AI magic! The free mobile app uses the camera on your smart device to scan and narrate the world around you. It is designed to make the visual world more accessible for people who are blind or have low vision. 

The app can read text, describe pictures, recognise faces and even identify if a person is happy or sad. You can ask Seeing AI specific questions about the scans to better understand and personalise the information the app provides you. 

For example, you can take a photo of a menu at a restaurant and ask Seeing AI to read out the vegetarian options. That way you only have to hear about the information that is relevant to you.

3. Voiceitt2 App

Voiceitt2 is an app that uses automatic speech recognition (ASR) technology to recognise and translate non-standard speech patterns into readable text. It allows people with dysarthria, a motor speech disorder, to communicate more easily and with their own voice.

To begin using the app, you initiate a training phase to teach the app your unique speech patterns by speaking around 200 words. With each use, Voiceitt2 continues to learn and improve its ability to interpret your voice accurately. 

The app has ‘speak mode’ for conversation, which you can also use to ask ChatGPT a question and dictate mode’ that lets you create text that can be used for SMS, email, assignments and more.

4. Magic ToDo

Magic ToDo by goblin.tools is a free app, powered by AI that helps people take on daily activities.

Simply add a task to your to-do list, specify how much detail you need in your guide, and the AI will create a series of steps to complete the task. If you need more detail on a certain step, click the magic wand to generate more sub-tasks to help you move forward.

Magic ToDo can help you organise your closet, write an essay or even buy a gift for your best friend!  

5. Hand Talk 

The Hand Talk app was built to break communication barriers using technology. It lets you bring a sign language translator with you wherever you go via a smartphone app! At this stage, the app can translate English to ASL (American Sign Language) and Portuguese to Libras.

The helpful tool translates text or spoken words into sign language using an animated virtual translator, Hugo, who can translate short pieces of content in real-time through AI. 

The Hand Talk app helps people who are deaf or hard of hearing communicate with people who do not know sign language and connect with information presented in an audio-only format. 

Some people use Hand Talk to learn sign language, too! The app bridges the gap between sign language and spoken or written language. 

We’re hoping this great app will include translation for AUSLAN and other sign language dialects soon!

6. DROVE

DROVE makes it easier for people who use a wheelchair to get around at home thanks to AI and other cutting-edge technology.

Using wheelchair-mounted cameras and location sensors, DROVE navigates the home environment like an expert. The NeuroNode component is a wearable sensor that uses information from nerve signals and slight movements to control the wheelchair. It allows you to operate your wheelchair with your mind instead of a joystick, keyboard or screen.

With DROVE, your wheelchair becomes super smart. Select a pre-set destination in your home and DROVE will get you there safely. It navigates doorways, corners and obstacles like a pro! Plus it will make sure the wheelchair is set up in the right position for any specific task you want to perform.