Artificial intelligence is helping people do extraordinary things. At Microsoft, it’s helping blind people see the world around them like never before.
Last Thursday, Microsoft showed off its Seeing AI app for the first time. It’s still under development, but it looks extremely promising.
Using a smartphone camera or a pair of camera-equipped smart glasses, the Seeing AI app can identify things in your environment — people, objects, and even emotions — to provide important context for what’s going on around you.
Take a look.
Shortly after, Shaikh was introduced to talking computers at a school for the blind. This inspired him to become a programmer.
He's been working on an idea he's had since his college days: an app that can tell you at any moment what's going on around you.
Shaikh teamed up with like-minded engineers to work on this very app using Microsoft's intelligence APIs.
The app, called Seeing AI, works on smartphones as well as Pivothead's SMART glasses, pictured here. Just a simple swipe forward on the glasses tells you what you're looking at.
The Seeing AI app can tell you whether or not people are really listening to what you're saying, and it can describe the general age and gender of the people around you, as well as their emotions.
You can use the app to take a picture of the text, and the app will actually guide you to ensure you're capturing the full text of what you're looking at.
Once you take the picture, Microsoft's AI will recognise the text. It can even identify and read back headings in case you don't want to know about every single item on a restaurant's menu, for example.
Business Insider Emails & Alerts
Site highlights each day to your inbox.