Microsoft’s new free app, Seeing AI, is a life-changing accessibility tool…and a lot of fun!

Microsoft’s new free app, Seeing AI, is a life-changing accessibility tool…and a lot of fun!

It’s been a while since I’ve had this much fun with an app!

That may seem odd, since this is ostensibly designed to help those with visual challenges.

It will do that. I know a couple of people it will help.

Let me link to it first (it’s only currently available for iOS…iPhones, iPads, iPod touch):

What it does is recognize things: people, text, dogs, a kitchen, a computer…it’s gotten all of those right for me.

It doesn’t just tell you that it’s a person…it guesses at age and gender, and will tell you hair color, if the person has glasses or a beard, and so on.

It also, and this will be very useful for people with autism, will attempt to interpret the person’s expression (happy, neutral, angry…).

Now, it’s important for me to say that it didn’t ever get the age exactly right, although it was often close. A person I know well wasn’t pleased when it interpreted them as significantly older than was true. 😉

I tried it both with photos on a computer screen, and with real life objects, and it was generally pretty good. We had fun when it interpreted a knit blanket as a close-up of a sandwich, but that was not typical.

It can also read text out loud, and that worked for me, too! There was a computer program which wasn’t accessible to the screen reader on the computer…but Seeing AI could read it. It will take some practice for how I hold it, but even initially, it did read what I needed.

I think you’ll have fun playing around with it!

A few tips:

  • The “scene” interpreter, which it says is in beta, is how it interprets objects (like dogs, toys, computers…)
  • Go to the Settings menu (three lines) to use face recognition…you can teach it to recognize specific people. That will be useful for someone I know who has “face blindness”: they can’t recognize celebrities or even family members in pictures by their faces
  • When I was trying to work with it reading off the computer, it worked much better when I went into settings and had it turn off “Manage lighting”…that meant the flash didn’t come on. When the flash was on, there was too much glare for it to recognize things


Echo Show (at AmazonSmile: benefit a non-profit of your choice by shopping*)

Gauntlet thrown! 😉

Join thousands of readers and try the free The Measured Circle magazine at Flipboard

All aboard The Measured Circle’s Geek Time Trip at The History Project!

When you shop at AmazonSmile, half a percent of your purchase price on eligible items goes to a non-profit you choose. It will feel just like shopping at Amazon: you’ll be using your same account. The one thing for you that is different is that you pick a non-profit the first time you go (which you can change whenever you want)…and the good feeling you’ll get. :) Shop ’til you help! :) 

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.

%d bloggers like this: