Smartglasses Use ChatGPT To Help The Blind And Visually Impaired

  • 2 months ago
Smartglasses Use ChatGPT To Help The Blind And Visually Impaired
Transcript
00:00These are AI-powered smart glasses that help people who are blind or have low vision.
00:09Chicken and pumpkin soup.
00:11They're called InVision glasses, and they use ChatGPT, Google Glass hardware, and 5G connectivity
00:18to quickly and accurately process the visual information around the user and convert that into speech.
00:25Handcrafted, bruised, family-friendly, public house, local bold, flavors.
00:30The visually impaired community, we want to be independent as much as possible.
00:36And things, devices like the InVision glasses allow us to do that.
00:42We take a look at how the InVision glasses work and how they assist the blind and visually impaired.
00:49This is 5G Playbook.
00:52My name is Sam Seavey, and I am an assistive technology specialist.
00:57And I am the owner and the creator of the YouTube channel, The Blind Life.
01:01When I first got my hands on the InVision glasses, I was really impressed by the hardware.
01:07And then when I turned it on and started to use it, I was equally impressed with the features, even in the early days.
01:15Private, parking lot, farmer's jewelry, and corner...
01:19The glasses have an offline mode, but you're not going to get the best performance through that.
01:25It gets the job done, but if you want the best results, then you should be connected to some type of mobile hotspot.
01:32The performance through that hotspot now versus my previous review is much better.
01:39In the scene, there is a sidewalk in front of a store. The sidewalk is lined with pumpkins.
01:43And I'm sure that's because the adoption of 5G and faster networks and all of that.
01:49But it's truly fantastic for us.
01:53Not only is it a convenience thing, but it's very possibly a safety thing.
01:57If there's an obstacle in my way, if there's a sign that is warning me of something,
02:02the faster I can get the information about that, the better.
02:05Indicating the presence of a busy street nearby.
02:08So there are many features within the glasses which wouldn't have been possible without 5G.
02:13One such feature that I can think of is the scan text feature.
02:16Now, this is a feature that users use to scan all types of documents.
02:20And that kind of AI is actually quite complex and big, and can't be actually put onto the glasses themselves.
02:27So using 5G, we're able to keep the AI in the cloud.
02:30And we're able to send data from the glasses to the cloud.
02:33And the cloud is able to go ahead and understand the images and extract the text
02:37and help the users go ahead and read those documents more easily.
02:41Scan text.
02:42Reader. Chapter 8. Sending email.
02:45Translate text into Spanish.
02:48Envision is answering your question.
02:55Some other things that Envision does, it helps a visually impaired person to read text
02:59in over 100 different languages from pretty much any surface.
03:02Recognize faces of friends and family.
03:04Help them get descriptions of scenes around them.
03:06And even make video calls directly from the Envision glasses to a friend or a family member if they need any help.
03:12Call an ally.
03:14Opening call an ally.
03:17Ray Haddad.
03:19Connecting with Ray Haddad.
03:22So Envision started off when me and my co-founder went to a blind school in India.
03:27And we asked those kids there what kind of problems would they like to solve when they grew up.
03:31And the answers that they gave us was quite impactful.
03:34They said they'd like to go out more independently.
03:36They'd like to read books more independently.
03:38And that was a big inspiration.
03:40I like to get out and explore the world.
03:42I travel a ton.
03:44And one of the problems that I run into the most when I'm doing that, though,
03:47is accessing printed material like signs or menus or price tags.
03:53And that is probably one of the best ways that the Envision glasses help me, specifically,
03:59is to read those things when I'm out and about.
04:03I can simply just walk down the street and enjoy downtown, enjoy being out in nature,
04:10and still be able to access all the signs and business names and all of that around me, just like anybody else.
04:18So it really has changed my life tremendously.
04:23In the scene, there are three men standing together in a room.
04:26One of the men is holding a camera, possibly capturing footage for a video or recording.

Recommended