This 'mind-reading' AI system can recreate what your brain is seeing

MinD-Vis could be developed to integrate into virtual reality headsets, with the idea that users could control being in a metaverse with their minds.

Transcript

00:00 (upbeat music)

00:02 (upbeat music)

00:05 (upbeat music)

00:33 - Brain decoding, like using brain signals

00:36 to generate the natural modalities is very interesting

00:39 and exciting job, exciting work.

00:42 So I'm also interested in what happened in my brain

00:46 and what my brain can output and what I'm thinking.

00:49 So I try to participate to see

00:51 what really happened on my brain.

00:53 - So next time you come in, you will do the scan, right?

00:57 And in the scan, you will see the visual stimuli like this

01:01 and then we'll record your brain activities at the same time

01:05 and your brain activities will go into our AI translator

01:10 and this translator will translate your brain activities

01:13 into a special language

01:15 that a stable diffusion can understand.

01:17 And then it will generate the images

01:21 you are seeing at that point.

01:23 So that's basically how we can read your mind in this sense

01:26 and we can see the generate images on this side.

01:29 (upbeat music)

01:31 (upbeat music)

01:35 (upbeat music)

01:37 (upbeat music)

01:43 (upbeat music)

01:54 [music]