Meta 2024
Category
🤖
TechTranscript
00:00This is the new MetaQuest 3S.
00:03High-quality mixed reality for $299.
00:13Hell yeah.
00:17I've been waiting for this one for a long time.
00:22You know, when we built Quest 3,
00:25we delivered the first high-quality,
00:28mainstream mixed reality experience
00:30where you can see the world around you,
00:32you can reach out and touch digital things
00:34as if they're right there.
00:36Quest 3 is the best mixed reality device
00:39that you can buy today, and I am really proud of it.
00:42Quest 3S has the same defining features as Quest 3.
00:47High-resolution, color, mixed reality,
00:50powered by the same processor, vivid pass-through,
00:53hand tracking, feels natural,
00:55touch plus controllers for precision.
00:57You get the full range of experiences from Horizon OS,
01:00gaming, social, fitness, watching videos, productivity, and more.
01:04So whether you're looking to get started with the base Quest 3S
01:08or if you want the top-of-the-line Quest 3
01:10with 512 gigabytes and 4K displays,
01:13which is now just $499,
01:16the Quest 3 family, it's not just the best value,
01:19it is the best product available.
01:21Everything you're going to see up here
01:22is streamed from his headset live.
01:24This is what he is seeing.
01:26Yeah, it's sharp.
01:29All right, Kenny, what do we got?
01:31All right, now the first thing that you can see
01:33is that we have expanded...
01:35the quality, the volume of content massively.
01:42Yeah, sorry to the dude next to him.
01:44Live demo artifact.
01:47All right.
01:49You can now run everything from 2D mobile apps
01:52to remote desktop for PC
01:55to fully immersive experiences all on one device.
01:59You can open screens.
02:00You can put them anywhere around you.
02:02You can have pretty much as many of them running as you want.
02:05And we have also rebuilt all of our social apps
02:09for Mixed Reality 2.
02:11We've got all new Instagram and Facebook experiences
02:15to bring your feeds and your reels with you
02:19into Mixed Reality.
02:20A really nice interface so you can lean back,
02:23enjoy your content on nice big screens.
02:27And there's a bunch more too.
02:29We've been working with Microsoft
02:32to upgrade remote desktop soon.
02:35So now you're going to be able to easily connect
02:37to any Windows 11 PC.
02:40You just look at the keyboard
02:42and it'll start pairing.
02:46So if you want to work on a giant virtual display
02:48or a bunch of virtual displays
02:50or if you want to work on your projects without distractions
02:53or with other people,
02:54Quest is going to be able to be a natural extension of your PC.
02:59We're also bringing photorealistic spaces
03:02to the metaverse.
03:05And we call this Hyperscape.
03:08And the way this works is you can use your phone
03:10to scan a room and then recreate it
03:13or you can step into a room that someone else has scanned
03:15and shared.
03:16Now of course there's gaming.
03:18So we've got some really good ones coming.
03:22Showing off what the Quest 3 family can do.
03:24Batman, Arkham Shadow up here.
03:27Exclusively on the Quest 3 family.
03:29It's going to be included in any purchase of a Quest 3
03:32or 3S that you buy this fall.
03:35Lots of great experiences.
03:37A lot more coming soon.
03:39And today we are making meta AI even smarter
03:43with our new open source Lama 3.2 models.
03:48And I'm going to get into more details about Lama 3.2
03:50in just a minute.
03:51But one of the headlines is that they're multimodal.
03:55So now meta AI can natively understand images
03:59as well as text.
04:01Now we're using this new capability
04:03to build some features that I haven't seen anyone else build.
04:06I mean this is pretty interesting and novel stuff.
04:08Creative tools that we're adding to imagine edit.
04:10It lets you upload any photo and edit it precisely
04:16with natural language in meta AI across the apps.
04:20I think that voice is going to be a way more natural way
04:24of interacting with AI than text.
04:26And probably I think it has the potential to be one of,
04:29if not the most frequent ways that we all interact with AI.
04:33It is just a lot better.
04:34So now you're going to be able to have natural voice
04:36conversations with meta AI across all the major apps.
04:39You've got Instagram, WhatsApp, Messenger, Facebook.
04:43Hey, are live demos risky?
04:48Live demos can be risky, yes.
04:51They can be unpredictable, prone to technical issues,
04:54and potentially embarrassing.
04:56However, they can also be engaging, memorable.
04:59All right, but I'm going to do it anyway.
05:02Go for it.
05:03Just be prepared for anything to happen.
05:05So you were one of the first creators
05:07to build one of these creator AIs with a text-only platform.
05:11Can you tell us what it does and your experience with it?
05:14Yeah, so for me, I've been treating my creator AI
05:16kind of like my digital assistant.
05:19So I've trained it on how I respond
05:21and how to engage with my audience.
05:23And then, yeah, I can send DMs and share links
05:26to relevant resources.
05:27And then what else am I having it do?
05:29Oh, yeah, it guides people through conversation.
05:31It's great.
05:32Congrats on the new book that you just released.
05:34What's the main thing that you're hoping
05:36that people take away from it?
05:39Thank you so much.
05:40Yeah, the main thing I want people
05:42to take away from my book is the idea
05:44that you have the power to create your own opportunities
05:48by combining curiosity, adaptability,
05:51and resilience in a rapidly evolving digital world.
05:54We are experimenting with automatic video
05:57dubbing on Reels, starting with English and Spanish.
06:03So this is going to be a way that you can see more
06:05of the content that's out there, no matter
06:07what language you speak.
06:08And as a creator, this is going to let
06:10you reach a lot more people around the world,
06:12no matter what language you speak.
06:13So now you're going to be able to take your content,
06:15and it's going to be in your authentic voice,
06:19speaking other languages if you want.
06:21And we're also doing automatic lip syncing.
06:23So it actually looks like you are
06:25speaking the other language.
06:26So let's check this one out.
06:27My native language is Spanish, but check it out.
06:38Now I can also speak English through AI automatic dubbing.
06:42So glasses, they're kind of the perfect form factor for AI,
06:47for letting an AI assistant see what you see,
06:50hear what you hear, be able to communicate with you privately
06:54so it can help you out with whatever you're
06:56doing throughout the day.
06:57I am about to have a conversation with Brandon Moreno,
07:00former UFC flyweight champion of the world,
07:02where he is speaking Spanish, and I am speaking English.
07:06All right, Brandon, you want to come out here and show us this?
07:11Starting live translation from Spanish to English.
07:17Hey, como estas?
07:19Como esta tu rodilla?
07:20Has vuelto a entrenar?
07:22Hey, how are you?
07:24How is your knee back training?
07:27Doing well.
07:28Knee is doing well.
07:30It feels strong.
07:31I'm ramping up training.
07:32How are you doing?
07:33Are you getting ready for your next fight?
07:35Haciendo bien.
07:36La rodilla está.
07:38Está haciendo bien y sentirse fuerte.
07:41So today we are dropping a limited edition of clear,
07:45transparent frames.
07:48And I think this is neat because it's a neat vibe, right?
07:51You can see the technology in them.
07:54You know, for the first few versions,
07:56we spent so much energy designing the glasses to
07:59basically hide the technology, to make them look like normal,
08:04stylish glasses.
08:05But now I think people are starting to appreciate what
08:08makes them special, and I think having a design that celebrates
08:12that is pretty awesome.
08:14This is Orion, our first fully functioning prototype.
08:21And if I do say so, the most advanced glasses the world has
08:26ever seen.
08:27They're not a headset, no wires, less than 100 grams.
08:33They need wide field of view, holographic displays,
08:39sharp enough to pick up details, bright enough to see in
08:45different lighting conditions, large enough to display a
08:49cinema screen or multiple monitors for working wherever
08:53you go, whether you're in a coffee shop or on a plane or
08:57wherever you are.
09:00And you need to be able to see through them.
09:03And people need to be able to see through them, too,
09:05and make eye contact with you.
09:07This isn't pass-through.
09:10This is the physical world with holograms overlaid on it.
09:16It is a completely new kind of display architecture with these
09:20tiny projectors in the arms of the glasses that shoot light
09:24into wave guides that have nanoscale 3D structures etched
09:29into the lenses so they can diffract light and put holograms
09:34at different depths and sizes into the world in front of you.
09:40And all of that is directed by custom silicon and sensors that
09:44we designed and powered by a battery that fits in the arm of
09:49the glasses.
09:51It is an absolutely incredible amount of technology to be able
09:56to miniaturize and fit into a pair of glasses and a small puck
10:01that goes with it to help power the whole thing.
10:03They're going to do voice and AI.
10:06They're going to do hand tracking and eye tracking so you
10:09can select UI elements by looking at them.
10:12Voice is great, but the thing is sometimes you're in public and
10:15you don't want to say what you're trying to do with your
10:18computer out loud.
10:20Hand tracking is neat for controlling different interfaces,
10:23but you don't want to walk down the street like this.
10:28I think that you need a device that allows you to just send a
10:33signal from your brain to the device.
10:37So this isn't just the first full screen, full wide field of
10:43view holographic AR glasses.
10:45This is also the first device that is powered by our wrist
10:48based neural interface.
10:50We do still have a few things that I want us to keep pushing
10:54on before we ship this as a consumer product.
10:57We're going to keep tuning the display system to make it
10:59sharper.
11:01I want to keep working on the design to make it smaller and a
11:04little bit more fashionable.
11:06And we are going to keep making, we need to keep working on the
11:09manufacturing to make it a lot more affordable too.
11:14But we have line of sight to all of those things.
11:17So we are going to use Orion as a dev kit.
11:21We are going to use it mostly internally to build out the
11:24software that we need to.
11:26But we're also going to work with a handful of partners
11:29externally to make sure that we get a diversity of content and
11:34just that we can really dial in the software and the experience
11:37so that way when we have the next version of this hardware,
11:41it is going to be ready to be our first consumer full
11:46holographic AR glasses.