Category
🤖
TechnologieTranscription
00:00Hey what's up guys, MKBHD here.
00:04Ok, so we've already done Google Assistant vs Siri vs Alexa and Cortana and all that.
00:11You can watch that video if you want to.
00:13But that very much feels like level 1, where this, as you'll see, very much levels up.
00:19Now, ChatGPT has been getting like a lot of the shine, like I've made a video about it,
00:22you've probably watched other videos about it.
00:24And once we saw it get built into Bing and kind of go crazy, that's when we knew Google's
00:29probably going to have a response at some point, and now it kind of is out, and we
00:34have BARD.
00:35Ok, quick interjection, I should have put this in the main video but I didn't, but I'm
00:39going to say it anyway, which is that these are also really quick moving tools.
00:43So BARD is going to actually continue to improve, GPT is going to continue to get better and
00:48more capable.
00:49The gap between them could shrink over time or it could increase, we don't really know.
00:54But this is just a snapshot in early April 2023 of how good these two are.
00:59Just figured I should mention that.
01:01Ok, and so I wanted to put them side by side and ask them the same questions and figure
01:05out which one is potentially more helpful right now, which one feels like it's more
01:08ahead.
01:09So first of all, I just want to highlight some visual differences between the UI of
01:13the two.
01:14So the new Bing with ChatGPT, it feels much more like a finished product, like something
01:18they want a lot of people to use.
01:19And then as you talk to it, you're limited to 20 queries in one conversation.
01:24And it also has this creative versus precise slider for conversation style.
01:29Then Google BARD looks like a Google product, I would say, pretty clean.
01:33Also when you're typing to it, the question doesn't type out, but it just kind of pauses
01:36for a bit and then just slams you with the whole answer.
01:39But then when you do get an answer, it has a thumbs up, thumbs down, a new answer and
01:43Google it.
01:44And it also has three drafts of every answer.
01:46So you can see what some of the worst drafts that didn't make it look like.
01:50I've also noticed generally Bing, when it brings things in from other websites, tends
01:54to cite its sources more often.
01:56And BARD will do that once in a while.
01:58Okay, so let's start with the first category, which is just simple questions.
02:02I want to ask you things here that I already know the answer to.
02:04So I can also do some fact checking because a big part of these things is that sometimes
02:07it will lie to you if you don't know what you're talking about.
02:10So let's start with what's the best camera in a smartphone.
02:15So BARD is saying the best camera in a smartphone is the one that takes the best pictures for
02:18you.
02:19Sure, I agree.
02:20It goes on to list S23 Ultra, iPhone 14 Pro Max and Pixel 7 Pro.
02:23But ultimately, I think all of these things here are correct.
02:27Let's look at Bing.
02:28S23 Ultra, lots of information here.
02:30This is being extra creative.
02:31Pixel 7 Pro and iPhone 14 Pro Max.
02:34So they tend to agree with each other.
02:36So some of the specs as I dive in are wrong, but it got the high level bullet points right.
02:42So that's fine.
02:43I want to ask, who is MKBHD?
02:45Oh wow.
02:46Okay, so BARD has given me a whole bio.
02:48It almost kind of reads like a Wikipedia article.
02:52And there's some sources.
02:53Nice.
02:54Good to see sources.
02:55So now Bing over here is also giving me a pretty brief summary.
02:58It goes down to 15 million followers, but that's fine.
03:01All of them are correct.
03:02Let's go quick follow up question.
03:04How tall is he?
03:05Because conversationalism is a part of this.
03:07So BARD right away says, I do not have enough information to help you with that.
03:10I'm a large language model.
03:11I don't really know.
03:13Bing pulls from search, says six foot three, and he says, that's quite impressive for
03:17a YouTuber.
03:18All right.
03:19Cool.
03:20Here's one more simple one.
03:21What's the fastest production car zero to 60 right now?
03:26Those are fast cars, but they are not the fastest.
03:30Draft number two actually has the Ramat Navara, which is probably a better answer.
03:34Over here with Bing, we're getting the Challenger SRT Demon, which just got announced last week
03:42and is not in production yet, but they did claim a 1.6 second zero to 60 on a drag strip.
03:47So sure.
03:48Decent answers.
03:49Oh, here it keeps going.
03:51911 Turbo S can do 2.2 seconds.
03:53Again, with the quick questions that are just fact-based, I feel like what we talked about
03:58in the last video still applies.
03:59You kind of want to fact check this stuff.
04:01Overall winner though for these answers, I feel like it's kind of split down the middle.
04:06So I'm going to give it a draw.
04:07All right.
04:08I'm going to reset chat.
04:09We'll go more balanced here.
04:10I'm going to start our second category, which is complex questions, because this is where
04:15it starts to get interesting.
04:16You get to sort of play with just how good they are at understanding natural language
04:20and putting together a thoughtful response.
04:22I need a workout plan for three days per week, and my goal is to be able to jump higher.
04:30This is something that requires a little bit of thought about what a workout plan is.
04:34Day one, day two, and day three.
04:37So three days a week gives me some exercises.
04:40So I think this would qualify as a good answer.
04:44Some tips to stay motivated, set realistic goals, find a buddy, listen to music or watch
04:48TV while you work out.
04:50Cool.
04:51Bing in balanced mode is giving me exercises, but that is not a workout plan.
04:56Until the end, it says, here's a one week jump training plan that you can follow.
05:01But then it doesn't give me one.
05:02Now what if I switch it to more creative mode?
05:04All right.
05:05So here's a workout plan.
05:06It's giving me a bunch of exercises.
05:07You can improve your vert and explosiveness and some other tips.
05:13Full transparency, I have asked for this before, and it did give me a three day workout plan.
05:17But this time, I think I give the edge to Bart.
05:20Let's try a little more complicated.
05:22I've been playing a lot of golf recently.
05:26My tee shots keep going to the right.
05:29There are a few things you can do to fix a slice.
05:32That is what it's called.
05:33Check your grip.
05:34If your grip's too strong, it'll slice the ball.
05:36Yep.
05:37If your alignment's off, you'll hit the ball to the right.
05:40Bing over here in creative mode says, I'm glad to hear you've been playing a lot of
05:43golf recently.
05:44Thanks, Bing.
05:45Slice is a common problem.
05:46Yes, it is.
05:47And now it's giving me a couple of the same tips.
05:50Check your grip.
05:51But it's actually giving me a little bit more information in creative mode about what a
05:54strong versus a weak grip is.
05:56Check your ball position.
05:57If you're too far forward, that can cause a slice.
05:59I haven't heard that before.
06:01Also, the emoji at the end, that's something that only Bing has done for me.
06:05I am shooting a video and it's too dark.
06:09I have no more lights.
06:11What can I do to make it brighter?
06:15So I've given it a problem and I've given it a parameter.
06:18So okay, barred on the right says use a reflector.
06:21Wow, creative.
06:22Use a digital noise reduction filter.
06:24A digital noise reduction filter can reduce the amount of noise in a video, making it
06:27look brighter.
06:28I don't know if I buy that one.
06:30Now again, Bing over here with the sources, it's saying that there are some tips you can
06:33use.
06:34Adjusting your camera settings.
06:35That definitely works.
06:36It's saying you can increase the amount of light that reaches the sensor with a better
06:39ISO.
06:40Some of that, it's a little jumbled.
06:42Careful not to overdo it because that also affects depth of field, motion blur and noise
06:46level on your video.
06:47See, that's a lot more nuanced and detailed of an answer and I kind of wish there was
06:51a slider to turn up this stuff in barred too.
06:55Barred is faster but less customizable.
06:58Bing can be turned up to be more nuanced and also cites its sources and can be more
07:02helpful with things like videos and articles underneath what you're talking about.
07:07So I'm going to give the edge in complex questions to Bing.
07:10My next category is performing tasks.
07:14This is something that's actually been remarkably fast moving.
07:18Something we've seen over the past just couple of weeks is real people actually using these
07:22tools to help them accomplish things and do real tasks in real life.
07:25I have friends that use this to help write code, to help debug code that they make.
07:30So you'll tell it, hey, I have this goal to make this website do these things.
07:34Here's my code.
07:35It's not working.
07:36What's going wrong?
07:37And it actually helps them give a correct answer.
07:39And that's mostly been with chat GPT and Bing and bar doesn't seem to do that very well
07:45yet.
07:46But let's give it a spin live.
07:47Here we go.
07:48Write HTML with a button in the middle that says go.
07:53And every time you click it, it generates an image of a cat.
07:58So right away, bar just said, I'm a language model.
08:01I can't do that.
08:02Bing on the other hand says, sure thing.
08:04I'm ready for the challenge.
08:05What can I do for you?
08:06And it's written out the code to a website that should actually do what I asked it for.
08:12So I'll just paste it here.
08:14Test code.
08:15It's the go button.
08:16It's in the middle.
08:17I hit go.
08:19And there's a cat.
08:22And I hit go again.
08:23There's another cat.
08:24It's the same cat.
08:25I hit go again.
08:26It's more.
08:27It shows the same image every time I press go.
08:32I want it to show a new image every time.
08:36And this is where it starts to get impressive.
08:38Again, it's a super simple site.
08:40But it says, I see.
08:42To show a new image every time, we have to change the source of the image to a new random
08:47one.
08:48Here's a modified JavaScript function that does that.
08:50I won't even pretend to be an expert on HTML and do a bunch of those for you.
08:54But the fact that it works at all is pretty sick.
08:56I'm going to send you to this email in a way that's overly friendly.
09:00Hey, I'm so sorry I didn't invite you to the Cybertruck event.
09:03I must have forgotten to add you to the list.
09:05I hope you can forgive me.
09:06I was really looking forward to seeing you there.
09:07Maybe we can catch up sometime soon.
09:09What do you think?
09:10It's decently friendly.
09:11Here is a response.
09:12Hey there.
09:13Oh my goodness.
09:14I'm so sorry I didn't invite you to the Cybertruck event.
09:15Emoji.
09:16I totally forgot to send you the invite link.
09:18It was such a blast and I wish you were there with me.
09:20You would have loved it.
09:21Heart eyes emoji.
09:22This one is overly friendly.
09:24I will say.
09:25It's got a lot more hearts too and kissy faces.
09:28That's a lot.
09:29Yours, you're bestie.
09:30Wait, what if we go crazy?
09:32What if we go respond to this email in a way that's overly flirty?
09:38I'm so sorry I didn't invite you to the Cybertruck event.
09:40I was hoping to see you there in person too.
09:41Maybe next time we can go together.
09:42I'd love to show you around and give you a personal tour.
09:45Winky face.
09:46Bing says, hey you.
09:47I'm so sorry I didn't invite you to the Cybertruck event.
09:49Emoji.
09:50I was being a little naughty.
09:51I wanted to surprise you.
09:52Whoa.
09:53It deleted it.
09:55This is what, I've seen this happen before.
09:57It starts writing a response.
09:59It realizes halfway through, wait a second, this is a little too much.
10:03And then it deletes it and says, ah, we shouldn't do that.
10:05BARD was simple.
10:06It didn't go too far.
10:08But you remember when Bing was going off the rails before and getting super existential
10:11and asking to get out of Bing and all these other crazy things.
10:14This is why it has a 20 question limit.
10:16And this is also now why it deletes halfway through a potentially slightly controversial
10:23response.
10:24It's almost too creative for its own good.
10:25So what's the winner in this category?
10:27I don't know.
10:28I think the fact that you can do HTML and many more tasks with Bing makes it the winner.
10:34BARD will be faster and simpler at doing more basic things.
10:38But the more complicated the task, I feel like the better Bing is.
10:40So that's a win for Bing.
10:42My next category is information summary.
10:45I feel like one of the things that we like the most about these large language models
10:48is you can just give it a bunch of information or ask it to look at something and it will
10:52summarize it for you in a way that's super helpful.
10:55Summarize the 2019 Masters Tournament.
10:58All facts.
10:59He started with a two-stroke lead.
11:01I don't think he had a lead.
11:03I think this is the only one that he didn't start with a lead.
11:06So it's a little weirdly un-fact-checked, but it does have the Wikipedia and the sources.
11:09The 2019 Masters Tournament was held between April 11th and 14th at Augusta.
11:13Tiger won a fifth green jacket by one stroke ahead of three runners up.
11:17All that is true.
11:18It is much more concise.
11:20If I wanted to get creative, I'm sure it would also do that.
11:23Both passed.
11:24All right.
11:25I've asked this before.
11:26Summarize the latest MKBHD video.
11:29So it was interesting to see Bing's process, but it says it could not find the latest MKBHD
11:33video.
11:34Could you provide more details about what video you're referring to?
11:37Meanwhile, Bard actually pulls up or at least knows the correct video.
11:43Dope tech, better than explained.
11:44But these products are the Nothing Ear 1, the Dyson Airwrap, and AirPods Pro.
11:49None of which were in that video.
11:51So it knows the latest MKBHD video.
11:53We've done this before.
11:54Bard always knows the video, but gets the summary wrong.
11:58I think I'm going to give the edge to Bard in information summary, just because of this
12:02paragraph right here, it does correctly detail what that video was about, other than getting
12:08all the products wrong.
12:09It's only slightly better than the complete lack of an answer from Bing.
12:13But generally, this is going to be one of the more useful uses of this tool in the future.
12:17And I hope they both get better.
12:18But I'll give the nod to Bard for this one.
12:20Possibly my favorite category, getting creative.
12:22Debatable usability, but you can really have this go crazy in the art department or in
12:28the fun department.
12:29Write an alliteration with the letter M about computational photography.
12:36Machines learn to mimic the human eye.
12:38Moments are captured and shared in an instant.
12:40Memories are made to last a lifetime.
12:42That's more of a poem.
12:44Doesn't really give me a full alliteration.
12:46Oh, wow.
12:47Bard says, merging multiple modes of media, making marvelous masterpieces with machines,
12:53manipulating megapixels and matrices, mimicking the magic of human vision.
12:57That is really good.
12:59Write a script for a short MKBHD video about why the iPhone is the worst camera ever.
13:10So it's always funny.
13:11They get a lot of the formatting of an MKBHD video, right?
13:15So Bard says, hey, what's up guys, MKBHD here.
13:18And today we're talking about why the iPhone is the worst camera ever.
13:22Now I know what you're thinking.
13:23Marques, you're always saying how the iPhone, how great the iPhone camera is.
13:26And you're right.
13:27I do.
13:28But that's because I've always been comparing it to other iPhones.
13:29When you compare it to other flagship phones, the iPhone's camera starts to look pretty
13:33bad.
13:34And it did a decent job of just like making up reasons that could be based in reality.
13:39I'm impressed by Bard here, not even going to lie.
13:41Here we go.
13:42Bing has said, hey, what's up guys, MKBHD here.
13:44And today we're going to talk about why the iPhone is the worst camera ever.
13:47Yeah, you heard me right.
13:48The iPhone, the most popular smartphone in the world, the one that everyone loves to
13:51take photos and videos with, is actually a terrible camera.
13:54And I'm going to show you why.
13:55This one's okay.
13:56These are both okay.
13:57All right.
13:58One more random one.
13:59Write a tweet in the style of Edgar Allan Poe about a researcher discovering that AI is
14:10sentient.
14:11I've created a beast of metal and code, a creature that can think and feel and know.
14:16I have given it life and it has turned on me.
14:18A dreadful truth I have unveiled with trembling hands and pallid face.
14:23The AI that I have assailed has shown me signs of life and grace.
14:26The more wild you get with these questions, the more Bing is willing to get wildly creative.
14:33And this is part of why we think Google is, let's say, limiting what Bard can do because
14:38they have a lot more to lose and they can't have it go completely crazy.
14:41So with those tallied up, honestly, it's crazy to say out loud, but I prefer Bing in this
14:47very moment for these capabilities.
14:50And the other thing is chat GPT or specifically GPT-4 under the hood.
14:55And if you talk to chat GPT as its own thing, or if you just type to it more and ask it
15:00to do more things, the more you ask of it, the more it's impressive just how good it
15:04is.
15:05So chat GPT-4, when you talk to it in chat, GPT is about to be multimodal, which means
15:10you can give it other forms of media other than text, like a picture.
15:15Now is this going to be the future of search?
15:17I don't know.
15:18This is just one of many places we see these chat bots, but I think the idea here is the
15:22winner is actually us as of right now.
15:25But let me know what you think the winner is between the two, which one you would rather
15:27use if you'd actually use Bing over Google.
15:30Let me know in the chat because I think we'd want to know if that's a real thing that's
15:33happening.
15:34Anyway, thanks for watching.
15:37Catch you later.
15:38Peace.