Meet Claude 2: Anthropic's New ChatGPT Contender

--- type: transcript date: 2023-07-11 youtube_id: o1SR_ecQ88A --- # Transcript: Meet Claude 2: Anthropic's New ChatGPT Contender this video I'm going to be showing and demonstrating to you Cloud 2 which is the latest model by anthropic so claw 2 is notable in that it can accept up to a hundred thousand tokens within its limit now the other thing that's nice with this is within their GUI they have support to be able to upload documents of all sorts of types by default so I'll demonstrate that in just a moment now a couple housekeeping items with this is right now it is limited to anyone within the us or UK to get started and then because this is a developers Focus Channel this model can also be accessed by their API as well so from what I read the pricing is the same as their previous model and yeah without further Ado let's get into it so the first thing that I wanted to do to demo in is I wanted to get up as close as I could to that hundred thousand uh limit with that token limit so what I did is I went and fetched three different of the 10q filings from Facebook Apple and Google and when I tried this uh initially I tried it with apple Google and Microsoft and it gave me a notification that the limit is x amount of percent too long so that feature alone is very nice because in chat GPT for instance if you put in something too long you don't know that it's too long until you hit that Enter key and you get an error message so being able to proactively count those tokens is super helpful so one thing in this example so I was just I just wanted to ask it a broad question of just like who's doing better right so within the results so it passed through all these filings and just to give you an idea these filings are very very long so if I open up Facebook you'll see that that's 145 Pages if I open up Apple that's 28 pages and then if I open up Google that's 45 or 46 Pages rather so over 200 pages of documents and this only took a moment to parse through so it said okay revenue is up it sort of gives me a highlight of all the different uh details within that filing and then it gives me my response here so overall Google app will appear to be executing well by leveraging Etc et cetera you know meta is facing some near-term challenges et cetera et cetera so a super great right like really sort of blew me away the fact that you can put so much information within their their token window here so to uh go back to the main page you can just click the logo here I think there's also a command K option to start a new chat now you will see all your chats within this main page here so there isn't that uh like left hand toolbar like there is on the challenging BT implementation but they're here nonetheless so you're able to save things which is really great because it's like sometimes if you have files and you can go back to the chat and if you want to interact with it it's all there there's a couple of things that I think would be nice like if we just would be able to instead of going into each chat and deleting them like when I was setting up this video I had to like go into each and delete them all it would be nice just to have a little X there but that's like really a minor thing right so they do have some examples these are the core examples that they provided here which I'll just go into quickly so within the python example you see that you can provide code and the one nice thing with this is you can provide code by pasting it into the context window but you can also upload a document which I'll demonstrate in just a moment so you see here this is a simple rock paper scissors game in Python here's how it works so you can imagine if you had like a complex code base there's definitely going to be some code bases that fit within this context window you know if you have like a giant mono repo maybe not but you know for a lot of project you'll be able to put in a lot of different files here so I'll demonstrate that quickly here so oops if I go back here and I start a new chat so I'll just open up and let's just see what happens so if I just go ahead and highlight let's just say everything here and I go ahead now you'll see something as soon as I drag you can only have five items so if you're going to be putting in a ton of code you might have to get a little creative so let's just say we'll put in our index code interpreter we'll put in five files here so these are relatively small files compared to the last one but if I say what uh can I do to make these type script supported so the this project is just a plain vanilla JavaScript project that I've been working on typescript is something that I've thought about implementing or I would like to implement so let's just see what it does here so it's quickly parsed all these files that you see and you can see here okay add a typescript type or add the typescript types for each function you can go in the parameters etc etc so it breaks it up it's not exactly what I would have wanted but let's just say let's give it a better Prof let's say to rewrite all of them for me let's just see what happens so when we first tried this I was curious to see with the upload feature if there's a download feature and right now it doesn't appear to be the case so you could imagine that would be helpful instead of just having copy code if you also had download that would be excellent if that's something that's you know soon to be available hopefully especially for coders and then in here you see you see sort of a similar thing that I've experienced lately with chat GPT gpt4 where if you ask it a question especially on Long files it will start to redact answers and you sort of have to force force its hand or force your hand rather a little bit so if I say don't omit anything return the typescript info so the other thing while this is loading up the interface is really nice I think there's like minor ux things like I mentioned about being able to delete conversations I do like having the conversations in pain on the left hand side like chat gbt I don't mind them on that main interface but it would be nice if you had a little flyout menu or something where you can see them all here but as you see here we are starting to get closer to what we want so it's just sort of rewriting the project with typescript so I'm not going to be testing this or anything I'll take a look at this a little later but just to give you an idea like you know instead of going into each file copy and pasting within the context window now you can just upload your files correctly which is huge I think it's really great in terms of uh you know the user experience so other things obviously you can summarize I sort of demonstrated that with all the different filings if I go back to the filings and I just say what are the risks or Apple so you can see even once it's loaded up that initial large context window when you ask questions it might feel a little bit longer to be able to parse that but considering that that's pretty close to that hundred thousand token limit you'll see here that it is still pretty quick considering what you're having to do like you can imagine say the human equivalent of trying to sift through 200 documents or even maybe not physically sifting through but trying to search through and parse different parts it can be something that you know takes some time so you know we'll see this sort of load and with the larger you know token Windows it will obviously take a little bit more time so while that's loading I'll just go over to the blog post and do a little housekeeping so I'll just bring this up to the side for us and keep this by the side so you see the answer is loading now the one thing with um the model right now is it is available within the US and UK however if you have a VPN you will be able to try this out so I can't speak for all vpns but let's just say some of them allow you to do this pretty easily similar for Bard if you're in a restricted area and you go and you set your location to us it does work from my experience so other aspects that it demonstrates in the blog post so there's the multi-step output you can summarize make a table there's the coding with Claude And there's other things in here where it talks about performance so this is their latest and greatest model uh in in my next videos here I'll be going through actually implementing their API and seeing how this works to be able to you know play with a model that has such a high token limit I think for coders in particular I can speak for myself it is based on the results initially after seeing this obviously I've only played with this with you know for for a number of hours is I could say this is a big competitor to chat GPT you know the simple user experience features of being able to drag those documents without me needing to you know use like the python code interpreter to accomplish you know like uploading files and having it do something is really great um and yeah like I up until this point I have to say I've been uh primarily focused on using openai and chat gbt within the videos that I've I've produced but just on First Impressions on this alone I'm definitely going to be diving in and creating more content on anthropic and their models so if you found this video useful please like comment share and subscribe and otherwise until the next one