ChatGPT Desktop Can Now Access VS Code, Xcode, Terminal & iTerm2

--- type: transcript date: 2024-11-14 youtube_id: ullyQaC39Mg --- # Transcript: ChatGPT Desktop Can Now Access VS Code, Xcode, Terminal & iTerm2 open AI has just released a new feature to the Chad GPT desktop app that allows you to access the context of vs code xcode terminal as well as I term 2 I'm going to play the video from this tweet and then once that's done I'm going to be showing you the steps in terms of setting this up and then showing you a quick demonstration in terms of my experience and my thoughts on it as well hi I'm Roman from open AI today I want to show you a quick look at an early feature in the chat GPT app for Mac OS the ability to work directly with the applications on your computer so imagine I'm building an iPhone app and I have my xcode project open here previously I would have had to copy my code back and forth from xcode into CH GPT well now with this new integration that I enabled I can click the xcode button here and Chad GPT can immediately see the Swift Code I'm working on check out this example so open1 first created this entire app from scratch to track the ISS and astronauts in space in real time but say I want to add a new feature to this app I can simply write add a screen in the center with the live stream now CH GPT has the context about my existing Swift Code and starts suggesting the changes that's done so I can just jump back in and update the code let's build the app command R great it's pretty cool the live stream is right there with even a fancy icon for it and I could keep on going and adding new features but for now let's ship this update I'm going to switch to the terminal and I'm going to now ask CHP to work with my terminal I'm going to tell CH GPT to help me push this on GitHub now given that CH GPT has the context of the two apps xcode and the terminal chpt can help write commit messages based on the work we're just done it can also help troubleshoot errors if you have any or install missing dependencies based on anything it sees in your terminal output and that's it chat GPT helped me iterate on this app it's like having a pair programmer by your side and you're ready to CH dis update we're always working on additional ways to make CH GPT more useful for developers personal I would love for instance for chat GPT to go even further showing me the diffs writing the files or potentially letting me talk out loud the features i' like to add and these are things we'll continue to explore we hope you find this update useful and stay tuned for more I think the key piece with what he mentioned at the end there was this right now is for reading the context effectively there isn't the ability to action things right now like writing to files or executing commands within the terminal that's something that is very likely coming now in terms of getting set up the main piece that you will need if you're going to be using vs code is you'll have to download this extension I'll put the link to this within the description of the video and then to install it you can just open up your command pallet command shift p and then you just type in vsx and you select this option of extensions to install once you have that I'm just going to open up vs code as well as iterm and the chat gbt app let's open up a brand new tab here and let's just clear out our project and set up a couple quick examples within the app there's this new icon where it will show all of the apps that are supported that you have installed in my case I have vs code installed I have iterm 2 installed and then it also has the default text edit as well as the terminal that's built into the Mac OS as soon as you select one you will be prompted to just enable chat GPT to be able to access this from your security preferences you have to enable that at first and the thing with this is you can actually have multiple things with here so let's say you want to have code iterm 2 maybe even you want to have a text edit file you could do all three within here so it can see the context of what's within my file now I have this example. TS file if I were to ask a question about this and I say what is in the example. TS file and I asked that question here we see they don't have the visibility into that now that's just something to be mindful of now if I say something like start hello. TS in the bun runtime and I run that you'll see it will give you the command of how to run this but it's not going to be able to execute anything if I just go ahead and run this now where this can potentially be helpful though is let's say It's a larger application or a smaller application doesn't really matter and you go and you try and run that and let's run it again with a deliberate error and I just say what is the error then based on the context of what it sees within the terminal it gives me the fix that I can put within this file all in all I think right now what's interesting with this is more where it's going not necessarily where it is right now I think I personally am still going to be using other tools and other approaches this probably isn't going to be a flow that I will be using but as soon as they have the voice capability and the ability to read and write to both the terminal as well as vs code that's going to be something a lot more compelling right now being able to not have to copy and paste the context that is definitely nice and being able to access the context of multiple things locally on your machine very nice but I'm not sure with this beta version how wide the adoption will necessarily be you don't have to copy and paste in the context you still have to copy and replace the context I think once they figure out the ability to write within the programs execute commands within the terminal and also use the voice feature that's going to be definitely a lot more compelling and I look forward to when that is finally available but otherwise I just wanted to do a quick one if you found this video useful please like comment share and subscribe otherwise until the next one