OpenAI GPT 4o Image Generation in 7 Minutes

--- type: transcript date: 2025-03-25 youtube_id: hTNAYbopAaA --- # Transcript: OpenAI GPT 4o Image Generation in 7 Minutes AI has finally released the much anticipated GPD 40 image generation capabilities and it is honestly quite amazing this is a demonstration where it's taking some instructions of text as well as two different photos one of a playing card as well as a photo of one of the researchers dogs we can see it generates perfect text all throughout all in real time meet gp40 our native multimodal model that can generate images in seconds and we have all of those specific detail details within there in this video I'll show you a handful of examples and I have some great news in terms of getting started here's an example of a whiteboard session a wide image taken with a phone of a glass whiteboard in a room overlooking the Bay Bridge the field of view shows a woman writing sporting a t-shirt with a large opening eye logo handwriting looks natural and a bit messy and we see the photographer's reflection within here we see all of that text perfectly written on the Whiteboard we see the reflections even and we also see the B Bridge now the one thing that is nice they do mention that this is the best of eight examples and they also have another iteration here where it took in that original input and now it shows the photographer as well as the individual writing what's neat with this is it's not just text image you can also pass in multiple images with text to be able to generate some of these things just to show you a few other ones magnetic poetry on a fridge a picture is worth a thousand words but sometimes and then he's holding a few words in the right place Cas can Elevate its meaning in this example this was the best of five different examples kudos to them for actually highlighting that because with some of these things just with language models is often times as you probably know a lot of these things are an iterative process and you might not get it the first time here's another example of a comic strip here and finally here is a science experiment this is really interesting because especially for graphic designers and people that are in this line of work now being able to leverage a tool like this can honestly potentially make their job a lot easier and what's really cool with this is you can generate the graphic but in addition to generating the graphic is here's another example on how you can leverage that original picture as well as some subsequent text now generate a POV of a person drawing this diagram in their notebook at a round cafe table in Washington Square Park again we see that perfect text and that same representation of the image that was passed in within the exact environment that was asked for they touch on useful IM generation so from the first cave paintings to modern infographics humans have used visual imagery to communicate persuade and analyze not just decorate they mention that today's generative models conure surreal breathtaking scenes but struggle with the Workhorse of imagery people use to share and create information from logos to diagrams images can convey precise meaning when augmented with symbols that refer to Shared languages and experiences and that's one thing to really emphasize with this isn't just based on the image Generations from the model you can can upload your own images whether it's for visual inspiration or for editing certain aspects of that image with your request they mentioned that this model was trained on a joint distribution of images as well as text this model has a really good understanding on not just how images relate to language but how they relate to each other it's going to be able to likely take in whatever you're asking for and give you a quite good result in terms of the text rendering this is the most impressive model for image generation with text to date just yesterday there was a model that was released with really great image generation capabilities that did quite well with text that gp4 O's image generation capabilities definitely outperform anything to date here are just a few different examples of some street signs a menu as well as an invitation and the great thing with the image generation capability is you're going to be able to access this even for free from chat GPT so you'll be able to add different images like here's an example of someone's cat they added a monocle on the cat and there's definitely going to be a ton of really creative examples no doubt that we're going to see over the coming days another interesting tidbit that they lay out here is that gp40 can handle up to 10 to 20 different objects and and here's just a quick demonstration of that a 4x4 column grid of 16 different objects on a white background go from left to top to bottom here's the list and down here we can see the best of five example of all of those different items from common shapes to things like curs of writing as well as emojis some other really cool cool use cases with this is what can analyze and learn from user uploaded images it can seamlessly integrate the details and context to inform the image generation here is an example of passing in a number of different drawings and based on those drawings as well as the instructions we can see what looks to be a very similar representation of the images that were passed in a similar example here here is a photo realistic chainsaw and then finally here is an ad with this chainsaw of a gramma carving a turkey add Thanksgiving dinner and add a tagline so you can use this to create memes I might potentially try and leverage this to create thumbnails for my channel but overall I encourage you to try this out yourself and see what you're able to generate here's another great example of how it combines the text understanding with the image results here's actually a code example of 3js 3js is something used to make 3D shapes as well as games within the browser and based on that 3js piece of code it was able to generate this relevant image here in addition to the text capability here are a few different examples of some different photos that it was able to generate so here I'll just click through a handful of different examples here this model doesn't outperform on just tasks that a graphic designer might do generally across the board it does seem like it has very strong results in terms of some limitations now there are some they mentioned cropping hallucinations High binding problems as you might expect there are going to be some issues especially for things that require very specific details finally within the announcement they did mention that they are going to be Rel permissive in terms of what you're going to be able to generate with this obviously as you might expect they're going to block a number of different what they're calling bad stuff but it is going to be interesting to see what the boundary is of what people are able to generate with this model now the good news for the model is you will be able to access this within chat GPT today it's rolling out to plus pro team and free users as the default image generator in Chach gbt and the other great news developers will soon be able to generate image with GPD 40 via the API with access rolling out in the next few weeks now the last thing that I do want to mention that they call out here is because the model creates more detailed pictures images take longer to render often up to 1 minute that is just one thing to be mindful of in terms of your expectations of the model but otherwise that's pretty much it for this video kudos to the team over at open aai for this release it is long awaited and it definitely looks like it was worth the wait otherwise if you found this video useful please comment share and subscribe otherwise until the next one