OpenAI,France the parent company of ChatGPT, has given its first official public preview of DALL-E 3, its latest image generation model. Rolled out Wednesday at a small event for reporters, DALL-E 3 is being pitched as a tool that fully understands complex text prompts, and produces images to match them in complexity.
As a new information page about DALL-E 3 on the OpenAI website notes, "Modern text-to-image systems have a tendency to ignore words or descriptions, forcing users to learn prompt engineering. DALL-E 3 represents a leap forward in our ability to generate images that exactly adhere to the text you provide."
SEE ALSO: OpenAI releases new teacher guide for ChatGPT in classroomsPossible images from an in-progress version of DALL-E 3 were leaked onto Discord earlier this summer, and those showed enormous potential along the lines depicted in the press preview. The leaker claimed to have fed DALL-E 3 the lengthy prompt "painting of a pink jester giving a high five to a panda while in a cycling competition. The bikes are made of cheese and the ground is very muddy. They are driving in a foggy forest. The panda is angry." The resulting image was downright astonishing in its fidelity to that request.
Image generators like Midjourney and Stable Diffusion, while capable of mimicking photorealism and producing representations of a wide-range of objects, styles, and people (with no small amount of controversy to go with them) will undoubtedly struggle to produce anything this complex.
Those image generators, and OpenAI's own previous offerings in this area, also famously fall short when asked to produce images that feature text — usually producing garbled nonsense at best, and hilarious malapropisms at worst. DALL-E 3 appears to me much more capable of incorporating coherent text into images, as demonstrated in a cartoon posted on X by OpenAI CEO Sam Altman.
This Tweet is currently unavailable. It might be loading or has been removed.
Open AI says it will integrate DALL-E 3 into ChatGPT directly, and strongly implies that the chatbot will transition from one model to another, depending on the content of the prompt. ChatGPT, once purely a user-friendly spigot for text outputs from the GPT-3.5 model is rapidly evolving — incorporating third-party plugins with the ability to pull text from other sources, including the web. This move further diversifies ChatGPT's capabilities, broadening the already strained definition of the term "chatbot."
DALL-E 3 "will ramp to all ChatGPT+ users over the next couple of weeks," according to Altman. The OpenAI website says all ChatGPT Plus and ChatGPT Enterprise customers will be able to use it "in early October," and that OpenAI won't be making any copyright claims on the model's outputs. However, if you plan to generate something with DALL-E 3 and then copyright it yourself, that's a whole other can of worms.
Topics Artificial Intelligence
The Saddest Sound in the World by Sadie SteinThe Morning News Roundup for June 18, 2014Exploring Alexander Pope’s GrottoesMedical Literature by Sadie SteinBest gift card deal: Get a $100 DoorDash gift card for only $85 at Best BuyMaya Angelou, 1928–2014 by Dan PiepenbringOut of Joint by Jonathan WilsonTaxonomy by Sadie SteinThe Morning News Roundup for June 11, 2014I’d Like to Make You SmileThe Morning News Roundup for June 12, 2014I’d Like to Make You SmileThe Comforts of Suspending DisbeliefOttessa Moshfegh and Susan Stewart Win Pushcart PrizesWhy We Hate InsectsChinghiz Aitmatov and the Literature of KyrgyzstanThe Lighter Side of World War IThe Morning News Roundup for June 11, 2014The Morning News Roundup for May 22, 2014Phantom Limb by Daniel Bosch Best Shark deals this week: Save up to $100 on a robot vacuum, air purifier, and more Best Dyson deals this week: V12 Detect Slim plus refurbished Airwraps and Supersonics Best Buy's Microsoft three Wordle today: The answer and hints for August 20 Connecticut Sun vs. Atlanta Dream 2024 livestream: Watch live WNBA Shop the best robot vacuum deals the week of August 19 Best Windows laptop deals this week: HP, Asus, LG, and more Los Angeles Sparks vs. Connecticut Sun 2024 livestream: Watch live WNBA Fortnite is back on the iPhone in Europe Sonos will not bring old app back to life, CEO confirms Leaked iPhone 16 Pro image shows new bronze color Young Boys vs. Galatasaray 2024 livestream: Watch Champions League for free The 30 funniest comedies on Hulu, because we all need a laugh Wordle today: The answer and hints for August 19 iPhone 16 Pro new color will reportedly be Desert Titanium Amazon deals of the day: Sonos Ace, Kindle Paperwhite Kids, Echo Spot bundle, and 55 Wordle today: The answer and hints for August 22 Slack security crack: Its AI feature can breach your private conversations, according to report 'Hell Hole' review: Body horror at its absolute silliest Paralympic Games 2024 livestream: How to watch Paralympics for free