Diffusion

Quick introduction to text-to-image generation using Hugging Face’s diffusers packageIn this article, I will show you how to get started with text-to-image generation with stable diffusion models using Hugging Face’s diffusers package.A while back I got access to the DALLE-2 model by OpenAI, which allows you to create stunning images from text. So, I started to play around with it and generate some pretty amazing images.Image by the author. Generated with DALL-E 2.However, my credits ran out, so I decided to look for…

Image from UnsplashCreated by the researchers and engineers from Stability AI, CompVis, and LAION, “Stable Diffusion” claims the crown from Craiyon, formerly known as DALL·E-Mini, to be the new state-of-the-art, text-to-image, open-source model.Although generating images from text already feels like ancient technology, Stable Diffusion manages to bring innovation to the table, which is even more surprising given that it’s an open-source project.Let’s dive into the details, and check what Stable Diffusion has in store for…

What do all recent super powerful image models like DALLE, Imagen, or Midjourney have in common? Other than their high computing costs, huge training time, and shared hype, they are all based on the same mechanism: diffusion. Diffusion models recently achieved state-of-the-art results for most image tasks including text-to-image with DALLE but many other image generation-related tasks too, like image inpainting, style transfer or image super-resolution. But how do they work? Learn more in the video...Louis BouchardI…

A state-of-the-art AI model available for everyone through a safety-centric open-source license is unheard of.Credit: HollyB#1382 (portrait)Earlier this week the company Stability.ai, founded and funded by Emad Mostaque, announced the public release of the AI art model Stable Diffusion. You may think this is just another day in the AI art world, but it’s much more than that. Two reasons.First, unlike DALL·E 2 and Midjourney — comparable quality-wise — , Stable Diffusion is available as open-source. This means anyone can…

And the limitations (today!) of this approachThe authors of Stable Diffusion, a latent text-to-image diffusion model, have released the weights of the model and it runs quite easily and cheaply on standard GPUs. This article shows you how you can generate images for pennies (it costs about 65c to generate 30–50 images).Start a Vertex AI NotebookThe Stable Diffusion model is written in Pytorch and works best if you have more than 10 GB of RAM and a reasonably modern GPU.On Google Cloud, go to the Vertex AI Workbench by…

Kyle Wiggers / TechCrunch: Stable Diffusion, a DALL-E 2-like system now available to 1K+ researchers, is raising tricky ethical questions by allowing depictions of public figures and more — DALL-E 2, OpenAI's powerful text-to-image AI system, can create photos in the style of cartoonists, 19th century daguerreotypists, stop-motion animators and more. Kyle Wiggers / TechCrunch: Stable Diffusion, a DALL-E 2-like system now available to 1K+ researchers, is raising tricky ethical questions by allowing…