Stable Diffusion

Stable Diffusion is an open-weight latent diffusion model for text-to-image generation, built by Stability AI Ltd. and first released in August 2022. Unlike closed platforms such as Midjourney or DALL-E, Stable Diffusion publishes its model weights under a community license, meaning anyone can download, run, and fine-tune the model on their own hardware without paying per image. The current flagship, Stable Diffusion 3.5 (released October 2024), comes in three variants: SD3.5 Large at 8.1 billion parameters, the distilled SD3.5 Large Turbo that generates in four steps, and the consumer-friendly SD3.5 Medium at 2.5 billion parameters. This is not a single tool; it is a model family that powers an ecosystem of third-party interfaces, community-trained checkpoints, and commercial applications.

Stable Diffusion supports text-to-image, image-to-image, inpainting, and outpainting. Its deepest capabilities come from two integration layers: ControlNet, which lets users guide composition and pose using a reference image rather than relying on prompts alone, and LoRA (Low-Rank Adaptation) files, small fine-tune adapters that apply a specific style, character, or subject to any base model without a full training run. The community has produced hundreds of thousands of LoRAs and custom checkpoints on platforms like Civitai and Hugging Face. The model is accessible locally via ComfyUI or AUTOMATIC1111, or via the Stability AI API at $0.035-$0.065 per image depending on the model variant.

What Stable Diffusion generates in April 2026

The SD3.5 Large model outputs at up to 1 megapixel resolution using a Multimodal Diffusion Transformer (MMDiT) architecture with QK normalization, a major architectural shift from the U-Net design used in SD 1.5 through SDXL. The Large Turbo variant trades a small quality margin for four-step generation, useful when iterating on compositions quickly. SD3.5 Medium supports 0.25-2 megapixel resolution and runs on consumer hardware with 9.9GB VRAM, making it the practical choice for users without professional-grade GPUs.

SDXL remains widely used within the community because its LoRA and checkpoint library is deeper than SD3.5's, which is still maturing. SD3.5 improved on SD3 Medium's weak prompt adherence and the anatomy problems that plagued that earlier release, with Stability AI citing better text rendering, more accurate multi-object scenes, and a wider stylistic range. The model supports photorealism, illustration, concept art, 3D rendering, and painterly aesthetics without separate mode switching. Three text encoders (OpenCLIP-ViT/G, CLIP-ViT/L, and T5-xxl) handle prompt parsing, which gives SD3.5 a stronger grasp of complex, structured prompts than earlier SD versions.

Where Stable Diffusion sits versus FLUX and Midjourney

FLUX (Black Forest Labs) is the most direct competitor in the open-weight space. FLUX was built by Robin Rombach and colleagues who originally developed Stable Diffusion at Stability AI before leaving to start Black Forest Labs in early 2024. FLUX.1 models run a hybrid multimodal and parallel diffusion transformer architecture at 12 billion parameters, using rectified flow matching rather than the probabilistic denoising approach of earlier SD models. In practical terms, FLUX needs fewer inference steps to reach equivalent quality and handles long, multi-element prompts more reliably. Community benchmarks on r/StableDiffusion through late 2025 consistently placed FLUX ahead on photorealism, text rendering inside images, and complex scene composition. One subreddit moderator put it plainly: "Flux won the quality battle. SD still wins on ecosystem, LoRA libraries, and community resources." That ecosystem gap is real. SD3.5 and SDXL together have a head start of years in community fine-tunes, ControlNet models, and workflows. FLUX's LoRA library is growing but has not caught up.

Midjourney is a fully proprietary, closed-source cloud service. Its model weights are not public, there is no ControlNet equivalent, no LoRA system, and no way to self-host or fine-tune. Midjourney V6 and later versions benchmark as the current quality leader for aesthetic and artistic coherence from simple prompts, with polished outputs in seconds via Discord or its web app. The tradeoff is total loss of configurability: you cannot train Midjourney on your own dataset, cannot control pose or composition programmatically, and cannot build it into your own application. A Midjourney subscription costs $10-$120 per month with no free tier as of 2026. Stable Diffusion wins decisively on customization, self-hosting economics for high-volume users, and API integration. Midjourney wins on out-of-box image quality and ease of use for non-technical creatives.

"The biggest advantage of stable diffusion over things like midjourney is the amount of control you can do to your images like controlnet and loras." - r/StableDiffusion user, 2025

Real cost of running Stable Diffusion

Self-hosting via ComfyUI or AUTOMATIC1111 is free after the hardware investment. SDXL runs comfortably on a GPU with 12GB VRAM; SD3.5 Medium needs 9.9GB; SD3.5 Large needs 18GB (reducible to about 11GB with FP8 quantization via NVIDIA TensorRT). A consumer RTX 4070 Ti covers SDXL and SD3.5 Medium. SD3.5 Large requires a higher-end card such as an RTX 3090, 4090, or 4080 Super. Once the hardware is in place, local generation has no per-image cost regardless of volume.

The Stability AI Community License is free for individuals and organizations with annual revenue under $1 million, covering both commercial and non-commercial use. Users fully own all generated outputs. Organizations generating over $1 million annually need an Enterprise License at custom pricing. For developers who want API access without managing hardware, Stability AI's platform charges 3.5-8 credits per image depending on model tier ($0.035-$0.08 per image). A commercial membership at $20/month provides a subscription-based relationship with the API rather than pay-as-you-go credits. API pricing was updated in August 2025, with some tier rates increasing. The 25 free credits on signup are enough for six to seven trial images at the highest quality tier.

"Start with A1111 if you're new, switch to ComfyUI when you want more performance or start working with Flux." - r/StableDiffusion community consensus, 2026

Where Stable Diffusion reliably fails

The most notorious launch in SD history came in June 2024, when Stability AI released Stable Diffusion 3 Medium. The community waited through months of hype, then watched the subreddit fill with examples of mangled human anatomy: fused limbs, extra fingers, torsos that collapsed into each other, hands that looked like melted wax. Slashdot and Futurism ran headlines calling it a step backward. The root cause was Stability AI's aggressive NSFW filtering during training, which inadvertently stripped anatomy data from the training set. CivitAI, the world's largest repository of community SD models, responded by announcing a temporary ban on all SD3-related content to protect users from licensing liability created by the simultaneous controversy over SD3's original restrictive license terms. Stability AI revised the license and later released SD3.5 with corrected anatomy handling, but the SD3 launch poisoned community trust in a way that benefited FLUX's arrival two months later.

Beyond that specific incident, persistent failure modes across SD versions include: distorted hands and fingers even in SD3.5 (better than SD3 Medium but not solved), difficulty rendering legible text inside images without specific text-focused LoRAs, and prompt drift on complex multi-object scenes where some described elements are dropped or merged. The setup burden is another consistent complaint. Installing and maintaining a working ComfyUI or A1111 environment on Windows or Linux requires managing Python environments, CUDA versions, model paths, and extension dependencies. First-time setup regularly takes an afternoon, and updates can break working configurations. Users who want results in 30 seconds from a text box will find the friction significant.

Who Stable Diffusion is for, and who should pick something else

Stable Diffusion is the correct choice for digital artists who need composition control that goes beyond prompt engineering, ControlNet workflows for pose and depth references, and a library of thousands of style or character LoRAs. It is the right pick for developers building image generation into their own products, either via the API or by embedding the model directly. High-volume generators, particularly those creating hundreds or thousands of images per month, benefit substantially from local self-hosting once the hardware cost is amortized. Researchers and ML practitioners working on fine-tuning, model distillation, or custom training pipelines need access to open weights, and SD remains one of the most studied and documented model families available.

Skip Stable Diffusion if you are a marketer, social media manager, or creative professional who needs high-quality results from short prompts with no setup or maintenance. The configuration overhead is a real cost that does not disappear with experience, and Midjourney consistently produces more immediately polished results for casual use cases. If photorealism and complex prompt adherence are the top priorities and you are comfortable with another open-weight model, FLUX.1 Dev currently beats SD3.5 Large in community head-to-head tests. And if you are on a budget GPU with 8GB or less VRAM, you will be limited to SDXL with optimizations or SD 1.5, both of which lag behind current-generation quality benchmarks.