NSFW Drama on Stable Diffusion

Lost Books
6 min readAug 26, 2022

We have followed with interest the drama as Stable Diffusion (SD), the new open source AI image generation model, has gone public.

The CEO of stability.ai, the company that makes SD stated in a Techcrunch article, and also in other places:

“The paternalistic and somewhat condescending attitude of many AI aficionados is misguided in not trusting society.”

From early on, SD always positioned itself as an AI model you could basically do anything you wanted with — provided you were running it locally. This in contrast to OpenAI’s highly restrictive content policy and error messages.

Not too long after that (literally two days after the Techcrunch article quoted above), he also stated in the Discord:

“please do not deliberately generate NSFW stuff or you will get banned/are basically being a douche”

That message feels a little “paternalistic” and “not trusting society,” unfortunately, but we can understand the reason given the context.

Now, Discord has its own rules about what is allowed. Interestingly, Stability.ai created a tool that was apparently routinely violating them, even often when users were…

--

--