In a move that has sparked debate and concerns, OpenAI has revealed it is exploring whether to permit the creation of artificial intelligence-generated pornography and other explicit content through its products and technologies.
The company behind viral AI systems like ChatGPT and DALL-E stated it is looking at responsibly providing "the ability to generate not-safe-for-work (NSFW) content in age-appropriate contexts." This could potentially include erotica, extreme violence, offensive language, and explicit nudity according to OpenAI.
While OpenAI emphasised its ban on deepfakes would remain in place, the proposal has raised eyebrows and criticism from online safety advocates who argue it undermines OpenAI's stated mission of developing "safe and beneficial" artificial intelligence.
OpenAI employee Joanne Jang explained the company wants to initiate a conversation around whether a total prohibition on AI-generated adult content is warranted. She cited potential "creative cases" where sexuality or nudity may have importance for some users. However, Jang stressed OpenAI has no intention of actually creating "AI porn" and that output qualifying as pornography would depend on definitions.
Enabling deepfakes remains strictly off-limits. The spread of non-consensual AI-generated explicit imagery has already emerged as a major issue this year. But while acknowledging those risks, OpenAI argues some users may have legitimate reasons for wanting to create adult content through its AI tools.
Child safety advocates like Baroness Beeban Kidron were highly critical, accusing OpenAI of rapidly "undermining its own mission statement" by entertaining the idea of AI-powered erotica and pornography.
Legal experts also expressed scepticism that any tech company could truly produce and distribute such material "responsibly" while preventing abuse and illegal content. The considerations reveal mounting tensions over the governance of generative AI technologies and their potential impacts, both positive and negative.
As AI capabilities rapidly advance, more complex challenges around content moderation, safety, and ethical boundaries continue to emerge.
OpenAI states its aim is to facilitate public dialogue and better understand societal expectations before potentially changing its strict rules to allow some forms of AI-generated adult content. But the proposal seems likely to face stringent opposition from online safety groups.
תגובות