OpenAI, the company behind ChatGPT, has released draft documentation outlining how it wants its AI technology to behave. The Model Spec document reveals that the company is exploring the possibility of responsibly providing the ability to generate NSFW (not safe for work) content, including erotica, extreme gore, slurs, and unsolicited profanity, in age-appropriate contexts through its API and ChatGPT.
Currently, OpenAI’s usage policies prohibit sexually explicit or suggestive materials, but the company is considering loosening these restrictions. However, the extent to which OpenAI plans to allow the generation of explicit content remains unclear.
In a statement to WIRED, company spokesperson Niko Felix said that OpenAI does not intend for its models to generate AI porn, while NPR reported that Joanne Jang, who helped write the Model Spec, acknowledged that users would ultimately decide if the technology produced adult content.
“We’re exploring whether we can responsibly provide the ability to generate NSFW content in age-appropriate contexts,” OpenAI wrote in the document.
Joanne Jang, one of the writer of the Model Spec, told NPR that this means they “want to ensure that people have maximum control to the extent that it doesn’t violate the law or other peoples’ rights, but enabling deepfakes is out of the question, period,” clarifying that “this doesn’t mean that we are trying now to create AI porn.”
It’s unclear though how that would make this possible. The potential embrace of explicit AI content by OpenAI raises concerns, as AI-generated pornography has become a significant and troubling application of generative AI technology.
Deepfake porn, which depicts real people without their consent, has been used as a tool for harassment, particularly against women and girls.
Information for this story was found via the sources and companies mentioned. The author has no securities or affiliations related to the organizations discussed. Not a recommendation to buy or sell. Always do additional research and consult a professional before purchasing a security. The author holds no licenses.
