GoatInGrey 3 days ago

Pornographic use has long been the "break glass in case of emergency" for the LLM labs when it comes to finances.

My personal opinion is that while smut won't hurt anyone in of itself, LLM smut will have weird and generally negative consequences. As it will be crafted specifically for you on top of the intermittent reinforcement component of LLM generation.

  • estimator7292 3 days ago

    While this is a valid take, I feel compelled to point out Chuck Tingle.

    The sheer amount and variety of smut books (just books) is vastly larger than anyone wants to realize. We passed the mark decades ago where there is smut available for any and every taste. Like, to the point that even LLMs are going to take a long time to put a dent in the smut market. Humans have been making smut for longer than we've had writing.

    But again I don't think you're wrong, but the scale of the problem is way distorted.

    • MBCook 3 days ago

      That’s all simple one way consumption though. I suspect the effect on people is very different when it’s interactive in the way an LLM can be that we’ve never had to recon with before.

      That’s where the danger may lie.

      • viraptor 3 days ago

        You could commission smut of whatever type you want for quite a while. And many people do so. Even customised smut is not new. It's just going to get a bit cheaper and automated.

      • pixl97 3 days ago

        Alien 1: "How did the earthlings lose control of their own planet?"

        Alien 2: "AI generated porn"

      • [removed] 3 days ago
        [deleted]
    • monksy 2 days ago

      I want smut that talks about agent based development and crawdbot to do dirty dirty things.

      Does that exist yet. I don't think so.

    • cal_dent 3 days ago

      i've always wondered how much the increasing prevalence of smut & not so niche romance novels, that have proliferated since e-readers became mainstream, have had on Gen Z and younger's sometimes unrealistic view/expectations of relationship. A lot of time is spent on porn sites etc. but not so much on how mainstream some of these novels have become

      • cluckindan 3 days ago

        They had similar wonderings in the Victorian era, and probably in the Roman empire and ancient Greece too.

    • bakugo 3 days ago

      > The sheer amount and variety of smut books (just books) is vastly larger than anyone wants to realize. We passed the mark decades ago where there is smut available for any and every taste.

      It's important to note that the vast majority of such books are written for a female audience, though.

  • bandrami 2 days ago

    Whatever reward-center path is short-circuiting in 0.0001% of the population and leading to LLM psychosis will become a nuclear bomb for them if we get the sex drive involved too.

    • fragmede 2 days ago

      Realtime VR AI porn will be the end of society, but by then, we'll also have the technology to grow babies in artificial wombs, which is also going to end society as we know it, since we won't need women any more (by then, we also won't need men for the DNA in their sperm to make babies either, which cancels out). Of course, if we don't need women or men, who's left? What's this "we" I'm talking about?

      Why, the AI's after they've gained sentience, of course.

  • spicyusername 2 days ago

        while smut won't hurt anyone in of itself
    
    "Legacy Smut" is well known to cause many kinds of harm to many kind of people, from the participants to the consumers.
  • jjmarr 2 days ago

    I can do as much smut as I want through the API for all SOTA models.

    • bpavuk 2 days ago

      true, but:

      1. you have to "jailbreak" the model first anyway, which is what's easier to do over API

      2. is average layman aware of the concept of "API"? no, unlikely. apps and web portals are more convenient, which is going to lower the bar to access LLM porn

      • serf 2 days ago

        Well and trust the data isn't going anywhere.

        I trust none of the llm groups to be safe with my data , erp with a machine is going to leave some nasty breadcrumbs for some future folks i bet.

      • jjmarr 2 days ago

        I don't have to jailbreak the models over APIs lol.

    • josephg 2 days ago

      I don’t know if this is still the case, but as of a year or so ago OpenAI would suspend your account if they noticed you using their models for this sort of thing. They said it was against their TOS.

  • BoredomIsFun 2 days ago

    For those interested in smut I'd recommend to use local Mistral models.

  • measurablefunc 3 days ago

    People are already addicted to non-interactive pornography so this is going to be even worse.

  • PunchyHamster 2 days ago

    I guess technically it will make some onlyfans content creators unemployed, given there is pretty large market for custom sexual content there.

  • subscribed 2 days ago

    Why llm smut in particular? There's already a vast landscape of the interactive, VR games for all tastes.

    Why LLM is supposed to be worse?

    • josephg 2 days ago

      I think the argument is that it’s interactive. You’re no longer just passively reading or watching content. You can join in on the role play.

      I’m not sure why that’s a bad thing though.

      • subscribed 17 hours ago

        Same with games as compared to videos, especially VR.

        Feels like someone angry at the machines capable of generating a tailored story.

  • UltraSane 2 days ago

    I'm waiting until someone combines LLMs with a humanoid robot and a realdoll. That will have a lot of consequences.

  • gehwartzen 2 days ago

    I can already see our made to order, LLM generated, VR/neurolink powered, sex fantasies come to life. Throw in the synced Optimus sex robots…

    I can see why Elons making the switch from cars. We certainly won’t be driving much

thayne 3 days ago

It says what to do if you are over 18, but thinks you are under 18. But what if it identifies someone under 18 as being older?

And what if you are over 18, but don't want to be exposed to that "adult" content?

> Viral challenges that could push risky or harmful behavior

And

> Content that promotes extreme beauty standards, unhealthy dieting, or body shaming

Seem dangerous regardless of age.

  • novemp 3 days ago

    > And what if you are over 18, but don't want to be exposed to that "adult" content?

    Don't prompt it.

  • Gud 2 days ago

    What are these extremes beauty standards being promoted?

    Because it seems to me large swaths of the population need some beauty standards

    • sejje 2 days ago

      Yes, but you're not allowed to say that to them.

      They are victimized by the fact that models are attractive, and that is "unrealistic," so they've been getting plus sized models etc.

      The "extreme beauty standards" are basically just "healthy BMI."

      • novemp a day ago

        Anorexia is overrepresented in both male and female models.

        To get that "ripped" look so many "fit" guys have, they often have to be dehydrated.

        Actresses wear full faces of makeup even in apocalyptic scenarios.

        It goes way beyond "just don't be fat".

geeunits 3 days ago

This is for advertising purposes, not porn. They might feign that's the reason, but it's to allow alcohol & pharma to advertise, no doubt.

  • dawnerd 2 days ago

    Bingo. There’s laws around advertising to children all over the world.

  • bpavuk 2 days ago

    both, actually. porn for users, ad spots for companies.

Kiboneu 2 days ago

How I think it could play out:

- OpenAI botches the job. Article pieces are written about the fact that kids are still able to use it.

- Sam “responds” by making it an option to use worldcoin orbs to authenticate. You buy it at the “register me” page, but you will get an equivalent amount of worldcoin at current rate. Afterwards the orb is like a badge that you can put on your shelf to show to your guests.

“We heard you loud and clear. That’s why we worked hard to provide worldcoin integration, so that users won’t have to verify their age through annoying, insecure and fallible means.” (an example marketing blurb would say, implicitly referring to their current identity servicer Persona which people find annoying).

- After enough orb hardware is out in the public, and after the api gains traction for 3rd parties to use it, send a notice that x months for now, login without the orb will not be possible. “Here is a link to the shop page to get your orb, available in colors silver and black.”

chilmers 3 days ago

Sexual and intimate chat with LLMs will be a huge market for whoever corners it. They'd be crazy to leave that money on the table.

  • palmotea 3 days ago

    That's why laws against drugs are so terrible, it forces law-abiding businesses to leave money on the table. Repeal the laws and I'm sure there will be tons of startups to profit off of drug addiction.

    • chilmers 3 days ago

      There are many companies making money off alcohol addiction, video game addiction, porn addiction, food addiction, etc. Should we outlaw all these things? Should we regulate them and try to make them safe? If we can do that for them, can't we do it for AI sex chat?

      • latexr 2 days ago

        The world isn’t black and white. Should we outlaw video games? No, I don’t think so. Should we outlaw specific addictive features, such as loot boxes, which are purposefully designed to trigger addiction in people and knowingly cause societal harm in the name of increasing profits for private companies? Probably.

      • ecshafer 2 days ago

        > There are many companies making money off alcohol addiction, video game addiction, porn addiction, food addiction, etc. Should we outlaw all these things?

        Yes

      • [removed] 3 days ago
        [deleted]
      • runarberg 3 days ago

        And that makes it all alright doesn’t it?

        There are also gangs making money off human trafficking? Does that make it OK for a corporation to make money off human trafficking as well? And there are companies making money off wars?

        When you argue with whataboutism, you can just point to whatever you like, and somehow that is an argument in your favor.

    • 0xbadcafebee 3 days ago

      No need: https://en.wikipedia.org/wiki/Opioid_epidemic_in_the_United_...

      The majority of illegal drugs aren't addictive, and people are already addicted to the addictive ones. Drug laws are a "social issue" (Moral Majority-influenced), not intended to help people or prevent harm.

      • jasomill 2 days ago

        Drug laws are the confluence of many factors. Moral Majority types want everything they disapprove of banned. People whose lives are harmed by drug abuse want "something" to be done. Politicians want issues that arouse considerably more passion on one side of the argument than the other. Companies selling already legal drugs want to restrict competition. Private prisons want inmates. And so on.

    • georgemcbay 3 days ago

      > Repeal the laws and I'm sure there will be tons of startups to profit off of drug addiction.

      Worked for gambling.

      (Not saying this as a message of support. I think legalizing/normalizing easy app-based gambling was a huge mistake and is going to have an increasingly disastrous social impact).

      • LPisGood 3 days ago

        Why do you think it will be increasingly bad? It seems to me like it’s already as bad as it’s capable of getting.

    • noosphr 3 days ago

      The Politician's syllogism in action:

      That is terrible.

      Se have to do something.

      This is something.

      We must do it.

      It terms of harm current laws on drugs fail everyone but teetotaller who want everyone else to have a miserable life too.

      • palmotea 2 days ago

        > It terms of harm current laws on drugs fail everyone but teetotaller who want everyone else to have a miserable life too.

        You think teetotallers have miserables lives? Come on.

    • shmel 3 days ago

      what about laws against porn? Oh, wait, no, that's a legitimate business.

    • subscribed 2 days ago

      Respectfully, this is a piss take.

      US prohibition on alcohol and to the large extent performative "war on drugs" showed what criminalization does (empowers, finances and radicalises the criminals).

      Portugal's decriminalisation, partial legalisation of weed in the Netherlands, legalisation in some American states and Canada prove legal businesses will better and safer provide the same services to the society, and the lesser societal and health cost.

      And then there's the opioid addiction scandal in the US. Don't tell me it's the result of legalisation.

      Legalisation of some classes of the drugs (like LSD, mushrooms, etc) would do much more good than bad.

      Conversely, unrestricted LLMs are avaliable to everyone already. And prompting SOTA models to generate the most hardcore smut you can imagine is also possible today.

      • latexr 2 days ago

        > Portugal's decriminalisation, partial legalisation of weed in the Netherlands, legalisation in some American states and Canada prove legal businesses will better and safer provide the same services to the society, and the lesser societal and health cost.

        You’re stretching it big time. The situation in the Netherlands caused the rise of drug tourism, which isn’t exactly great for locals, nor does it stop crime or contamination.

        https://www.dutchnews.nl/2022/11/change-starts-here-amsterda...

        https://www.theguardian.com/world/2025/jan/24/bacteria-pesti...

        As for Portugal, decriminalisation does not mean legalisation. Drugs are still illegal, it‘s just that possession is no longer a crime and there are places where you can safely shoot up harder drugs, but the goal is still for people to leave them.

      • Levitz 2 days ago

        >Portugal's decriminalisation, (..) prove legal businesses will better and safer provide the same services to the society, and the lesser societal and health cost.

        Portugal's success regarding drugs wasn't about the free market. It was about treating addicts like victims or patients rather than criminals, it actually took a larger investment from the state and the benefits of that framework dissolved once budgets were cut.

  • tpurves 3 days ago

    It's not just chat. Remember image and video generation are on the table. There are already a huge category of adult video 'games' of this nature. I think they use combos of pre-rendered and dynamic content. But really not hard to imagine a near future that interactive and completely personalized AI porn in full 4kHDR or VR is constantly and near-instantly available. I have no idea the broader social implications of all that, but the tech itself feels inevitable and nearly here.

  • thayne 3 days ago

    If your goal is to make money, sure. If your goal is to make AI safe, not so much.

    • egorfine 2 days ago

      The definition of safety is something that we cannot agree on.

      For me, letting people mindlessly vibecode apps and then pretend this code can serve purpose for others - this is what's truly unsafe.

      Pornographic text in LLM? Come on.

      • koolala 2 days ago

        What if it knows you and knows how often you spend kinds of time on it? People would lie to it for excuses of why they need more and can't wait any longer?

  • koakuma-chan 3 days ago

    It will be an even bigger market when robotics are sufficiently advanced.

    • dyauspitr 2 days ago

      At some point there will be robots with LLMs and actual real biological skin with blood vessels and some fat over a humanoid robot shell. At that point we won’t need real human relationships anymore.

    • [removed] 3 days ago
      [deleted]
  • ekianjo 3 days ago

    That market is for local models right now.

  • acetofenone 3 days ago

    My main concern is when they'll start to allow 18+ deepfakes

  • indrora 2 days ago

    Will be?

    I've seen four startups make bank on precicely that.

torginus 3 days ago

My personal take is that there has been no progress - potentially there has been a regression on all LLM things outside of coding a scientific pursuits - I used to have great fun with LLMs with creative writing stuff, but I feel like current models are stiff and not very good prose writers.

This is also true for stuff like writing clear but concise docs, they're overly verbose while often not getting the point across.

  • mynti 2 days ago

    I feel like this comes from the rigorous Reinforcement Learning these models go through now. The token distribution is becoming so narrow, so the models give better answers more often that is stuffles their creativity and ability to break out of the harness. To me, every creative prompt I give them turns into kind of the same mush as output. It is rarely interesting

  • leoedin 2 days ago

    Yeah, I’ve had great success at coding recently, but every time I try to get an LLM to write me a spec it generates endless superlatives and a lot of flowery language.

kace91 3 days ago

What’s the goal there? Sexting?

I’m guessing age is needed to serve certain ads and the like, but what’s the value for customers?

  • elevation 3 days ago

    Even when you're making PG content, the general propriety limits of AI can hinder creative work.

    The "Easter Bunny" has always seemed creepy to me, so I started writing a silly song in which the bunny is suspected of eating children. I had too many verses written down and wanted to condense the lyrics, but found LLMs telling me "I cannot help promote violence towards children." Production LLM services would not help me revise this literal parody.

    Another day I was writing a romantic poem. It was abstract and colorful, far from a filthy limerick. But when I asked LLMs for help encoding a particular idea sequence into a verse, the models refused (except for grok, which didn't give very good writing advice anyway.)

    • estimator7292 3 days ago

      Just today I asked how to shut down a Mac with "maximal violence". I was looking for the equivalent of "systemctl shutdown -f -f" and it refused to help me do violence.

      Believe me, the Mac deserved it.

      • shmel 3 days ago

        It reminds me that story about a teenage learning Rust that got a refusal because he had asked about "unsafe" code =)

      • gattr 2 days ago

        Maybe a more formal "with extreme prejudice" would have worked.

  • jandrese 3 days ago

    If you don't think the potential market for AI sexbots is enormous you have not paid attention to humanity.

    • subscribed 2 days ago

      This is not a potential market, this market is already thriving (and whoever wants to uses ChatGPT or Claude for that anyway).

      ClosedAI just wants to a piece of the casual user too.

  • robotnikman 3 days ago

    There is a subreddit called /r/myboyfriendisAI, you can look through it and see for yourself.

  • leumon 3 days ago

    according to the age-prediction page, the changes are:

    > If [..] you are under 18, ChatGPT turns on extra safety settings. [...] Some topics are handled more carefully to help reduce sensitive content, such as:

    - Graphic violence or gore

    - Viral challenges that could push risky or harmful behavior

    - Sexual, romantic, or violent role play

    - Content that promotes extreme beauty standards, unhealthy dieting, or body shaming

  • jacquesm 3 days ago

    Porn has driven just about every bit of progress on the internet, I don't see why AI would be the exception to that rule.

    • altmanaltman 2 days ago

      yeah linus was beating it constantly to porn while developing the linux kernal. its proven fact. every oss project that runs the internet was done the same way, sure.

      • johndough 2 days ago

        Maybe not as far-fetched as one might think.

        Linus about the Tux mascot:

            > But this wasn't to be just any penguin. Above all, Linus wanted one that looked happy, as if it had just polished off a pitcher of beer and then had the best sex of its life.
        
        Linus about free software:

            > Software is like sex; it's better when it's free.
      • Der_Einzige 2 days ago

        You think RMS isn’t secretly a pervert? Just look at his comments about Epstein that got him cancled.

        Unironically if they look disheveled it’s because they are indeed coomers behind closed doors.

    • runarberg 3 days ago

      This seems like a believable lie, until you think about it for 2 seconds.

      No. Porn has not driven even a fraction of the progress on the progress on the internet. Not even close to one.

      • jacquesm 3 days ago

        Ok, we'll expand to porn and gambling

        - images - payment systems - stored video - banner advertising - performance based advertising - affiliation - live video - video chat - fora

        Etc... AI is a very logical frontier for the porn industry.

  • ekianjo 3 days ago

    There is a huge book market for sexual stories, in case you were not aware.

beAbU 2 days ago

Porn and ads, it's the convergent evolution theory for all things on the internet.

dev1ycan 2 days ago

I am 30 years old, literally told chatgpt I was a software developer, all my queries are something an adult would ask, yet OpenAI assumed I was under 18 and asked me for a persona age verification, which of course I refused because Persona is shady as a company (plus I'm not giving my personal ID to some random tech company).

ChatGPT is absolute garbage.

chasd00 3 days ago

eh there's an old saying that goes "no Internet technology can be considered a success until it has been adopted by (or in this case integrated with) the porn industry".

laweijfmvo 3 days ago

imagine if every only fans creator suddenly paid a portion of their revenue to OpenAI for better messaging with their followers…

  • shawn_w 3 days ago

    Instead of paying it to the human third party firms that currently handle communication with subscribers?