909
Instagram Advertises Nonconsensual AI Nude Apps (www.404media.co)
submitted 2 years ago by to c/technology@lemmy.world
315 comments fedilink hide all child comments
 

Instagram is profiting from several ads that invite people to create nonconsensual nude images with AI image generation apps, once again showing that some of the most harmful applications of AI tools are not hidden on the dark corners of the internet, but are actively promoted to users by social media companies unable or unwilling to enforce their policies about who can buy ads on their platforms.

While parent company Meta’s Ad Library, which archives ads on its platforms, who paid for them, and where and when they were posted, shows that the company has taken down several of these ads previously, many ads that explicitly invited users to create nudes and some ad buyers were up until I reached out to Meta for comment. Some of these ads were for the best known nonconsensual “undress” or “nudify” services on the internet.

you are viewing a single comment's thread
view the rest of the comments
[–] 101 points 2 years ago* (4 children)

And yet, people are still scorned and offended as if they were.

I think you are missing the plot here... If a naked pic of yourself, your mother, your wife, your daughter is circulating around the campus, work or just online... Are you really going to be like "lol my nipples are lighter and they don't know" ??

You may not get that job, promotion, entry into program, etc. The harm done by naked pics in public would just as real weather the representation is accurate or not ... And that's not even starting to talk about the violation of privacy and overall creepiness of whatever people will do with that pic of your daughter out there

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 8 child comments
    •
  • [–] 42 points 2 years ago (1 child)

    I believe their point is that an employer logically shouldn't care if some third party fabricates an image resembling you. We still have an issue with latent puritanism, and this needs to be addressed as we face the reality of more and more convincing fakes of images, audio, and video.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 21 points 2 years ago (2 children)

    I agree... however, we live in the world we live in, where employers do discriminate as much as they can before getting in trouble with the law

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 15 points 2 years ago (1 child)

    I think the only thing we can do is to help out by calling this out. AI fakes are just advanced gossip, and people need to realize that.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 3 points 2 years ago (1 child)

    But it doesn't. Nobody who is harassed or has their prospects undermined because of AI fakes is helped by repeating that. Especially because as the technology advances the only way to verify its legitimacy will be to compare it with real intimate pictures, which the person cannot show without being exposed to the exact same treatment.

    It also doesn't help that gossip can do all that harm as well so the point is moot.

    Trying to point out that this is illogical and that nudes shouldn't even be such a big deal is an uphill battle against human emotional, social and cultural tendencies. It would take much more than some offhand comments to affect it at all, and I wouldn't count on that shift happening before the harms of AI fakes spread.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 5 points 2 years ago (1 child)

    The ubiquity of AI fakes will necessitate a cultural shift. Honestly, the world is going to be a nightmare of misinformation soon and nudes may very well be the least of our worries.

    What other options do we have? An ironclad verification system for any fabricated content? Wildly harsh penalties for all caught creating it? The ship has sailed - we won't be able to prevent it from happening.

    I'd argue that overexposure will make people quickly become accustomed/nonplussed at information we don't believe to be true and verify with the source. Look at how we treat other fabricated content - if I showed you a screencap of the Pope saying "Fuck" you'd want to verify with a source directly.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 3 points 2 years ago (1 child)

    Does it seem to you that people are becoming more likely to verify sources?

    Nevermind, like I just said before, how exactly do you verify fake porn with the source? Who is going to be volunteering their intimate pictures as reference? Or, do you really think all that it takes to avoid all issues is for the victim to say "that's fake, it's not me"?

    Frankly, that sounds like pure wishful thinking to me.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 4 points 2 years ago

    In most cases, the answer should really be "It's none of my business", but yes, it'd involve asking the person whether they're authentic if you needed to verify for some reason.

    But yes it really is wishful thinking, because it's honestly about to be a shitshow. People are going to start getting credibly framed for things like child porn.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 8 points 2 years ago* (2 children)

    Well I think the whole point of this post is that the world is changing towards this being the norm. If an employer says they're not hiring me because of a nude photo, I'm just going to post 500 nudes of them and ask how they feel about it now 😂

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 20 points 2 years ago (2 children)

    This is a transitional period issue. In a couple of years you can just say AI made it even if it's a real picture and everyone will believe you. Fake nudes are in no way a new thing anyway. I used to make dozens of these by request back in my edgy 4chan times 15 years ago.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 19 points 2 years ago* (last edited 2 years ago) (2 children)

    Dead internet.

    It also means in a few years, any terrible thing someone does will just be excused as a "deep fake" if you have the resources and any terrible thing someone wants to pin on you with be cooked up in seconds. People wont just blanket believe or disbelieve any possible deep fake. They'll cherry pick what to believe based on their preexisting world view and how confident the story telling comes across.

    As far as your old edits go, if they're anything like the ones I saw, they were terrible and not believable at all.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 9 points 2 years ago

    I'm still on the google prompt bandwagon of typing this query:

    stuff i am searching for before:2023.. or ideally, even before COVID19, if you want more valuable, less tainted results. It's only going to get worse from here, 2024 is the year of saturation with garbage data on the web (yes I know it was already bad before, but now AI is pumping this shit out at an industrial scale.)

  • permalink
  • fedilink
  • source
  • parent
  • [–] 3 points 2 years ago

    People do that now, even without the excuses of ai deepfakes. They simply ignore the stuff that doesn’t fit their worldview, only focusing on what does.

    Ai stuff may make that easier, but it certainly won’t be some new problem.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 19 points 2 years ago

    This is a transitional period issue. In a couple of years you can just say AI made it even if it’s a real picture and everyone will believe you.

    Sure, but the question of whether they harm the victim is still real... if your prospective employer finds tons of pics of you with nazi flags, guns and drugs... they may just "play it safe" and pass on you... no matter how much you claim (or even the employer might think) they are fakes

  • permalink
  • fedilink
  • source
  • parent
  • [–] 3 points 2 years ago (3 children)

    On the other end, I welcome the widespread creation of these of EVERYONE, so that it becomes impossible for them to be believable. No one should be refused from a job/promotion because of the existence of a real one IMO and this will give plausible deniability.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 6 child comments
    •
  • [–] 25 points 2 years ago (2 children)

    People are refused for jobs/promotions on the most arbitrary basis, often against existing laws but they are impossible to enforce.

    Even if it is normalized, there is always the escalation factor.. sure, nobody won't hire Anita because of her nudes out there, everyone has them and they are probably fake right?... but Perdita? hmmm I don't want my law firm associated in any way with her pics of tentacle porn, that's just too much!

    Making sure we are all in the gutter is not really a good way to deal with this issue... specially since it will, once again, impact women 100x more than it will affect men

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 1 point 2 years ago (1 child)

    How should we deal with this issue then? I'm not sure what can be done about it.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 4 points 2 years ago

    That's a good question... I'm not an expert in this area but I do think it should be criminalized to a certain extent (even if it's hard to enforce)

    Probably legislation should out some onus on the makers of these tools as well

  • permalink
  • fedilink
  • source
  • parent
  • [–] 0 points 2 years ago (1 child)

    Yeah, let's just sexually violate everyone. /s

    Who the hell is upvoting this awful take? Please understand that it would never be equitable. If this became reality, it would be women and girls that were exploited the most viciously.

    I guess if you don't give a shit about people, especially women and girls, feeling safe in public at all, you would say something like this...

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 0 points 2 years ago (1 child)

    It's already possible. Do you want to make it punishable by jail time? How do you prove some anon on 4chan that posts nudes of someone else actually deepfaked it?

    I don't see how this can otherwise be contained.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 0 points 2 years ago (2 children)

    Do you want to make it punishable by jail time?

    Yes, sex crimes deserve harsh punishments.

    How do you prove some anon on 4chan that posts nudes of someone else actually deepfaked it?

    It's either deepfaked, or revenge porn. Whichever charge sticks. If 4chan refuses to unmask anons posting illegal content, throw the book at 4chan. Way overdue anyway.

    I don't see how this can otherwise be contained.

    See previous two answers.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •