A mother and her 14-year-old daughter are advocating for better protections for victims after AI-generated nude images of the teen and other female classmates were circulated at a high school in New Jersey.

Meanwhile, on the other side of the country, officials are investigating an incident involving a teenage boy who allegedly used artificial intelligence to create and distribute similar images of other students – also teen girls - that attend a high school in suburban Seattle, Washington.

The disturbing cases have put a spotlight yet again on explicit AI-generated material that overwhelmingly harms women and children and is booming online at an unprecedented rate. According to an analysis by independent researcher Genevieve Oh that was shared with The Associated Press, more than 143,000 new deepfake videos were posted online this year, which surpasses every other year combined.

    • afraid_of_zombies@lemmy.world
      link
      fedilink
      arrow-up
      1
      ·
      10 months ago

      You might be able to understand it if you imagined it happening to someone in your family, like an aunt or sister or your mother.

    • Saganaki@lemmy.one
      link
      fedilink
      arrow-up
      1
      ·
      edit-2
      10 months ago

      I’m not sure if you’re trolling or not here or just lacking empathy.

      Imagine a believable image, let alone video, of you with your full name and age on it participating in a burning cross ceremony in a white hood propagating through the internet.

      This isn’t just some situation where it stays on a single person’s computer—it gets shared. And is effectively unstoppable.

      I’m not claiming of knowing a way to handle this situation, but your comment is really confusing to me that you don’t understand the harms here.

        • Saganaki@lemmy.one
          link
          fedilink
          arrow-up
          1
          ·
          10 months ago

          So that means it will make all images and videos not believable. That’s serious dystopian shit.

          Trust no one. Everything is fake. Nothing is real.

          • DarkGamer@kbin.social
            link
            fedilink
            arrow-up
            1
            arrow-down
            2
            ·
            10 months ago

            Unfortunately that’s the road we’re headed down, and if there’s an off-ramp I don’t see it. Photo and video evidence alone will not be sufficient to prove claims in the near future.

    • Dimantina@lemmy.world
      link
      fedilink
      arrow-up
      0
      arrow-down
      1
      ·
      10 months ago

      It’s harmful, especially at that age. Psychologicaly it triggers a sense of violation of person. It’s a sense of privacy being shattered.

      Also not all people experience sexual awakening/understand they are sexual beings, by 14 or even 18. It is confusing/harmful to have that forced upon you.

      Talk to a close female friend or your mother regarding how they feel about the AI deepfakr, and how they’d react in highschool if this happened to them. Really listen to the answer and you’ll gain a better understanding of the harm done.

    • cannache@slrpnk.net
      link
      fedilink
      arrow-up
      0
      arrow-down
      1
      ·
      10 months ago

      Tbh you’ve got a point despite the downvotes, but there’s a lot of ladies out there that would be very upset with your viewpoint because they still hold onto the Madonna Whore complex