Home>Tech
The harrowing crisis of deepfakes continues, once again targeting women.
ByMeera Navlakha on
Credit: Jamie McCarthy/Getty Images
The crisis of deepfakes continues. Meta platforms, including Instagram, Facebook, and Messenger, reportedly hosted AI-generated ads depicting Wednesday actor Jenna Ortega as undressed.
As reported by NBC News, the ads used a blurred picture of Ortega taken when she was 16 years old, and instructed users on how they could change the celebrity's outfit, including an option for removing all clothes. The images were reportedly manipulated by an app called Perky AI, listed as developed by company RichAds, which is described in Apple's App Store as a platform that uses AI to "create super-realistic or fantasy-like persons" with prompts. This includes "NSFW" (not safe for work) images, which are typically sexually explicit.
SEE ALSO:
What parents need to tell their kids about explicit deepfakesFollowing NBC's report, the publisher says the Perky AI app's page was suspended by Meta, having already run 260 unique ads on the company's platforms since September — those featuring Ortega's image reportedly ran throughout the month of February. Of the ads that had run on Meta's platforms, the news outlet says 30 were already suspended for not meeting the company's advertising standards, but the ads featuring Ortega were not among these.
In a statement to Mashable, Meta spokesperson Ryan Daniels said, "Meta strictly prohibits child nudity, content that sexualizes children, and services offering AI-generated non-consensual nude images. While this app remains widely available on various app stores, we’ve removed these ads and the accounts behind them."
Perky AI also appears to have been removed on Apple's App Store and Google Play (Mashable checked and it's not available on either). Apple told NBC the app had been taken down on Feb. 16, having already been under investigation by the company for violating its policies around "overtly sexual or p*rnographic material".
Mashable has reached out to Apple and Google for further comment.
Mashable Light Speed
Want more out-of-this world tech, space and science stories?
Sign up for Mashable's weekly Light Speed newsletter.
By signing up you agree to our Terms of Use and Privacy Policy.
Thanks for signing up!
SEE ALSO:
Deepfakes of Taylor Swift have gone viral. How does this keep happening?This incident is the latest in a slew of nonconsensual, sexually explicit deepfakes being circulated on the internet. In the first two months of 2024, pictures of celebrities like Taylor Swift and podcast host Bobbi Althoff have spread across major social media platforms, including X, formerly known as Twitter. Deepfakes have also infiltrated schools, with fake nudes of students recently making their way around a Beverly Hills middle school and a high school in suburban Seattle.
The issue is at a critical point, with experts warning that legal and societal change is urgently needed. Subsum, an identity verification platform, found that detection of deepfakes increased 10 times between 2022 and 2023. Many social media platforms have struggled to contain this type of content: in the past few months alone, Google, X, and Meta have been called out for allowing deepfake material to circulate on their platforms.
If users see an ad on any platform that they believe needs to be reported, company guides feature directions on how to do so. Meta allows users to report ads on Facebook or Instagram, while Apple features several community threads that help users report ads that are in-app, for example. Google also helps users report inappropriate ads via a form.
Related Stories
- Hugging Face empowers users with deepfake detection tools
- What to do if someone makes a deepfake of you
- Deepfakes of Taylor Swift have gone viral. How does this keep happening?
But some of these steps aren't enough to stop the proliferation of AI-generated content. Big tech needs to take significant action to tackle what seems to be becoming an epidemic, most often targeting girls, women, and marginalized people.
If you have experienced sexual abuse, if you are based in the U.S., call the free, confidential National Sexual Assault hotline at 1-800-656-HOPE (4673), or access the 24-7 help online by visiting online.rainn.org. If you have had intimate images shared without your consent, call the Cyber Civil Rights Initiative’s 24/7 hotline at 844-878-2274 for free, confidential support. The CCRI website also includes helpful information as well as a list of international resources.
If you are based in the UK and have experienced intimate image abuse (aka revenge p*rn), you can contact the Revenge p*rn Helpline on 0345 6000 459. If you have experienced sexual violence and are based in the UK, call the Rape Crisis helpline 0808 802 9999.
TopicsArtificial IntelligenceCelebritiesMeta
Recommended For You
Meta is using your posts to train AI. It's not easy to opt out.
Your Facebook and Instagram posts are a buffet of data for hungry AI models.
By Cecily Mauran
Thousands of explicit AI 'girlfriend' ads found on Meta platforms
These ads appear to violate Meta's adult content advertising policy.
By Anna Iovine
How to stop students from making deepfakes of each other
Educators don't know how to handle fake nude or explicit imagery made by students.
By Rebecca Ruiz
Instagram teens now have the option to interact with only their 'close friends'
Instagram builds out its anti-harassment 'Limits' feature.
By Chase DiBenedetto
I tested Rabbit R1 vs. Meta AI: The winning AI assistant will surprise you
How does the Rabbit R1 compare to the Ray-Ban Meta Smart Glasses?
By Kimberly Gedeon
Trending on Mashable
NYT Connections today: See hints and answers for June 3
Everything you need to solve 'Connections' #358.
By Mashable Team
In case you missed it: Bank info-stealing malware found in 90+ Android apps with 5.5M installs
The apps identified have since been removed from Google Play, but make sure you didn't install one.
By Cecily Mauran
Meta is using your posts to train AI. It's not easy to opt out.
Your Facebook and Instagram posts are a buffet of data for hungry AI models.
By Cecily Mauran
NYT Connections today: See hints and answers for June 2
Everything you need to solve 'Connections' #357.
By Mashable Team
The biggest stories of the day delivered to your inbox.
This newsletter may contain advertising, deals, or affiliate links. Subscribing to a newsletter indicates your consent to our Terms of Use and Privacy Policy. You may unsubscribe from the newsletters at any time.
Thanks for signing up. See you at your inbox!
- TECH
- SCIENCE
- LIFE
- SOCIAL GOOD
- ENTERTAINMENT
- BEST PRODUCTS
- DEALS
- About Mashable
- Contact Us
- We're Hiring
- Newsletters
- Sitemap
Mashable supports Group Black and its mission to increase greater diversity in media voices and media ownership. Group Black's collective includes Essence, TheShadeRoom and Afro-Punk.
©2005–2024 Mashable, Inc., a Ziff Davis company. All Rights Reserved.
Mashable is a registered trademark of Ziff Davis and may not be used by third parties without express written permission.
- About Ziff Davis
- Privacy Policy
- Terms of Use
- Advertise
- Accessibility
- Do Not Sell My Personal Information