Hardware FixRecommendedDevice not working? Your driver may be the problemCheck updates for common hardware issues.Fix DriversHalloween DealsAmazon USHalloween week deals: useful picks before month-endAmazon US: current deals, useful picks and tech finds.Check DealsSlow PC?RecommendedPC slow today? Run a repair scan before it gets worseResolve common Windows issues and optimize system performance.Scan Now×
FREEDOM251

Freedom251 › Blog › AI Safety

Meta Bans Sexualized AI Images of Children—So Why Did They Appear on Instagram?

By Freedom251 Team · · 4 min read

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Because a ban is not the same as reliable prevention. Investigations documented sexualized AI-generated depictions of minors on Instagram, and one researcher reported that many sampled videos remained available after he flagged them. The evidence shows specific enforcement failures and possible recommendation risks—not how common the material is across Instagram, or that the platform always recommends it.

What investigators found on Instagram

Nucleo found 14 profiles posting sexualized AI images of minors

In an investigation published through the Pulitzer Center’s AI Accountability Network, Nucleo identified 14 Instagram profiles posting AI-generated images of minors in sexualized poses. Nucleo contacted Meta in March 2025. After that contact, 12 of the 14 profiles were removed; Meta later confirmed that the removals followed information supplied by Nucleo.

As an Amazon Associate I earn from qualifying purchases.

Nucleo could not establish whether the images were based on real children or whether the profiles shared owners. The investigation documents specific profiles and a response to a report, not the total amount of this content on Instagram or a comprehensive audit of the service.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

A separate researcher counted 144 videos in a manually assembled sample

In a report published in February 2026, independent researcher Jeremy Carrasco said that, as of February 10, his sample covered 20 Instagram accounts and 144 qualifying videos with a combined 130,625,138 views. He classified 19 of those videos as “egregiously sexual”; they had accumulated 10,353,200 views. These are counts from Carrasco’s selected sample, not platform-wide prevalence estimates.

Carrasco also said he reported 23 videos: one was removed and six were restricted to viewers over 18. The remaining videos were still up when he checked. This small, self-reported set of reports does not establish a general removal rate, and an age restriction is not the same action as removal.

What the recommendation test does—and does not—show

Carrasco described browsing with three accounts. In that limited test, recommendations moved from qualifying sexualized AI videos to nonsexual posts featuring real underage girls. He said he did not interact with the girls’ videos. The observation raises a legitimate question about how recommendation systems connect this material to other content, but three accounts cannot show that Instagram always makes these recommendations, that the system does so intentionally, or how often this happens.

Meta’s rules and enforcement figures are different kinds of evidence

Meta says sexualizing children is prohibited

In a statement to Nucleo, Meta said: “At Meta, we have strict rules against the sexualization of children — both real and AI-generated — and we have removed the accounts shared with us so far for violating these guidelines.” Meta also said it removes accounts devoted to posting otherwise innocuous images of children when appearance-focused captions or comments accompany them. These are the company’s stated rules and explanation, not an independent assessment of how consistently they are enforced.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Meta reports proactive detection, but the totals do not measure these cases

Meta says it uses image-matching tools to scan uploads for potential child sexual abuse material, alongside AI and machine learning to address child nudity, unwanted adult–teen interactions and possible grooming. In a company report published in July 2026, Meta said it removed 13 million pieces of child sexual exploitation content from Facebook and Instagram between October and December 2025, and that it found and proactively addressed more than 96% before users reported them. Meta also said it automatically removed more than 4 million suspicious accounts and removed 36 million pieces of child exploitation content in 2025.

Those company-reported totals cover broad categories across Meta’s services. They do not reveal how many sexualized AI depictions appeared on Instagram, how quickly those particular items were detected, or whether enforcement worked in the Nucleo and Carrasco cases.

Teen protections for Meta AI do not settle questions about Instagram posts

Meta says teen conversations with Meta AI are subject to a 13+ content setting and that the assistant is trained not to engage teens in sexual or romantic conversations. Those stated safeguards concern teens interacting with Meta AI. They do not explain how Instagram handles public posts or comments by adults, or how it recommends content in the cases described above.

Keep four related harms distinct

Different kinds of sexualized content involve different evidence and potentially different people affected. Treating them as one category obscures what a report actually established.

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
  • AI-generated depictions of minors: Nucleo and Carrasco documented examples on Instagram. Nucleo could not determine whether the images drew on real children’s photos or likenesses.
  • Sexualized content using real children’s images: A separate September 2026 WIRED report on Tech Transparency Project research said more than 350 abusive video ads had run across Meta platforms since the end of 2025, including ads using real children’s images. Paid ads are not the same as public user posts or recommendation feeds.
  • Sexualized comments on real children’s accounts: The Associated Press reported that Meta said it removed 135,000 accounts that left sexualized comments on adult-run accounts of children under 13, along with 500,000 linked accounts that interacted inappropriately, in July 2025. These are Meta’s figures about real children’s accounts, not a finding about AI-generated depictions.
  • AI-generated sexualized impersonation of an adult: In a separate case, the Oversight Board overturned Meta’s decision to leave up a reportedly AI-generated sexualized video impersonating an adult woman. The Board said such impersonation should signal non-consent and identified shortcomings in detection, review and reporting for non-public figures. That decision concerns an adult, not child content.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

What the evidence says about the gap

The documented sequence is straightforward: Meta says child sexualization is prohibited and describes proactive detection systems; Nucleo nevertheless found specific profiles, and 12 were removed after it alerted the company. Carrasco’s later sample included videos with substantial view counts, and his limited reporting exercise produced mixed outcomes. The sources establish that prohibited material can appear and persist long enough to be seen, but they do not establish why each item escaped detection, how prevalent it is across Instagram, or whether the recommendation test reflects a typical user experience.

That distinction matters when judging enforcement. A policy statement tells users what Meta says is forbidden. A removal after an outside report shows that a report led to action in that case. Aggregate company totals describe the scale of reported enforcement across broad categories. None, on its own, demonstrates that detection is complete or that the particular harms identified by independent investigators have been prevented.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.

AI Safetychild safetycontent moderationInstagramMeta

Leave a Reply

Your email address will not be published. Required fields are marked *

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Recommended PC Tool
Recommended PC Tool
PC Slower Than It Used to Be?Free scan - under a minute
Outdated Drivers Are Slowing You DownFree scan - exact matches

Two free Windows tools

One Free Minute Could Fix That PC

Before you go - each of these free tools takes about a minute and tackles what quietly slows a Windows PC down.

Special offer. View Outbyte info, uninstall instructions, EULA, and Privacy Policy.