Meta’s Oversight Board Orders Facebook to Remove Two AI Deepfakes
The binding removals concern a Scottish councillor and a Muslim campaign volunteer. The Board also wants labels to limit how deceptive AI posts spread.
Listen to this story
The audio brief
Story brief
3 key pointsMeta’s Oversight Board is forcing Facebook to take down two AI-manipulated videos after finding failures in both enforcement and labeling. One falsely depicted a Scottish Labour councillor making hateful claims about refugees; the other mocked a Muslim menstrual-health campaign volunteer. The removals are binding, but the Board’s nine broader recommendations—including feed demotion for high-risk AI content, warning...
- 01
The Board called Meta’s deepfake safeguards “consistently and fundamentally inadequate.”
- 02
One video should have been removed and labeled under Meta’s existing rules, but Facebook cleared it.
- 03
The second case targets deepfakes portraying private people as saying or doing things they never did.
Meta’s Oversight Board has ordered Facebook to remove two AI-generated deepfake videos, concluding that both violated company rules. In the same rulings, the Board said Meta’s safeguards for addressing AI deepfakes were “consistently and fundamentally inadequate.”
One case involved a Scottish Labour councillor falsely portrayed as making inflammatory comments about refugees. The Board found that the video breached Meta’s hateful-conduct rules because it alleged criminal and predatory sexual behavior by refugees as a group. It also said the post should have received a high-risk AI label.
Facebook had concluded that the councillor video did not violate its policies and did not merit an AI label, even after the Board raised the case directly with the company. The Board said the clip appeared to be AI-generated because its audio was not fully synchronized with the councillor’s facial movements.
A second target, and a wider reach problem
The other removal concerns a video mocking a Muslim campaign volunteer who worked on menstrual-health education in Europe. It fabricated scenes of her doing absurd exercises and eating junk food, and the Board found it violated Meta’s bullying-and-harassment policy. AI-manipulated material targeting her drew tens of millions of views online, including on Meta platforms, though that total covers more than the individual video at issue.
The proposed shift: labels that affect reach
The Board recommended nine policy changes. Its main proposal would make a high-risk AI label alter distribution: Facebook would demote labeled posts in feeds, making them less likely to appear to users. It also recommended greater transparency about when Meta applies AI labels.
Other recommendations include
- Broader circumstances for applying high-risk AI labels.
- Warning screens that require a click before viewing AI-generated content.
- Stronger penalties for accounts that repeatedly share deceptive AI content.
- A wider definition of unwanted manipulated imagery for private people falsely depicted saying or doing something.
The two cases expose different gaps in Meta’s approach. The councillor video should have been removed and labeled under existing policy, the Board said. For the volunteer’s case, it wants Meta to explicitly cover deepfakes that make private people appear to say or do things they never did.
Editorial analysis
Our Read
The important divide in these rulings is between what Meta must do now and what it may choose to do next. The two removals are binding; the wider package is not. The Board’s recommendations would make a label consequential by connecting it to distribution, warnings and repeat-sharing penalties. That approach leaves some material online while reducing its reach, rather than treating moderation as a choice only between removal and no action. The next meaningful signal will be whether Meta adopts those recommendations, especially feed demotion and clearer rules for impersonated private people.
Sources
- theguardian.comMeta ordered to remove UK deepfakes as oversight board criticises ‘inadequate’ safeguards
Loading discussion...
Reader comments
Newest comments first. Replies stay oldest first.