Addressing the Financial Incentives Behind Online Misinformation

In a groundbreaking collaboration, Shout Out UK (SOUK), the All-Party Parliamentary Group (APPG) on Political and Media Literacy, and the Bureau of Investigative Journalism (TBIJ) are pressing for urgent amendments to the Representation of the People Bill to combat the rising threat of AI-generated political misinformation.

The coalition has issued a policy briefing as parliamentarians begin their line-by-line scrutiny of the bill, highlighting dangerous gaps in the current legislative framework that leave Britain’s democratic process vulnerable to synthetic media manipulation.

At the heart of their concerns is the monetization of harmful AI-generated political content across major social media platforms. While YouTube has taken steps to demonetize some AI-generated content, other platforms including TikTok and X continue to allow creators to profit from potentially misleading material.

The joint investigation by the organizations uncovered a troubling case study that exemplifies these concerns. “Danny Bones,” purportedly a working-class British rapper with presence across Instagram, X, YouTube, and Spotify, was revealed to be an entirely AI-generated character created by an entity called the “Node Project.”

More alarmingly, investigators discovered that Advance UK, a far-right political party, had paid the Node Project to produce campaign and election videos featuring the synthetic rapper. Multiple researchers believe this marks the first documented instance of a registered political party hiring an AI-generated influencer for election content in the UK.

Following public exposure of the scheme by TBIJ, the Node Project capitalized on the attention by driving donations and paid memberships ranging from £20 to £100. Cryptocurrency speculators even created Danny Bones-themed tokens on the Solana blockchain, while the Project began developing its own cryptocurrency called NODE coin.

“As the financial incentives grew, the content became increasingly extreme,” explained a researcher familiar with the investigation. “The latest materials feature explicitly anti-immigrant lyrics and AI-generated imagery of masked men storming Parliament.”

The policy briefing outlines what the coalition calls a “Gold Standard” for platform accountability. Their recommendations include mandatory demonetization across all platforms—explicitly including Spotify—to ensure that disinformation, AI-generated political manipulation, and hate speech become ineligible for monetization.

They also propose granting the Electoral Commission or Ofcom the power to suspend monetization privileges for repeat offenders, alongside requirements for unambiguous digital imprints for all AI-generated political content to ensure voter awareness.

Additionally, the briefing calls for quarterly transparency reporting from platforms to Ofcom detailing monetized political content, including engagement metrics and enforcement actions taken.

Perhaps most ambitious is the proposal for a “Levy for Literacy”—a 1% levy on UK profits from online platforms, similar to the existing gambling industry levy. These funds would support teacher training and media literacy initiatives designed to counteract the harms created by algorithmic amplification, aligning with recommendations made by the House of Lords Communications and Digital Committee in 2025.

Matt Bishop, MP and Co-Chair of the APPG on Political and Media Literacy, emphasized the urgency of addressing these issues: “The ‘Danny Bones’ investigation exposes a dangerous loophole in our current laws where synthetic characters can be used to bypass democratic norms for profit. We cannot allow platforms to treat the subversion of our elections as a revenue stream.”

Matteo Bergamini, MBE, Founder and CEO of Shout Out UK, added: “If content is designed to subvert democracy or spread hate through AI manipulation, it should not be eligible for ad revenue or platform profit.”

The coalition’s intervention comes as governments worldwide grapple with regulating AI in political discourse. The UK’s approach could set an important precedent for other democratic nations facing similar challenges in the age of synthetic media.