Dozens of fake social media accounts, created and controlled by individuals overseas, have been spreading anti-immigration propaganda in the US and UK, amassing millions of views on platforms like Facebook and Instagram. These accounts, often disguised as American or British, use AI-generated content to create and share misleading posts about mass immigration, sparking concerns about the manipulation of public opinion.
The creators of these accounts, located in countries such as Sri Lanka, Vietnam, and the Maldives, have been identified through Facebook’s transparency tools and interviews. They have been found to be sharing AI-generated videos and posts that portray a distorted view of the US and UK, often associating decline with Muslim immigration.
Anti-Immigration Propaganda
Experts warn that people are more susceptible to AI-generated fakes than they think, and the more they are exposed to such content, the more likely they are to distrust authentic material. London Mayor Sir Sadiq Khan has commissioned research into AI-generated images showing the capital in decline, which he says harm the city’s reputation abroad.
Some of the accounts have been found to be repurposed, switching from topics such as “Make America Great Again” to using AI to push anti-immigration narratives. Others have experimented with content more sympathetic to migrants, highlighting the complexity of the issue. The ease with which AI fakers can pose as American or British nationals online has raised concerns about the manipulation of public opinion.
States and other groups are attempting to manipulate public opinion with fake AI accounts, according to Prof Sander van der Linden, a social psychologist at the University of Cambridge. The accounts have been racking up hundreds of thousands of views with AI-generated videos of fake scenes, creating a contradictory image of the US and UK.
Implications and Reactions
The discovery of these fake accounts has sparked concerns about the impact of AI-generated propaganda on public opinion and the potential for hostile states to manipulate online discourse. The creators of these accounts claim to be motivated by a desire to “inform people and voters” about the potential consequences of current social and cultural trends.
However, experts warn that such content can be socially divisive and contribute to the erosion of trust in authentic material. As the use of AI-generated content continues to evolve, it is essential to develop strategies to detect and mitigate the spread of misinformation online.
The broader significance of this discovery lies in its highlighting of the vulnerability of online discourse to manipulation by foreign actors, emphasizing the need for increased vigilance and critical thinking in the digital age.