Games

Instagram cracks down on fake accounts: what’s changing (and what isn’t)

The ‘AI Creator’ label is being replaced by ‘AI-generated profile’: those who do not declare this risk being excluded from recommendation systems

3' min read

Translated by AI
Versione italiana

3' min read

Translated by AI
Versione italiana

Instagram has decided to change the rules of the game for profiles generated using artificial intelligence. For the past few days, the label that creators were previously encouraged to apply voluntarily – ‘AI Creator’ – has been replaced by a more explicit label, ‘AI-generated profile’, designed to make it immediately clear that a profile depicts a non-real person. Meta announced this in an official statement published on its creators’ blog, explaining that the aim is to address a discrepancy experienced by users: discovering, often too late, that a human-looking profile was in fact entirely synthetic.

Until now, this declaration has been left to the creator’s good faith; from tomorrow, anyone who fails to label their artificial profile correctly will face an ‘algorithmic penalty’ – in practice, a substantial reduction in visibility: profiles that are undeclared and identified by Meta’s detection systems will be excluded from the Explore section, from Reels and, more generally, from all the platform’s automatic recommendation mechanisms. Not a ban, but a penalty. Meta provides two ways to resolve this situation: to apply the label retrospectively, or to lodge an appeal via the Account Status section, should the system have made a classification error.

Loading...

There is also a distinction that the company is keen to make clear: the measure applies exclusively to profiles depicting a person generated by AI, not to human creators who simply use artificial intelligence tools as part of their creative process. The latter are not required to provide any additional labelling.

On paper, this represents a step towards greater transparency, in line with the direction taken over the past twelve months by YouTube, TikTok and Meta itself on Facebook and Instagram, where ‘AI info’ labels are already applied to content that includes metadata indicating synthetic origin or voluntary declarations by creators.

Observers remain sceptical as to whether this is a sufficient measure to counter the massive influx of AI-generated content on social media. This issue was also highlighted in an investigation by The Verge: labelling, however strict it may be, remains a structurally flawed tool. The platforms continue to refuse to offer users a genuine filter – a simple toggle that would allow them to exclude from their feeds anything that has been flagged as synthetic. When approached by The Verge, TikTok and Spotify did not respond; Google stated it had nothing to say; and Meta did not provide an attributable comment.

The suspicion – which is quite legitimate – is that the absence of a truly effective filter is an implicit choice. A filter that actually worked would risk leaving feeds empty. In a situation where users are posting less and less (an American study confirms this: Americans are gradually moving away from social media, with 55 per cent of respondents stating that they post less content now than they did five years ago), content generated by artificial intelligence is a source capable of ensuring a constant flow of new content. It is no coincidence that Instagram itself chooses to penalise those who create entire fake profiles, whilst excluding anyone who uses AI as a production tool. This is a crucial distinction, because it is this latter category – far broader and far less controllable – that guarantees the volume of content the system needs to stay alive.

After all, this issue is not new on the platforms’ internal agenda. Instagram’s head, Adam Mosseri, has publicly acknowledged that authenticity is becoming a scarce resource, whilst Google’s CEO, Sundar Pichai, admitted in a recent interview that there is a growing amount of low-quality synthetic content, urging users to ‘adapt’. An admission which, when viewed against the backdrop of Instagram’s crackdown on fake profiles, speaks volumes about the contradiction these companies find themselves in: on the one hand, they claim to want to protect authenticity; on the other, they profit from the very tools that erode it, such as the AI-generated rubbish produced by specialised content farms. In the background, there remains a very real risk that online cultural output will continue to become increasingly shallow, making social media even less interesting than it already is today.

Copyright reserved ©
Loading...

Brand connect

Loading...

Newsletter

Notizie e approfondimenti sugli avvenimenti politici, economici e finanziari.

Iscriviti