Instagram Tightens Rules on AI-Generated Profiles Posing as Real People

Instagram is tightening its approach to AI-generated profiles that present themselves as real people, introducing clearer labels to help users understand when they are interacting with an artificial persona.

The move comes as AI-generated influencers and virtual personalities become increasingly common across social media. With advances in generative AI, some of these profiles can appear remarkably realistic, making it difficult for users to determine whether they are following a genuine person or a computer-generated character.

Instagram is introducing changes specifically targeting profiles in which the person behind the account is entirely AI-generated.

The platform is changing the wording of its label from “AI creator” to “AI-generated profile”. The new description is intended to make it clearer that the account represents an artificial persona rather than a human creator.

Instagram says the change is part of its broader effort to provide users with more context about AI-generated content on the platform.

However, Instagram is not banning AI-generated content altogether. Creators can continue to use artificial intelligence to produce images, videos and other forms of content.

The distinction is significant because the latest move focuses on accounts that use AI to create an entire person or persona, rather than creators who simply use AI tools as part of their content production process.

According to reports, Instagram could also reduce the reach of AI-generated profiles that fail to properly disclose their nature. Posts from accounts that do not identify themselves appropriately could be less likely to appear in recommendations such as Reels and Explore.

For AI influencers, that could have a significant impact.

Instagram’s recommendation system is an important route for creators to reach users who do not already follow them. A reduction in recommendations could therefore make it more difficult for undisclosed AI profiles to build and grow their audiences.

The development reflects a wider concern across social media platforms about users being unable to distinguish between real people and artificial characters.

AI image and video generators have become increasingly sophisticated, allowing accounts to portray seemingly consistent personalities, appearances and lifestyles even when the person presented online does not actually exist.

Some AI-generated profiles have already attracted substantial audiences and interest from brands. This has created a new category within the digital influencer economy while raising questions about transparency and authenticity.

Instagram’s approach appears to favour disclosure rather than an outright ban on the technology.

Users will still encounter AI-generated images, videos and characters on the platform. However, Instagram wants to ensure they have enough information to understand what they are viewing and who, or what, is behind an account.

This could become increasingly important as generative AI becomes more accessible. Creating realistic faces, voices and personalities no longer requires advanced technical expertise, making it easier for people to build convincing artificial identities online.

For advertisers and brands, the change could also make influencer verification more important. Companies working with digital creators may need to establish whether an influencer represents a real person, a virtual character or a fully AI-generated profile before entering into commercial partnerships.

Instagram’s latest move highlights the challenge facing social media platforms as they attempt to establish rules for an internet where the distinction between human and artificial content is becoming increasingly difficult to identify.

Rather than preventing creators from using AI, Instagram is placing greater emphasis on transparency. For users, the objective is straightforward: knowing whether the person behind a profile is actually a person.