Millions Of People Use AI Bots To Create Deepfake Nudes On Telegram

 

In the digital age, where social media platforms play a central role in everyday life, concerns about user safety have intensified. These concerns span across users of all ages, with children being particularly vulnerable. Recent years have seen social media giants like Meta and TikTok facing significant scrutiny, particularly for how their platforms may intentionally foster addictive behaviors in younger users.

In a major development, Meta, the parent company of Facebook, Instagram, and Threads, was sued by 33 U.S. states, including New York, California, and Florida. The lawsuit alleges that Meta designed its platforms in ways that intentionally harm children by promoting addiction. Similarly, TikTok is also facing legal action from attorneys general of 14 states, claiming the platform's autoplay features, beauty filters, and viral challenges harm children's mental health.

Efforts by Meta and TikTok to address harmful content have often backfired, drawing even more criticism from users. For instance, some Meta users have complained that their Instagram or Threads accounts were suspended for trivial reasons like using sarcastic language, or even being wrongly identified as underage despite proving otherwise. Meanwhile, TikTok has reportedly replaced a significant number of its content moderation staff with AI technology, leading to concerns about the platform's ability to properly monitor harmful material.

More recently, Telegram Messenger has become the subject of concern due to harmful content, particularly around the use of deepfake technology. Experts have flagged a growing number of AI-powered bots on the platform, which are being used to create deepfake nude images and videos, including of children. According to WIRED, there are at least 50 such bots, collectively reaching millions of users. Despite Telegram's removal of the bots and associated channels when confronted, concerns remain high.

The dangers associated with these bots go beyond privacy violations, affecting the mental health and safety of young users, especially girls. Henry Ajder, a deepfake expert, highlighted the significant impact these tools have in ruining lives, particularly as they are easily accessible on one of the world’s largest apps. Despite the prompt removal of the bots, the question remains: Why were they allowed to operate in the first place?

These incidents, along with the arrest of Telegram co-founder Pavel Durov on charges related to child exploitation and drug trafficking, underscore a deeper problem with social media governance. While platforms promote free speech, the unrestricted spread of harmful content, such as deepfakes and exploitative material, demands stronger oversight.

With users spending an average of 2.5 hours daily on social media, it is evident that platforms must be held to higher standards to ensure user safety. Regulatory bodies should step in to impose stricter guidelines, ensuring that these platforms prioritize the well-being of all users, especially children. Allowing harmful content to proliferate unchecked not only endangers users but also erodes public trust in the digital platforms that have become so integral to modern life.

Read More