Telegram, a popular messaging app known for its secretive features, has come under scrutiny for inadvertently pushing extremist content to users. A new study conducted by the US civil rights organization, the Southern Poverty Law Center (SPLC), reveals alarming findings about the app’s algorithmic recommendations. This study highlights the platform’s role in inadvertently leading users down paths of radicalization, raising serious concerns about its moderation practices and the safety of its nearly one billion users.
The Algorithmic Recommendations of Telegram
The SPLC’s report, titled Telegram’s Toxic Recommendations, details how Telegram’s “similar channels” feature, introduced last year, has been recommending extremist channels even to users browsing topics as mundane as celebrities or technology. This feature seems to operate without much regard for the content’s nature, potentially exposing users to radical ideas. The report shows that a user searching for seemingly innocuous topics, such as “Donald Trump” or “UK riots,” can quickly be led to extremist content, including Q-Anon conspiracies and far-right ideologies.
For instance, Megan Squires, a lead researcher, demonstrated how easy it was to find extremist content on Telegram by simply searching for “Donald Trump.” In a newly created account, Squires was immediately recommended channels promoting the Q-Anon conspiracy theory, which posits with no evidence that Mr. Trump is leading a secret war against a cabal of Satan-worshipping elites. Another search for “UK riots” returned a meme about Adolf Hitler followed by links to far-right extremist channels. These findings suggest that Telegram’s algorithms do not just expose users to information of interest but actively funnel them into extremist communities.
The Risks of Unmoderated Content
Telegram’s claim that it does not inject or promote content but only shows users what they choose to engage with is problematic. The platform asserts that users are only presented with content they have subscribed to. However, the study from SPLC and expert testimonies tell a different story. Telegram’s “channel suggestions” feature appears to be pushing users toward content they may not actively seek out, and this has serious implications for user safety.
Prof David Maimon from Georgia State University, who has studied illegal content on Telegram for six years, explained that the platform hosts tens of thousands of channels promoting everything from scam tools to illegal arms sales. His own experiment highlighted the ease with which sellers would respond to a user’s request for weapons, offering immediate assistance in procuring illegal items. This ease of access to extremist and criminal content on Telegram makes it one of the most concerning platforms for online radicalization and criminal activity.
Telegram’s response to these findings has been to claim that its moderation teams and AI tools remove millions of pieces of harmful content daily. However, the effectiveness of these measures is questioned by both experts and former insiders. Elies Campo, a former insider who spent seven years in Telegram’s inner circle, revealed that Pavel Durov, Telegram’s founder, was reluctant to dedicate more resources to content moderation. Campo noted that Durov’s stance was that it was not the platform’s responsibility to moderate content, a position that seems increasingly untenable given the findings of the SPLC report.
The French authorities have also raised concerns, accusing Durov of complicity in criminal activities facilitated by Telegram, including drug dealing and sharing child abuse images. Durov, who is currently on bail and banned from leaving France, faces allegations of failing to prevent criminal activity on his platform. This formal investigation underscores the serious nature of the issues Telegram is facing regarding its content moderation practices.
A Growing Digital Threat
The SPLC’s research paints a picture of Telegram as a digital haven for extremists and criminals, where the ease of access to dangerous ideas and illegal activities is facilitated by the platform’s poor moderation practices. The platform’s “channel suggestions” feature and its handling of user content have led to concerns about Telegram’s role in digital radicalization.
Telegram’s response that it only shows users content they have chosen to engage with fails to address the problem of users being recommended extreme content without their explicit consent. As more users are unwittingly drawn into extremist circles, Telegram’s moderation claims become less convincing. The platform must address these concerns by implementing stronger content moderation tools and transparency measures to prevent further harm.
Telegram’s role in promoting extremist content highlights the urgent need for better regulation and oversight of social media platforms. While Telegram has made strides in content moderation, the platform’s approach remains insufficient to prevent the spread of harmful and dangerous ideologies. As the app continues to grow in popularity, the onus is on Telegram to take meaningful action to protect its users and prevent its misuse as a tool for radicalization and criminality.
