Telegram has issued an apology to South Korean authorities over its handling of deepfake pornographic material that was distributed through its messaging app. The apology follows an investigation launched by South Korean police, who accused Telegram of “abetting” the distribution of these explicit images.
In recent weeks, several Telegram chatrooms, many of which were operated by teenagers, were found to have been creating sexually explicit deepfakes using doctored photographs of young women. The disturbing trend has drawn significant public outcry in South Korea, a country that has seen a surge in digital sex crimes.
Deepfakes are AI-generated images that combine a real person’s face with a fake body, often resulting in explicit and non-consensual content. In this case, many of the victims were students and teachers known to the perpetrators, with the chat groups linked to various schools and universities across the country.
Telegram, in a statement to South Korea’s Communications Standards Commission (KCSC), described the situation as “unfortunate” and apologized “if there had been an element of misunderstanding.” The company confirmed it had removed 25 such videos from its platform at the KCSC’s request and proposed a dedicated email address for future communication with the regulator. The KCSC has described Telegram’s approach as “very forward-looking” and acknowledged that the company has recognized the seriousness of the situation.
Despite these steps, the deepfake crisis in South Korea has already resulted in severe consequences. Police have reported 118 cases of such videos in just five days, with seven suspects—six of whom are teenagers—having been questioned. Under South Korean law, individuals found guilty of creating sexually explicit deepfakes can face up to five years in prison and fines of up to 50 million won (approximately $37,500).
This issue is not isolated, as South Korea has grappled with several high-profile digital sex crime cases in recent years. In 2019, the country was rocked by the discovery of a sex ring that used Telegram to blackmail dozens of women and children into creating pornographic content. The ring leader, Cho Ju-bin, was sentenced to 42 years in prison. Women’s rights activists have criticized South Korean authorities for failing to adequately prevent such crimes, arguing that platforms like Telegram have become havens for sexual abuse due to lax oversight.
The scandal has also led to the involvement of South Korean President Yoon Suk Yeol, who recently instructed authorities to “thoroughly investigate and address these digital sex crimes to eradicate them.” His directive underscores the growing public demand for stronger actions against perpetrators of digital sex crimes, particularly those involving minors.
Further complicating matters, Pavel Durov, the Russian-born founder of Telegram, was arrested in France on unrelated charges involving allegations of child pornography, drug trafficking, and fraud on the messaging app. Durov has since been charged, adding another layer of scrutiny to Telegram’s operations and its role in managing illegal content on its platform.
The deepfake crisis in South Korea highlights the broader challenges of regulating digital platforms and protecting individuals from online exploitation. While Telegram’s recent steps to remove explicit content and establish direct communication channels with South Korean regulators are positive, they come amid a backdrop of intense public scrutiny and calls for greater accountability.
As digital platforms continue to evolve, the need for robust mechanisms to prevent abuse and protect users has never been more critical. The situation in South Korea serves as a stark reminder of the potential harms posed by advanced technologies like AI-generated deepfakes and the importance of proactive measures to safeguard vulnerable individuals in the digital age.