TikTok recommendation algorithm traps users in harmful loops, EU warns

FrontWord Desk
The FrontWord Desk covers AI and technology news for readers in the UK and Europe. Articles are researched from several independent outlets and primary sources, written...
7 Min Read
Image: Therecord
Summarize with AI

The European Commission warned TikTok on Friday that the TikTok recommendation algorithm breaches the European Union‘s Digital Services Act by steering users into harmful content loops. Preliminary findings from Brussels accuse the video platform of failing to evaluate mental health risks or install effective safeguards against repetitive exposure to videos on sadness, self-harm and body image.

Key points

  • European Union regulators issued preliminary findings against TikTok for using engagement-based recommendations that trap users in harmful content loops.
  • The case targets legal but repetitive videos covering topics such as strict dieting, sadness and self-harm rather than unlawful material.
  • Brussels found that TikTok’s existing safety tools, including feed refresh options and the not interested button, fail to break these algorithmic patterns.
  • If the findings are upheld, TikTok faces potential fines of up to 6% of its global annual revenue under the Digital Services Act.

How the For You feed creates rabbit holes

The European Commission announced its preliminary findings on Friday, marking the first time regulators anywhere in the world have formally challenged the core engagement mechanics of a major social media platform. Officials in Brussels said the platform’s recommendation engine relies on implicit signals, such as how many seconds a user lingers on a clip, to feed them an unbroken chain of similar posts.

In preliminary findings published by the European Commission, officials stated that “the more a user interacts with a certain type of content, the more TikTok’s ‘For You’ feed algorithm recommends similar content.” Regulators argued that this automated feedback loop becomes damaging when it centres on themes of sadness, isolation, self-harm and distorted body image.

Investigators emphasised that the inquiry does not seek the removal of individual posts or censorship of creators. Instead, the Commission examined videos that violate neither local laws nor TikTok’s own community guidelines. Officials described this material as the least harmful category when viewed in isolation, pointing to popular trends including “what I eat in a day” and “SkinnyTok”.

The danger, regulators said, comes from volume and frequency. An individual video about strict calorie counting or low mood may be harmless on its own, but watching hundreds or thousands of them in sequence creates a psychological trap for young and vulnerable audiences. A Commission official told journalists that the enforcement action was directly “addressing a business model” built primarily on maximising user watch time.

Why TikTok’s internal safeguards failed

Brussels said TikTok’s own risk assessments had previously flagged some of these hazards, but the company failed to carry out adequate analysis or deploy working defences. Investigators tested the tools TikTok provides to help users reset their viewing experience and concluded that none of them provided lasting protection.

The Commission found that TikTok’s internal dispersion systems, designed to inject variety into the video feed, failed to dilute continuous streams of sensitive material. Tapping the not interested button ceased working after extended use, while manually refreshing the feed offered only brief relief before the algorithm reverted to recommending identical themes.

European officials want TikTok to abandon implicit engagement signals as the primary driver of recommendations. Under the Commission’s proposed remedies, the platform would instead rely on explicit user preferences, asking viewers what topics they actually want to see rather than tracking passive watch time.

Scrutiny of TikTok’s recommendation loop has also intensified in the United States. In August, US senators demanded answers from the company over the suicide of 16-year-old Chase Nasca in February 2022 after he watched consecutive videos on sadness and suicide. An internal company review reported by Bloomberg revealed that Nasca had been placed in a control group comprising 10% of TikTok’s user base, where engineers withheld design modifications intended to curb repeated exposure to sensitive subjects.

The regulatory investigation and evidence

Friday’s preliminary findings escalate an inquiry by European regulators that has lasted almost three years. European officials spent two and a half years assembling technical testing tools to inspect social media algorithms without alerting platforms to the specific testing parameters.

Investigators gathered internal corporate records and data directly from TikTok. Working alongside psychiatrists, psychologists and systems design specialists, the Commission analysed roughly 20,000 individual videos to track how recommendation chains develop over time. Regulators said their testing framework produced sufficient empirical evidence of algorithmic behaviour without needing direct access to TikTok’s proprietary source code.

The action represents the third set of preliminary findings issued by the Commission against TikTok this year. In February, regulators challenged the platform over addictive design features. In July, Brussels issued a separate warning regarding account protections and privacy settings for underage users.

Commission officials stated that Friday’s case goes substantially deeper into algorithmic architecture than a recent state settlement TikTok agreed in Alabama. While the current findings apply strictly to TikTok, officials confirmed that the regulator is reviewing whether competing social media networks push European users into similar engagement traps.

What happens next for TikTok and the DSA

The preliminary findings do not represent a final ruling or an immediate financial penalty. TikTok now has the opportunity to review the Commission’s evidence file, submit formal written responses and challenge the regulatory conclusions.

If the European Commission confirms that TikTok breached the Digital Services Act, it can levy fines of up to 6% of the company’s global annual turnover. Neither TikTok nor its parent company, ByteDance, publishes complete annual revenue figures, meaning the exact financial exposure remains unconfirmed.

Beyond potential penalties, the case will shape future European technology legislation. Officials described the findings as a foundation for the proposed KIDS Act, introduced in September, which would legally prohibit online platforms from using engagement metrics as the sole factor when recommending media to minors.

TikTok did not immediately respond to a request for comment on the preliminary findings.

Share This Article
The FrontWord Desk covers AI and technology news for readers in the UK and Europe. Articles are researched from several independent outlets and primary sources, written with AI assistance, and reviewed by FrontWord editors before publication.