EU Commission Says TikTok's Recommendation Algorithm Risks Pulling Vulnerable Users into Harmful Content Loops

In brief

• The European Commission has preliminarily found that TikTok's For You feed breaches the Digital Services Act.
• Regulators say the recommendation system can pull vulnerable users into loops of content about sadness, isolation and body image.
• The Commission has ordered changes to the app; a fine of up to 6 percent of global annual turnover is possible if TikTok does not comply.

Preliminary findings against the For You feed

The European Commission has preliminarily concluded that TikTok breaches the Digital Services Act, the EU rulebook for online platforms. (Suchtgefahr - Tiktok widerspricht Vorwüfen der EU-Kommission – Deutschlandfunk) (‚Králičí nory‘ mají negativní dopad na duševní zdraví. Podle komise TikTok porušuje unijní nařízení – iROZHLAS) The focus is the For You page, the main feed that serves users a continuous stream of personalised short videos. Regulators say the feed keeps showing related content even when it touches on mental health problems and body image. (TikTok pod ostrzałem UE. Bruksela wskazuje niebezpieczeństwo „króliczych nor” – Rzeczpospolita)

How the "rabbit hole" effect works

According to the Commission, the more a user engages with one type of content, the more the algorithm recommends similar material. (Euroopa Komisjon: Tiktoki algoritm võib kahjustada kasutajate vaimset tervist – ERR) Regulators argue this can be harmful when repeated exposure involves themes such as sadness, isolation or body perception, and that such loops can damage mental health, especially among vulnerable adults and minors. Henna Virkkunen, the Commission's executive vice-president for technological sovereignty, security and democracy, said the algorithm offers more of the same each time a user watches or likes a video, drawing people into loops they find hard to leave. Regulators also link the feed to eating disorders and anxiety.

What the Commission wants changed

The Commission argues TikTok did not adequately assess how its recommender system can pull users into these loops, and has not put effective measures in place to mitigate the risk. (Soziale Medien: EU: TikTok gefährdet mentale Gesundheit - Strafe droht – ZEIT ONLINE) Brussels has ordered the company to change how the app works to protect users' mental health. TikTok has introduced controls aimed at the "rabbit hole" effect, but the Commission's preliminary view is that they are not effective. (TikTok’s For You page needs to change, says the EU – The Verge)

TikTok's response

TikTok rejects the allegations. The company says it proactively removes content promoting eating disorders or self-harm and offers a feed without personalised recommendations, as EU law requires.

Possible penalties

If TikTok does not adjust its algorithm, the Commission can impose a fine of up to 6 percent of the company's worldwide annual turnover. A separate proceeding against the platform concerns other features, including endless video playback. The case is at a preliminary stage, so the findings can still change before any final decision.