SOCIAL MEDIA

TikTok was aware of risks kids and teens face on its platform, legal document alleges

Oct 11, 2024, 7:16 PM

The TikTok Inc. building is seen in Culver City, Calif., on March 17, 2023. (AP Photo/Damian Dovarg...

FILE - The TikTok Inc. building is seen in Culver City, Calif., on March 17, 2023. (AP Photo/Damian Dovarganes, File)

(AP Photo/Damian Dovarganes, File)

TikTok was aware that its design features are detrimental to its young users and that publicly touted tools aimed at limiting kids’ time on the site were largely ineffective, according to internal documents and communications exposed in lawsuit filed by the state of Kentucky.

The details are among redacted portions of Kentucky’s lawsuit that contains the internal communications and documents unearthed during a more than two year investigation into the company by various states across the country.

Kentucky’s lawsuit was filed this week, alongside separate complaints brought forth by attorneys general in a dozen states as well as the District of Columbia. TikTok is also facing another lawsuit from the Department of Justice and is itself suing the Justice Department over a federal law that could ban it in the U.S. by mid-January.

The redacted information — which was inadvertently revealed by Kentucky’s attorney general’s office and first reported by Kentucky Public Radio — touches on a range of topics, most importantly the extent to which TikTok knew how much time young users were spending on the platform and how sincere it was when rolling out tools aimed at curbing excessive use.

Beyond TikTok use among minors, the complaint alleges the short-form video sharing app has prioritized “beautiful people” on its platform and has noted internally that some of the content-moderation metrics it has publicized are “largely misleading.”

Justice Department sues TikTok, accusing the company of illegally collecting children’s data

The unredacted complaint, which was seen by The Associated Press, was sealed by a Kentucky state judge on Wednesday after state officials filed an emergency motion to seal it.

When reached for comment, TikTok spokesperson Alex Haurek said: “It is highly irresponsible of the Associated Press to publish information that is under a court seal. Unfortunately, this complaint cherry-picks misleading quotes and takes outdated documents out of context to misrepresent our commitment to community safety.”

“We have robust safeguards, which include proactively removing suspected underage users, and we have voluntarily launched safety features such as default screentime limits, family pairing, and privacy by default for minors under 16,” Haurek said in a prepared statement. “We stand by these efforts.”

TikTok use among young users

The complaint alleges that TikTok has quantified how long it takes for young users to get hooked on the platform, and shared the findings internally in presentations aimed at increasing user-retention rates. The “habit moment,” as TikTok calls it, occurs when users have watched 260 videos or more during the first week of having a TikTok account. This can happen in under 35 minutes since some TikTok videos run as short as 8 seconds, the complaint says.

Kentucky’s lawsuit also cites a spring 2020 presentation from TikTok that concluded that the platform had already “hit a ceiling” among young users. At that point, the company’s estimates showed at least 95% of smartphone users under 17 used TikTok at least monthly, the complaint notes.

TikTok tracks metrics for young users, including how long young users spend watching videos and how many of them use the platform every day. The company uses the information it gleans from these reviews to feed its algorithm, which tailors content to people’s interests, and drives user engagement, the complaint says.

TikTok does its own internal studies to find out how the platform is impacting users. The lawsuit cites one group within the company, called “TikTank,” which noted in an internal report that compulsive usage was “rampant” on the platform. It also quotes an unnamed executive who said kids watch TikTok because the algorithm is “really good.”

“But I think we need to be cognizant of what it might mean for other opportunities. And when I say other opportunities, I literally mean sleep, and eating, and moving around the room, and looking at somebody in the eyes,” the unnamed executive said, according to the complaint.

‘We kind of lost him’: Why Jordan School District was named lead plaintiff in suit against Meta, TikTok

Time management tools

TikTok has a 60-minute daily screen time limit for minors, a feature it rolled out in March 2023 with the stated aim of helping teens manage their time on the platform. But Kentucky’s complaint argues that the time limit — which users can easily bypass or disable — was intended more as a public relations tool than anything else.

The lawsuit says TikTok measured the success of the time limit feature not by whether it reduced the time teens spent on the platform, but by three other metrics — the first of which was “improving public trust in the TikTok platform via media coverage.”

Reducing screen time among teens was not included as a success metric, the lawsuit said. In fact, it alleged the company had planned to “revisit the design” of the feature if the time-limit feature had caused teens to reduce their TikTok usage by more than 10%.

TikTok ran an experiment and found the time-limit prompts shaved off just a minute and a half from the average time teens spent on the app — from 108.5 to 107 minutes per day, according to the complaint. But despite the lack of movement, TikTok did not try to make the feature more effective, Kentucky officials say. They allege the ineffectiveness of the feature was, in many ways, by design.

The complaint says a TikTok executive named Zhu Wenjia gave approval to the feature only if its impact on TikTok’s “core metrics” were minimal.

TikTok — including its CEO Shou Chew — have talked about the app’s various time management tools, including videos TikTok sends users to encourage them to get off the platform. But a TikTok executive said in an internal meeting those videos are “useful” talking points, but are “not altogether effective.”

TikTok has ‘prioritized beautiful people’ on its platform

In a section that details the negative impacts TikTok’s facial filters can have on users, Kentucky alleges that TikTok’s algorithm has “prioritized beautiful people” despite knowing internally that content on the platform could “perpetuate a narrow beauty norm.”

The complaint alleges TikTok changed its algorithm after an internal report noted the app was showing a high “volume of … not attractive subjects” in the app’s main “For You” feed.

“By changing the TikTok algorithm to show fewer ‘not attractive subjects’ in the For You feed, Defendants took active steps to promote a narrow beauty norm even though it could negatively impact their young users,” the complaint says.

TikTok’s ‘leakage’ rates

The lawsuit also takes aim at TikTok’s content-moderation practices.

It cites internal communication where the company notes its moderation metrics are “largely misleading” because “we are good at moderating the content we capture, but these metrics do not account for the content that we miss.”

The complaint notes that TikTok knows it has — but does not disclose — significant “leakage” rates, or content that violates the site’s community guidelines but is not removed or moderated. Other social media companies also face similar issues on their platforms.

TikTok removes Russian state media accounts for ‘covert influence operations’ ahead of US election

For TikTok, the complaint notes the “leakage” rates include roughly 36% of content that normalizes pedophilia and 50% of content that glorifies minor sexual assault.

The lawsuit also accuses the company of misleading the public about its moderation and allowing some popular creators who were deemed to be “high value” to post content that violates the site’s guidelines.

KSL 5 TV Live

Social Media

FILE — Australian Prime Minister Anthony Albanese gestures during a press conference in Logan Cit...

Rod MCguirk, Associated Press

Australia plans a social media ban for children under 16

The Australian government announced on Thursday what it described as world-leading legislation that would set an age limit of 16 years for children to start using social media, and hold platforms responsible for ensuring compliance.

5 days ago

FILE - Reddit CEO Steve Huffman and company employees celebrate on the New York Stock Exchange trad...

Associated Press

Reddit’s explosive user growth and AI tools help it soar to its first-ever profit

For the first time in its nearly 20-year history, Reddit is turning a profit.

13 days ago

FILE - A spectator records a cell phone video as fireworks are launched over the Ohio River during ...

Kelvin Chan, AP Business Writer

One Tech Tip: How to prepare your online accounts for when you die

Most people have accumulated a pile of data on their social media and digital accounts over their lifetimes. What happens to those selfies, emails, videos and other files when we die?

19 days ago

Democratic vice presidential candidate Minnesota Gov. Tim Walz speaks during a campaign event in Yo...

David Klepper, Associated Press

Russia linked to disinformation targeting Walz, intelligence official says

Groups in Russia created and helped spread viral disinformation targeting Democratic vice presidential candidate Tim Walz, a senior U.S. intelligence official said Tuesday.

21 days ago

Twitter may now be X, but it’s keeping up the tradition of prompting celebrities to announce they...

Lisa Respers France, CNN

Jelly Roll says he’s quitting ‘most toxic’ X

Twitter may now be X, but it’s keeping up the tradition of prompting celebrities to announce they are leaving the platform.

22 days ago

Meta's logo is seen on a sign at the company's headquarters in Menlo Park, Calif., Nov. 9, 2022. Me...

Clare Duffy, CNN

Meta fires employees for spending food allowances on personal items like acne pads and wine glasses

Meta fired around two dozen employees from its Los Angeles office for misusing company meal credits for things like laundry detergent, wine glasses and acne treatment pads.

26 days ago

Sponsored Articles

abstract vector digital social network technology background...

Les Olson

Protecting yourself against social engineering attacks

Learn more about the common types of social engineering to protect your online or offline assets from an attack.

family having fun at home...

Lighting Design

Discover the impact of lighting on your mood

From color temperature to lighting saturation, we tackle how different lighting design setups can impact your day-to-day mood.

Laptops in a modern technology store. Department of computers in the electronics store. Choosing a ...

PC Laptops

How to choose the best laptop for college students

Finding the right laptop for college students can be hard, but with this guide we break down what to look for so you can find the best one.

young male technician is repairing a printer at office...

Les Olson

Unraveling the dilemma between leasing and buying office technology

Carefully weigh these pros and cons to make an informed decision that best suits your business growth and day-to-day operation. 

A kitchen in a modern farmhouse....

Lighting Design

A room-by-room lighting guide for your home

Bookmark this room-by-room lighting guide whenever you decide to upgrade your lighting or style a new home.

Photo courtesy of Artists of Ballet West...

Ballet West

The rising demand for ballet tickets: why they’re harder to get

Ballet West’s box office is experiencing demand they’ve never seen before, leaving many interested patrons unable to secure tickets they want.

TikTok was aware of risks kids and teens face on its platform, legal document alleges