TikTok sued by content moderator who claims she developed PTSD from reviewing disturbing content

Dec 29, 2021, 2:51 PM | Updated: Feb 13, 2023, 2:47 pm

FILE PHOTO (Photographer: Andrew Harrer/Bloomberg via Getty Images)...

FILE PHOTO (Photographer: Andrew Harrer/Bloomberg via Getty Images)

(Photographer: Andrew Harrer/Bloomberg via Getty Images)

(CNN) — A content moderator for TikTok is suing the social media platform after she says she developed psychological trauma as a result of her job, which she alleges required her to review videos featuring graphic violence, conspiracy theories and other disturbing imagery.

Candie Frazier, a Las Vegas-based contractor for TikTok parent company ByteDance, alleges that she and other content moderators often spend 12-hour days reviewing disturbing content. She claims that TikTok and ByteDance fail to provide adequate protections and psychological support for content moderators, according to the complaint.

“Plaintiff Frazier views videos of the genocide in Myanmar, mass shootings, children being raped, and animals being mutilated,” the complaint states. “As a result of constant and unmitigated exposure to highly toxic and extremely disturbing images at the workplace, Ms. Frazier has developed and suffers from significant psychological trauma including anxiety, depression, and posttraumatic stress disorder.”

The proposed class action lawsuit, filed last week in federal court in California is likely to heighten the scrutiny of problematic content and moderation practices at TikTok. The short video-based platform had previously flown under the radar compared to larger rivals such as Facebook and YouTube, but has gained attention in recent months from critics and lawmakers after exploding in popularity, especially among young people, during the pandemic. The company said in September that it had reached 1 billion monthly users.

A TikTok spokesperson said the company does not comment on ongoing litigation.

“We strive to promote a caring working environment for our employees and contractors,” the spokesperson said. “Our Safety team partners with third party firms on the critical work of helping to protect the TikTok platform and community, and we continue to expand on a range of wellness services so that moderators feel supported mentally and emotionally.”

Frazier is not a TikTok or ByteDance employee; rather, she works for a Canadian company called Telus International, which contracts out content moderation workers to TikTok and other social media platforms. But Frazier alleges in the suit that her work is dictated and supervised by TikTok and ByteDance. A spokesperson for Telus, which is not named as a party in the lawsuit, said that Frazier had never previously raised concerns about her work and “her allegations are entirely inconsistent with our policies and practices.”

“We have a robust resiliency and mental health program in place to support all our team members, as well as a comprehensive benefits program for access to personal health and well-being services,” the Telus spokesperson said. “Our team members can elevate questions and concerns about any aspect of their job through several internal channels, all of which the company takes very seriously.”

Facebook faced a similar lawsuit in 2018 from a content moderator who said she developed PTSD after being exposed to content featuring rape, suicide and violence on the job. Among the criticisms Facebook faced for its content moderation practices was that moderation contractors did not reap the same benefits as corporate employees, despite being tasked with such a taxing job. The social media giant ultimately agreed to a $52 million class action settlement, which involved payments and funding for mental health treatment for content moderators, as well as workplace changes.

A TikTok executive testified on Capitol Hill for the first time in October and acknowledged the need to increase protections for young users on the platform. “We’re seeking to earn trust through a higher level of action, transparency and accountability, as well as the humility, to learn and improve,” TikTok VP and head of public policy Michael Beckerman told a Senate subcommittee. But Frazier’s lawsuit may point to the challenges of improving such protections.

The complaint alleges that problematic content is only reviewed by moderators after it is uploaded to the platform if a user reports it. Because of the volume of content they are tasked with, moderators have only 25 seconds to review each video and view “three to ten videos at the same time,” it states. (TikTok did not immediately respond to a request for comment regarding these allegations.)

“These videos include animal cruelty, torture, suicides, child abuse, murder, beheadings, and other graphic content,” according to the complaint. “The videos are each sent to two content moderators, who review the videos and determine if the video should remain on the platform, be removed from the platform, or have its audio muted.”

Theo Bertram, then-TikTok’s director of public policy for Europe, the Middle East and Africa, told British lawmakers in September 2020 that the company had 10,000 people working on its “trust and safety” team worldwide. TikTok earlier this year also launched an automated moderation system to scan and remove videos that violate its policies “upon upload,” although the feature is only available for certain content categories.

The system handles “content categories where our technology has the highest degree of accuracy, starting with violations of our policies on minor safety, adult nudity and sexual activities, violent and graphic content, and illegal activities and regulated goods,” a July blog post from TikTok’s Head of US Safety, Eric Han, reads. “We hope this update also supports resiliency within our Safety team by reducing the volume of distressing videos moderators view and enabling them to spend more time in highly contextual and nuanced areas.”

TikTok says that 93% of the violating videos removed between April and June 2021 were done so within 24 hours of being posted — the majority of which had zero views and were flagged by its automated system rather than being reported by a user, according to a Community Guidelines Enforcement Report released in October. (TikTok did not comment on Frazier’s allegation that content moderators only review videos after they are reported by a user.)

Frazier also alleges that content moderators are required to sign non-disclosure agreements which “exacerbate the harm” caused by the work, according to the complaint. The practice of requiring workers to sign non-disclosure agreements has come under fire in the technology industry recently amid employee disputes at Pinterest, Apple and other big tech firms. TikTok did not immediately respond to a request for comment regarding its NDA practices.

With the lawsuit, Frazier seeks to have TikTok pay damages (in an amount that would be determined later) to herself and other content moderators, and to develop a “medical monitoring fund” to pay for screening, diagnosis and treatment of psychological issues for such workers, according to the complaint.

™ & © 2021 Cable News Network, Inc., a WarnerMedia Company. All rights reserved.

KSL 5 TV Live

National News

This March 20, 2018, file photo shows the Spotify app on an iPad in Baltimore. Spotify’s chief fi...

Mary Culbertson

Spotify CFO announces departure from company days after third round of layoffs

Spotify’s chief financial officer, Paul Vogel, is leaving next year, the music streaming service said — just days after the company announced its third round of layoffs for 2023.

1 hour ago

Secretary of State Antony Blinken appears on CNN's "State of the Union" on December 10. (CNN)...

By Jack Forrest and Sam Fossum, CNN

Blinken calls sexual violence inflicted by Hamas ‘beyond anything I’ve seen’

Secretary of State Antony Blinken forcefully condemned Hamas for sexual violence during the Oct. 7 attacks, and criticized those who were not quick enough to do the same.

2 hours ago

FILE - This Jan. 22, 2018, file photo, shows Rev. Martin Luther King Jr.'s birth home which is oper...

Brianna Chavez

Utahn recounts how attempted arson at the birth home of Martin Luther King Jr. was prevented

Several bystanders, including two from Utah, were able to prevent a 26-year-old woman from burning down the birth home of Martin Luther King Jr. Thursday evening. The incident has since sparked national attention.

16 hours ago

emergency lights...

Andy Rose, CNN

Three people killed, including child, after tornado strikes Tennessee

A tornado that cut through Clarksville, Tennessee, Saturday evening left at least three people dead, the county officials said.

18 hours ago

Liz Magill, President of University of Pennsylvania
(Kevin Dietsch, Getty Images)...

Matt Egan, CNN

University of Pennsylvania president resigns after hearing on antisemitism

In a stunning downfall for the leader of one of the world’s most prestigious universities, Liz Magill, the president of University of Pennsylvania, voluntarily stepped down from the helm of the Ivy League school on Saturday following a torrent of criticism for her testimony about antisemitism on Capitol Hill Tuesday.

19 hours ago

Elon Musk may restore Alex Jones account on X.

Clare Duffy, CNN

Elon Musk signals he will restore the X account of notorious conspiracy theorist Alex Jones

Elon Musk signaled Saturday that he would restore the account of right-wing extremist Alex Jones on X, formerly known as Twitter, reversing a 2018 decision by the company’s previous management to deplatform the notorious conspiracy theorist after he repeatedly broke rules prohibiting harassment and hate.

20 hours ago

Sponsored Articles

Stylish room interior with beautiful Christmas tree and decorative fireplace...

Lighting Design

Create a Festive Home with Our Easy-to-Follow Holiday Prep Guide

Get ready for festive celebrations! Discover expert tips to prepare your home for the holidays, creating a warm and welcoming atmosphere for unforgettable moments.

Battery low message on mobile device screen. Internet and technology concept...

PC Laptops

9 Tips to Get More Power Out of Your Laptop Battery

Get more power out of your laptop battery and help it last longer by implementing some of these tips from our guide.

Users display warnings about the use of artificial intelligence (AI), access to malicious software ...

Les Olson

How to Stay Safe from Cybersecurity Threats

Read our tips for reading for how to respond to rising cybersecurity threats in 2023 and beyond to keep yourself and your company safe.

Design mockup half in white and half in color of luxury house interior with open plan living room a...

Lighting Design

Lighting Design 101: Learn the Basics

These lighting design basics will help you when designing your home, so you can meet both practical and aesthetic needs.

an antler with large horns int he wilderness...

Three Bear Lodge

Yellowstone in the Fall: A Wildlife Spectacle Worth Witnessing

While most people travel to this park in the summer, late fall in Yellowstone provides a wealth of highlights to make a memorable experience.

a diverse group of students raising their hands in a classroom...

Little Orchard Preschool

6 Benefits of Preschool for Kids

Some of the benefits of preschool for kids include developing independence, curiosity, and learning more about the world.

TikTok sued by content moderator who claims she developed PTSD from reviewing disturbing content