SCIENCE & TECHNOLOGY

AI-generated child sexual abuse images could flood the internet. A watchdog is calling for action

Oct 24, 2023, 5:44 PM | Updated: 6:52 pm

images created by artificial intelligence behind a cell phone...

In this picture, the desktop and mobile websites for Stable Diffusion are seen, Tuesday, Oct. 24, 2023, in New York. Computer-generated child sexual abuse images made with artificial intelligence tools like Stable Diffusion are starting to proliferate on the internet and are so realistic that they can be indistinguishable from photographs depicting actual children, according to a new report. (AP Photo/John Minchillo)

(AP Photo/John Minchillo)

NEW YORK (AP) — The already-alarming proliferation of child sexual abuse images on the internet could become much worse if something is not done to put controls on artificial intelligence tools that generate deepfake photos, according to a new report.

The U.K.-based Internet Watch Foundation this week warned governments and technology providers to act quickly before a flood of AI-generated images of child sexual abuse overwhelms law enforcement investigators and vastly expands the pool of potential victims.

“We’re not talking about the harm it might do,” said Dan Sexton, the watchdog group’s chief technology officer. “This is happening right now and it needs to be addressed right now.”

In a first-of-its-kind case in South Korea, a man was sentenced in September to 2 1/2 years in prison for using artificial intelligence to create 360 virtual child abuse images, according to the Busan District Court in the country’s southeast.

In some cases, kids are using these tools on each other. At a school in southwestern Spain, police have been investigating teens’ alleged use of a phone app to make their schoolmates appear nude in photos.

The report exposes a dark side of the race to build generative AI systems that enable users to describe in words what they want to produce — from emails to novel artwork or videos — and have the system spit it out.

If it isn’t stopped, the flood of deepfake child sexual abuse images could bog investigators down trying to rescue children who turn out to be virtual characters. Perpetrators could also use the images to groom and coerce new victims.

Sexton said IWF analysts discovered faces of famous children online as well as a “massive demand for the creation of more images of children who’ve already been abused, possibly years ago.”

“They’re taking existing real content and using that to create new content of these victims,” he said. “That is just incredibly shocking.”

Sexton said his charity organization, which is focused on combating online child sexual abuse and working with others to remove it, first began fielding reports about abusive AI-generated imagery earlier this year. That led to an investigation into forums on the so-called dark web, a part of the internet hosted within an encrypted network and accessible only through tools that provide anonymity.

What IWF analysts found were abusers sharing tips and marveling about how easy it was to turn their home computers into factories for generating sexually explicit images of children of all ages. Some are also trading and attempting to profit off such images that appear increasingly lifelike.

“What we’re starting to see is this explosion of content,” Sexton said.

While the IWF’s report is meant to flag a growing problem more than offer prescriptions, it urges governments to strengthen laws to make it easier to combat AI-generated abuse. It particularly targets the European Union, where there’s a debate over surveillance measures that could automatically scan messaging apps for suspected images of child sexual abuse even if the image is not previously known to law enforcement.

A big focus of the group’s work is to prevent previous sex abuse victims from being abused again through the redistribution of their photos.

The report says technology providers could do more to make it harder for the products they’ve built to be used in this way, though it’s complicated by the fact that some of the tools are hard to put back in the bottle.

A crop of new AI image-generators was introduced last year and wowed the public with their ability to conjure up whimsical or photorealistic images on command. But most of them are not favored by producers of child sex abuse material because they contain mechanisms to block it.

Technology providers that have closed AI models, with full control over how they’re trained and used — for instance, OpenAI’s image-generator DALL-E — appear to have been more successful at blocking misuse, Sexton said.

By contrast, a tool favored by producers of child sex abuse imagery is the open-source Stable Diffusion, developed by London-based startup Stability AI. When Stable Diffusion burst on the scene in the summer of 2022, a subset of users quickly learned how to use it to generate nudity and pornography. While most of that material depicted adults, it was often nonconsensual, such as when it was used to create celebrity-inspired nude pictures.

Stability later rolled out new filters that block unsafe and inappropriate content, and a license to use Stability’s software also comes with a ban on illegal uses.

In a statement released Tuesday, the company said it “strictly prohibits any misuse for illegal or immoral purposes” across its platforms. “We strongly support law enforcement efforts against those who misuse our products for illegal or nefarious purposes,” the statement reads.

Users can still access unfiltered older versions of Stable Diffusion, however, which are “overwhelmingly the software of choice … for people creating explicit content involving children,” said David Thiel, chief technologist of the Stanford Internet Observatory, another watchdog group studying the problem.

“You can’t regulate what people are doing on their computers, in their bedrooms. It’s not possible,” Sexton added. “So how do you get to the point where they can’t use openly available software to create harmful content like this?”

Multiple countries, including the U.S. and U.K., have laws banning the production and possession of such images, but it remains to be seen how they will enforce them.

The IWF’s report is timed ahead of a global AI safety gathering next week hosted by the British government that will include high-profile attendees including U.S. Vice President Kamala Harris and tech leaders.

“While this report paints a bleak picture, I am optimistic,” IWF CEO Susie Hargreaves said in a prepared written statement. She said it is important to communicate the realities of the problem to “a wide audience because we need to have discussions about the darker side of this amazing technology.”


O’Brien reported from Providence, Rhode Island. Associated Press writers Barbara Ortutay in Oakland, California, and Hyung-jin Kim in Seoul, South Korea, contributed to this report.

 

KSL 5 TV Live

Science & Technology

STARBASE Hill...

Debbie Worthen

STARBASE Hill program in Utah shuts down due to massive funding reduction

A Department of Defense youth program is the latest victim of budget cuts on Washington’s Capitol Hill, and thousands of Utah children will feel the impact.

3 days ago

This May 18, 1969, photo provided by NASA shows Earth from 36,000 nautical miles away as photograph...

Marcia Dunn, Associated Press

Newly spotted asteroid has a tiny chance of hitting Earth in 2032

A newly discovered asteroid has a tiny chance of smacking Earth in 2032, space agency officials said Wednesday.

6 days ago

MELBOURNE, AUSTRALIA - NOVEMBER 30: In this photo illustration, social media networking apps are di...

Daniel Woodruff

Utah Senate committee approves requiring app stores to verify users’ ages

Children and smartphones took center stage at the Utah Capitol Tuesday as a Senate committee voted unanimously to require app stores to verify the ages of users.

11 days ago

Former Colombian President Juan Manuel Santos, second from left, and Bulletin of the Atomic Scienti...

Associated Press

‘Doomsday Clock’ moves closer to midnight amid threats

Earth is moving closer to destruction, a science-oriented advocacy group said Tuesday as it advanced its famous “Doomsday Clock” to 89 seconds till midnight, the closest it has ever been.

11 days ago

A surprisingly efficient and powerful Chinese AI model has taken the technology industry by storm. ...

David Goldman, CNN

What is DeepSeek, the Chinese AI startup that shook the tech world?

A surprisingly efficient and powerful Chinese AI model has taken the technology industry by storm. It’s called DeepSeek R1, and it’s rattling nerves on Wall Street.

12 days ago

The exterior of the Salt Lake City Public Library in Salt Lake City on July 27, 2021. Salt Lake Cit...

Carter Williams, KSL.com

Salt Lake City eyes this location for the start of Green Loop project

A "linear park" that could circle downtown Salt Lake City within the next decade has taken another step toward reality.

13 days ago

Sponsored Articles

holiday gift basket with blue tissue paper and gingerbread cookies...

Kneaders Bakery & Cafe

Holiday hacks for a stress-free season

Get more out of your time with family and loved ones over the holidays by following these tips for a stress-free season.

2 computer techs in a computer shop holding up a computer server with the "hang loose" sign...

PC Laptops

A comprehensive guide to choosing the right computer

With these tips, choosing the right computer that fits your needs and your budget will be easier than ever.

crowds of people in a German style Christmas market...

This Is The Place Heritage Park

Celebrate Christkindlmarket at This Is The Place Heritage Park!

The Christkindlmarket is an annual holiday celebration influenced by German traditions and generous giving.

Image of pretty woman walking in snowy mountains. Portrait of female wearing warm winter earmuff, r...

Lighting Design

Brighten your mood this winter with these lighting tricks

Read our lighting tips on how to brighten your mood in the winter if you are experiencing seasonal affective disorder.

A kitchen with a washer and dryer and a refrigerator...

Appliance Man

Appliance Man: a trusted name in Utah’s home appliance industry

Despite many recent closures of local appliance stores, Appliance Man remains Utah's trusted home appliance business and is here to stay.

abstract vector digital social network technology background...

Les Olson

Protecting yourself against social engineering attacks

Learn more about the common types of social engineering to protect your online or offline assets from an attack.

AI-generated child sexual abuse images could flood the internet. A watchdog is calling for action