Child abuse images removed from AI image-generator training source, researchers say

Artificial intelligence researchers said Friday they have deleted more than 2,000 web links to suspected child sexual abuse imagery from a database used to train popular AI image-generator tools.

The LAION research database is a huge index of online images and captions that’s been a source for leading AI image-makers such as Stable Diffusion and Midjourney.

But a report last year by the Stanford Internet Observatory found it contained links to sexually explicit images of children, contributing to the ease with which some AI tools have been able to produce photorealistic deepfakes that depict children.

That December report led LAION, which stands for the nonprofit Large-scale Artificial Intelligence Open Network, to immediately remove its dataset. Eight months later, LAION said in a blog post that it worked with the Stanford University watchdog group and anti-abuse organizations in Canada and the United Kingdom to fix the problem and release a cleaned-up database for future AI research.

Stanford researcher David Thiel, author of the December report, commended LAION for significant improvements but said the next step is to withdraw from distribution the “tainted models” that are still able to produce child abuse imagery.

AI-generated child sexual abuse images could flood the internet. A watchdog is calling for action

One of the LAION-based tools that Stanford identified as the “most popular model for generating explicit imagery” — an older and lightly filtered version of Stable Diffusion — remained easily accessible until Thursday, when the New York-based company Runway ML removed it from the AI model repository Hugging Face. Runway said in a statement Friday it was a “planned deprecation of research models and code that have not been actively maintained.”

The cleaned-up version of the LAION database comes as governments around the world are taking a closer look at how some tech tools are being used to make or distribute illegal images of children.

San Francisco’s city attorney earlier this month filed a lawsuit seeking to shut down a group of websites that enable the creation of AI-generated nudes of women and girls. The alleged distribution of child sexual abuse images on the messaging app Telegram is part of what led French authorities to bring charges on Wednesday against the platform’s founder and CEO, Pavel Durov.

Durov’s arrest “signals a really big change in the whole tech industry that the founders of these platforms can be held personally responsible,” said David Evan Harris, a researcher at the University of California, Berkeley who recently reached out to Runway asking about why the problematic AI image-generator was still publicly accessible. It was taken down days later.

New bipartisan bill would require online identification, labeling of AI-generated videos and audio

---

Child abuse resources:

• Utah Domestic Violence Coalition operates a confidential statewide, 24-hour domestic abuse hotline at 1-800-897-LINK (5465). Resources are also available online: udvc.org. The statewide child abuse and neglect hotline is 1-855-323-DCFS (3237).

Help with Children

Those who feel stressed out with a child, who need a break or who feel like they need counseling or training can reach out to one of the following agencies:

• The Family Support Center has 15 locations throughout the state and offers a free crisis nursery for parents who have to keep appointments or who are stressed out. They also offer counseling and family mentoring. Call 801-955-9110 or visit familysupportcenter.org/contact.php for more information.
• Prevent Child Abuse Utah provides home visiting in Weber, Davis, and Box Elder counties. Parent Educators provide support, education, and activities for families with young children. Their statewide education team offers diverse trainings on protective factors, digital safety, bullying, and child sex trafficking. They are available for in-person or virtual trainings and offer free online courses for the community at pcautah.org.
• The Office of Home Visiting works with local agencies to provide home visits to pregnant women and young families who would like to know more about being parents. Home visitors are trained and can provide information about breastfeeding, developmental milestones, toilet training, nutrition, mental health, home safety, child development, and much more. Find out more at homevisiting.utah.gov.

The Safe Haven law allows birth parents in Utah to safely and anonymously give up custody of their newborn child at any hospital in the state, with no legal consequences and no questions asked. The child’s mother can drop off the child, or the mother can ask someone else to do it for her. The newborns should be dropped off at hospitals that are open 24 hours a day. Newborns given up in this manner will be cared for by the hospital staff, and the Utah Division of Child and Family Services will find a home for the child. For more information, visit utahsafehaven.org or call the 24-hour hotline at 866-458-0058.