SCIENCE & TECHNOLOGY

Sora is ChatGPT maker OpenAI’s new text-to-video generator. Here’s what we know about the new tool

Feb 16, 2024, 12:22 PM | Updated: 12:40 pm

FILE - The OpenAI logo is displayed on a cell phone with an image on a computer monitor generated b...

FILE - The OpenAI logo is displayed on a cell phone with an image on a computer monitor generated by ChatGPT's Dall-E text-to-image model, Friday, Dec. 8, 2023, in Boston. The maker of ChatGPT is now diving into the world of AI-generated video. Meet Sora — OpenAI’s new text-to-video generator. The tool, which the San Francisco-based company unveiled on Thursday, Feb. 16, 2024 uses generative artificial intelligence to instantly create short videos based on written commands. (AP Photo/Michael Dwyer, File)

(AP Photo/Michael Dwyer, File)

NEW YORK (AP) — The maker of ChatGPT is now diving into AI-generated video.

Meet Sora — OpenAI’s new text-to-video generator. The tool, which the San Francisco company unveiled Thursday, uses generative artificial intelligence to instantly create short videos based on written commands.

Sora isn’t the first to demonstrate this kind of technology. But industry analysts point to the high quality of the tool’s videos displayed so far, and note that its introduction marks a significant leap for both OpenAI and the future of text-to-video generation overall.

Still, as with all things in the rapidly-growing AI space today, such technology also raises fears about potential ethical and societal implications. Here’s what you need to know.

What is Sora? Can I use it yet?

Sora is a text-to-video generator — creating videos up to 60 seconds long based on written prompts using generative AI. The model can also generate video from an existing still image.

Generative AI is a branch of AI that can create something new. Examples include chatbots, like OpenAI’s ChatGPT, and image-generators such as DALL-E and Midjourney. Getting an AI system to generate videos is newer and more challenging but relies on some of the same technology.

 

Post by @rpnickson
View on Threads

 

Sora isn’t available for public use yet (OpenAI says it’s engaging with policymakers and artists before officially releasing the tool) and there’s a lot we still don’t know. But since Thursday’s announcement, the company has shared a handful of examples of Sora-generated videos to show off what it can do.

OpenAI CEO Sam Altman also took to X, the platform formerly known as Twitter, to ask social media users to send in prompt ideas. He later shared realistically-detailed videos that responded to prompts like “two golden retrievers podcasting on top of a mountain ” and “a bicycle race on ocean with different animals as athletes riding the bicycles with drone camera view.”

While Sora-generated videos are able to depict complex, incredibly-detailed scenes, OpenAI notes that there are still some weaknesses — including some spatial and cause-and-effect elements. For example, OpenAI adds on its website, “a person might take a bite out of a cookie, but afterward, the cookie may not have a bite mark.”

Are there other AI-generated video tools out there today?

OpenAI’s Sora isn’t the first of its kind. Google, Meta and the startup Runway ML are among the other companies to have demonstrated similar technology.

Still, industry analysts stress the apparent quality and and impressive length of Sora videos shared so far. Fred Havemeyer, head of U.S. AI and software research at Macquarie, said that Sora’s launch marks a big step forward for the industry.

“Not only can you do longer videos, I understand up to 60 seconds, but also the videos being created look more normal and seem to actually respect physics and the real world more,” Havemeyer said. “You’re not getting as many ‘uncanny valley’ videos or fragments on the video feeds that look … unnatural.”

While there has been “tremendous progress” in AI-generated video over the last year — including Stable Video Diffusion’s introduction last November — Forrester senior analyst Rowan Curran said such videos have required more “stitching together” for character and scene consistency.

The consistency and length of Sora’s videos, however, represents “new opportunities for creatives to incorporate elements of AI-generated video into more traditional content, and now even to generate full-blown narrative videos from one or a few prompts,” Curran told The Associated Press via email Friday.

What are the potential risks?

Although Sora’s abilities have astounded observers since Thursday’s launch, anxiety over ethical and societal implications of AI-generated video uses also remains.

Havemeyer points to the substantial risks in 2024’s potentially-fraught election cycle, for example. Having a “potentially magical” way to generate videos that may look and sound realistic presents a number of issues within politics and beyond, he added — pointing to fraud, propaganda and misinformation concerns.

 

Post by @bloombergopinion
View on Threads

 

“The negative externalities of generative AI will be a critical topic for debate in 2024,” Havemeyer said. “It’s a substantial issue that every business and every person will need to face this year.”

Tech companies are still calling the shots when it comes to governing AI and its risks as governments around the world work to catch up. In December, the European Union reached a deal on the world’s first comprehensive AI rules, but the act won’t take effect until two years after final approval.

On Thursday, OpenAI said it was taking important safety steps before making Sora widely available.

“We are working with red teamers — domain experts in areas like misinformation, hateful content, and bias — who will be adversarialy testing the model,” the company wrote. “We’re also building tools to help detect misleading content such as a detection classifier that can tell when a video was generated by Sora.”

OpenAI’s vice president of global affairs Anna Makanju reiterated this when speaking Friday at the Munich Security Conference, where OpenAI and 19 other technology companies pledged to voluntarily work together to combat AI-generated election deepfakes. She noted the company was releasing Sora “in a manner that is quite cautious.”

At the same time, OpenAI has revealed limited information about how Sora was built. OpenAI’s technical report did not disclose what imagery and video sources were used to train Sora — and the company did not immediately respond to The Associated Press’ request for further comment Friday.

The Sora release also arrives amid the backdrop of lawsuits against OpenAI and its business partner Microsoft by some authors and The New York Times over its use of copyrighted works of writing to train ChatGPT. OpenAI pays an undisclosed fee to The Associated Press to license its text news archive.


O’Brien reported from Providence, Rhode Island.

 

KSL 5 TV Live

Science & Technology

A graphic shows what a lava lake, called Loki Patera, may look like on the surface of Jupiter's moo...

Ashley Strickland, CNN

Unprecedented images reveal jaw-dropping features of Jupiter’s ‘tortured moon’

Close flybys of Io, one of Jupiter’s moons and the most volcanically active world in our solar system, have revealed a lava lake and a towering feature called “Steeple Mountain” on the moon’s alien surface.

1 day ago

An artist's illustration depicts Voyager 1 as it travels through interstellar space, or the space b...

Ashley Strickland, CNN

Voyager 1 is sending data back to Earth for the first time in 5 months

For the first time in five months, NASA engineers have received decipherable data from Voyager 1 after crafting a creative solution to fix a communication problem aboard humanity’s most distant spacecraft in the cosmos.

2 days ago

The New Horizons spacecraft took an image of Pluto's heart on July 14, 2015. (Johns Hopkins Univers...

Ashley Strickland

Pluto gained a ‘heart’ after colliding with a planetary body

A huge heart-shaped feature on the surface of Pluto has intrigued astronomers since NASA’s New Horizons spacecraft captured it in a 2015 image. Now, researchers think they have solved the mystery of how the distinctive heart came to be.

2 days ago

FILE - The Lyrid meteor shower is seen over Burg on the Baltic Sea island of Fehmarn off Germany, F...

Christina Larson, The Associated Press

The Lyrid meteor shower peaks this weekend, but it may be hard to see it

The Lyrid meteor shower is underway. But with a nearly full moon in the sky during the peak, it might be tough to see clearly.

3 days ago

Nearly 4,000 of the new Tesla Cybertrucks are being recalled because the accelerator can become stu...

Chris Isidore and Peter Valdes-Dapena

Tesla recalls Cybertruck due to accelerator pedal that can stick

Tesla has been ordered to recall nearly 4,000 of its Cybertrucks due to an accelerator pedal that can stick in place when pressed down.

5 days ago

Zach Lemann, curator of animal collections for the Audubon Insectarium, prepares cicadas for eating...

Kevin McGill, Associated Press

Would you like a cicada salad? The monstrous little noisemakers descend on a New Orleans menu

They may look like little monsters. And their seemingly endless racket may be a nuisance. But as parts of the nation prepare for the emergence of trillions of noisy cicadas, bug experts say the little creatures can also be a tasty snack.

5 days ago

Sponsored Articles

Women hold card for scanning key card to access Photocopier Security system concept...

Les Olson

Why Printer Security Should Be Top of Mind for Your Business

Connected printers have vulnerable endpoints that are an easy target for cyber thieves. Protect your business with these tips.

Modern chandelier hanging from a white slanted ceiling with windows in the backgruond...

Lighting Design

Light Up Your Home With These Top Lighting Trends for 2024

Check out the latest lighting design trends for 2024 and tips on how you can incorporate them into your home.

Technician woman fixing hardware of desktop computer. Close up....

PC Laptops

Tips for Hassle-Free Computer Repairs

Experiencing a glitch in your computer can be frustrating, but with these tips you can have your computer repaired without the stress.

Close up of finger on keyboard button with number 11 logo...

PC Laptops

7 Reasons Why You Should Upgrade Your Laptop to Windows 11

Explore the benefits of upgrading to Windows 11 for a smoother, more secure, and feature-packed computing experience.

Stylish room interior with beautiful Christmas tree and decorative fireplace...

Lighting Design

Create a Festive Home with Our Easy-to-Follow Holiday Prep Guide

Get ready for festive celebrations! Discover expert tips to prepare your home for the holidays, creating a warm and welcoming atmosphere for unforgettable moments.

Battery low message on mobile device screen. Internet and technology concept...

PC Laptops

9 Tips to Get More Power Out of Your Laptop Battery

Get more power out of your laptop battery and help it last longer by implementing some of these tips from our guide.

Sora is ChatGPT maker OpenAI’s new text-to-video generator. Here’s what we know about the new tool