{"id":605584,"date":"2023-02-07T07:49:03","date_gmt":"2023-02-07T13:49:03","guid":{"rendered":"https:\/\/news.sellorbuyhomefast.com\/index.php\/2023\/02\/07\/the-original-startup-behind-stable-diffusion-has-launched-a-generative-ai-for-video\/"},"modified":"2023-02-07T07:49:03","modified_gmt":"2023-02-07T13:49:03","slug":"the-original-startup-behind-stable-diffusion-has-launched-a-generative-ai-for-video","status":"publish","type":"post","link":"https:\/\/newsycanuse.com\/index.php\/2023\/02\/07\/the-original-startup-behind-stable-diffusion-has-launched-a-generative-ai-for-video\/","title":{"rendered":"The original startup behind Stable Diffusion has launched a generative AI for video"},"content":{"rendered":"
\n

In a demo reel posted on its website, Runway shows how its software, called Gen-1, can turn clips of people on a street into claymation puppets, or books stacked on a table into a cityscape at night. Runway hopes that Gen-1 will do for video what Stable Diffusion did for images<\/a>. \u201cWe\u2019ve seen a big explosion in image-generation models,\u201d says Runway CEO and cofounder Crist\u00f3bal Valenzuela. \u201cI truly believe that 2023 is going to be the year of video.\u201d<\/p>\n<\/div>\n

\n

Set up in 2018, Runway has been developing AI-powered video-editing software for several years. Its tools are used by TikTokers and YouTubers as well as mainstream movie and TV studios. The makers of The Late Show with Stephen Colbert<\/em> used Runway software to edit the show\u2019s graphics; the visual effects team behind the hit movie Everything Everywhere All at Once<\/em> used the company’s tech to help create certain scenes.\u00a0\u00a0<\/p>\n

In 2021, Runway collaborated with researchers at the University of Munich to build the first version of Stable Diffusion. Stability AI, a UK-based startup, then stepped in to pay the computing costs required to train the model on much more data. In 2022, Stability AI took Stable Diffusion mainstream, transforming it from a research project into a global phenomenon.\u00a0<\/p>\n

But the two companies no longer collaborate. Getty is now taking legal action against Stability AI\u2014claiming that the company used Getty\u2019s images, which appear in Stable Diffusion\u2019s training data, without permission\u2014and Runway is keen to keep its distance.<\/p>\n

Gen-1 represents a new start for Runway. It follows a smattering of text-to-video models revealed late last year, including Make-a-Video from Meta<\/a> and Phenaki from Google, both of which can generate very short video clips from scratch. It is also similar to Dreamix, a generative AI from Google revealed last week, which can create new videos from existing ones by applying specified styles. But at least judging from Runway\u2019s demo reel, Gen-1 appears to be a step up in video quality. Because it transforms existing footage, it can also produce much longer videos than most previous models.\u00a0(The company says it will post technical details about Gen-1 on its website in the next few days.) \u00a0\u00a0<\/p>\n

Unlike Meta and Google, Runway has built its model with customers in mind. \u201cThis is one of the first models to be developed really closely with a community of video makers,\u201d says Valenzuela. \u201cIt comes with years of insight about how filmmakers and VFX editors actually work on post-production.\u201d<\/p>\n

Gen-1, which runs on the cloud via Runway\u2019s website, is being made available to a handful of invited users today and will be launched to everyone on the waitlist in a few weeks.<\/p>\n

Last year\u2019s explosion in generative AI was fueled by the millions of people who got their hands on powerful creative tools for the first time and shared what they made with them. Valenzuela hopes that putting Gen-1 into the hands of creative professionals will soon have a similar impact on video.<\/p>\n

\u201cWe\u2019re really close to having full feature films being generated,\u201d he says. \u201cWe\u2019re close to a place where most of the content you\u2019ll see online will be generated.\u201d<\/svg> <\/p>\n<\/div>\n

Read More<\/a>
\n Will Douglas Heaven<\/p>\n","protected":false},"excerpt":{"rendered":"

In a demo reel posted on its website, Runway shows how its software, called Gen-1, can turn clips of people on a street into claymation puppets, or books stacked on a table into a cityscape at night. Runway hopes that Gen-1 will do for video what Stable Diffusion did for images. \u201cWe\u2019ve seen a big<\/p>\n","protected":false},"author":1,"featured_media":605585,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1643,334,46],"tags":[],"class_list":{"0":"post-605584","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-original","8":"category-startup","9":"category-technology"},"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/posts\/605584","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/comments?post=605584"}],"version-history":[{"count":0,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/posts\/605584\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/media\/605585"}],"wp:attachment":[{"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/media?parent=605584"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/categories?post=605584"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/newsycanuse.com\/index.php\/wp-json\/wp\/v2\/tags?post=605584"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}