AI leaders (and Elon Musk) urge all labs to press pause on powerful AI

Some of the biggest names in AI are raising the alarm about their own creations. In an open letter published Tuesday, more than 1,100 signatories called for a moratorium on state-of-the-art AI development.

“We call on all AI labs to immediately pause for at least 6 months the training of AI systems more powerful than GPT-4 (including the currently-being-trained GPT-5),” reads the letter, released by the Future of Life Institute, a nonprofit that works to reduce catastrophic and existential risks. “This pause should be public and verifiable, and include all key actors. If such a pause cannot be enacted quickly, governments should step in and institute a moratorium.”

These are powerful words from powerful people. Signatories include Elon Musk, who helped co-found GPT-4 maker OpenAI before breaking with the company in 2018, along with Apple co-founder Steve Wozniak and Skype co-founder Jaan Tallinn.

More to the point, the signatories include foundational figures in artificial intelligence, including Yoshua Bengio, who pioneered the AI approach known as deep learning; Stuart Russell, a leading researcher at UC Berkeley’s Center for Human-Compatible AI; and Victoria Krakovna, a research scientist at DeepMind.

These are people who know AI. And they’re warning that society is not ready for the increasingly advanced systems that labs are racing to deploy.

There’s an understandable impulse here to eye-roll. After all, the signatories include some of the very people who are pushing out the generative AI models that the letter warns about. People like Emad Mostaque, the CEO of Stability AI, which released the text-to-image model Stable Diffusion last year.

But given the high stakes around rapid AI development, we have two options. Option one is to object, “These are the people who got us into this mess!” Option two is to object, “These are the people who got us into this mess!” — and then put pressure on them to do everything we can to stop the mess from spiraling out of control.

The letter is right to argue that there’s still a lot we can do.

We can — and should — slow down AI progress

Some people assume that we can’t slow down technological progress. Or that even if we can, we shouldn’t, because AI can bring the world so many benefits.

Both those assumptions start to fall apart when you think about them.

As I wrote in my piece laying out the case for slowing down AI, there is no technological inevitability, no law of nature, declaring that we must get GPT-5 next year and GPT-6 the year after. Which types of AI we choose to build or not build, how fast or how slow we choose to go — these are decisions that are up to us humans to make.

Although it might seem like an AI race is inevitable because of the profit and prestige incentives in the industry — and because of the geopolitical competition — all that really means is that the true challenge is to change the underlying incentive structure that drives all actors.

The open letter echoes this point. We need a moratorium on powerful AI, it says, so we have a chance to ask ourselves:

Should we let machines flood our information channels with propaganda and untruth? Should we automate away all the jobs, including the fulfilling ones? Should we develop nonhuman minds that might eventually outnumber, outsmart, obsolete and replace us? Should we risk loss of control of our civilization?

In other words: We don’t have to build robots that will steal our jobs and maybe kill us.

Slowing down a new technology is not some radical idea, destined for futility. Humanity has done this before — even with economically valuable technologies. Just think of human cloning or human germline modification. The recombinant DNA researchers behind the Asilomar Conference of 1975 famously organized a moratorium on certain experiments. Scientists definitely can modify the human germline, and they probably could engage in cloning. But with rare exceptions like the Chinese scientist He Jiankui — who was sentenced to three years in prison for his work on modifying human embryos — they don’t.

What about the other assumption — that we shouldn’t slow down AI because it can bring the world so many benefits?

The key point here is that we’ve got to strike a wise balance between potential benefits and potential risks. It doesn’t make sense to barrel ahead with developing ever-more-powerful AI without at least some measure of confidence that the risks will be manageable. And those risks aren’t just about whether advanced AI could one day pose an existential threat to humanity, but about whether they’ll change the world in ways many of us would reject. The more power the machinery has to disrupt life, the more confident we’d better be that we can handle the disruptions and think they’re worthwhile.

Exactly what we would do with a six-month pause is less clear. Congress, and the federal government more broadly, lacks deep expertise in artificial intelligence, and the unprecedented pace and power of AI makes developing standards to control it that much more difficult. But if anything, this uncertainty bolsters the case for taking a breath.

Again, this is not a radical position. Sam Altman, OpenAI’s CEO, has said as much. He recently told ABC News that he’s “a little bit scared” of the tech his company is creating, including how quickly it may replace some jobs.

“I think over a couple of generations, humanity has proven that it can adapt wonderfully to major technological shifts,” Altman said. “But if this happens in a single-digit number of years, some of these shifts … That is the part I worry about the most.”

In fact, OpenAI said in a recent statement that “At some point, it may be important to get independent review before starting to train future systems, and for the most advanced efforts to agree to limit the rate of growth of compute used for creating new models.”

The tech heavyweights who signed the open letter agree. That point, they say, is now.

rn rnvox-markrn rn rn rn rn rn“,”cross_community”:false,”groups”:[{“base_type”:”EntryGroup”,”id”:76815,”timestamp”:1680105604,”title”:”Future Perfect”,”type”:”SiteGroup”,”url”:”https://www.vox.com/future-perfect”,”slug”:”future-perfect”,”community_logo”:”rnrn rnvox-markrn rn rn rn rn rn“,”community_name”:”Vox”,”community_url”:”https://www.vox.com/”,”cross_community”:false,”entry_count”:1526,”always_show”:false,”description”:”Finding the best ways to do good. “,”disclosure”:””,”cover_image_url”:””,”cover_image”:null,”title_image_url”:”https://cdn.vox-cdn.com/uploads/chorus_asset/file/16290809/future_perfect_sized.0.jpg”,”intro_image”:null,”four_up_see_more_text”:”View All”,”primary”:true},{“base_type”:”EntryGroup”,”id”:27524,”timestamp”:1680131231,”title”:”Technology”,”type”:”SiteGroup”,”url”:”https://www.vox.com/technology”,”slug”:”technology”,”community_logo”:”rnrn rnvox-markrn rn rn rn rn rn“,”community_name”:”Vox”,”community_url”:”https://www.vox.com/”,”cross_community”:false,”entry_count”:24337,”always_show”:false,”description”:”Uncovering and explaining how our digital world is changing — and changing us.”,”disclosure”:””,”cover_image_url”:””,”cover_image”:null,”title_image_url”:””,”intro_image”:null,”four_up_see_more_text”:”View All”,”primary”:false},{“base_type”:”EntryGroup”,”id”:80311,”timestamp”:1680113528,”title”:”Artificial Intelligence”,”type”:”SiteGroup”,”url”:”https://www.vox.com/artificial-intelligence”,”slug”:”artificial-intelligence”,”community_logo”:”rnrn rnvox-markrn rn rn rn rn rn“,”community_name”:”Vox”,”community_url”:”https://www.vox.com/”,”cross_community”:false,”entry_count”:342,”always_show”:false,”description”:”Vox’s coverage of how AI is shaping everything from text and image generation to how we live. “,”disclosure”:””,”cover_image_url”:””,”cover_image”:null,”title_image_url”:””,”intro_image”:null,”four_up_see_more_text”:”View All”,”primary”:false},{“base_type”:”EntryGroup”,”id”:80357,”timestamp”:1680100204,”title”:”Emerging Tech”,”type”:”SiteGroup”,”url”:”https://www.vox.com/emerging-tech”,”slug”:”emerging-tech”,”community_logo”:”rnrn rnvox-markrn rn rn rn rn rn“,”community_name”:”Vox”,”community_url”:”https://www.vox.com/”,”cross_community”:false,”entry_count”:155,”always_show”:false,”description”:””,”disclosure”:””,”cover_image_url”:””,”cover_image”:null,”title_image_url”:””,”intro_image”:null,”four_up_see_more_text”:”View All”,”primary”:false},{“base_type”:”EntryGroup”,”id”:102794,”timestamp”:1680105604,”title”:”Innovation”,”type”:”SiteGroup”,”url”:”https://www.vox.com/innovation”,”slug”:”innovation”,”community_logo”:”rnrn rnvox-markrn rn rn rn rn rn“,”community_name”:”Vox”,”community_url”:”https://www.vox.com/”,”cross_community”:false,”entry_count”:139,”always_show”:false,”description”:””,”disclosure”:””,”cover_image_url”:””,”cover_image”:null,”title_image_url”:””,”intro_image”:null,”four_up_see_more_text”:”View All”,”primary”:false}],”internal_groups”:[{“base_type”:”EntryGroup”,”id”:112405,”timestamp”:1680105604,”title”:”Approach — Explores solutions or ideas to solve problems”,”type”:”SiteGroup”,”url”:””,”slug”:”approach-explores-solutions-or-ideas-to-solve-problems”,”community_logo”:”rnrn rnvox-markrn rn rn rn rn rn“,”community_name”:”Vox”,”community_url”:”https://www.vox.com/”,”cross_community”:false,”entry_count”:20,”always_show”:false,”description”:””,”disclosure”:””,”cover_image_url”:””,”cover_image”:null,”title_image_url”:””,”intro_image”:null,”four_up_see_more_text”:”View All”}],”image”:{“ratio”:”*”,”original_url”:”https://cdn.vox-cdn.com/uploads/chorus_image/image/72126835/GettyImages_1164575824.0.jpg”,”network”:”unison”,”bgcolor”:”white”,”pinterest_enabled”:false,”caption”:”Elon Musk speaks onstage during the the World Artificial Intelligence Conference in Shanghai on August 29, 2019.”,”credit”:”Hector Retamal/AFP via Getty Images”,”focal_area”:{“top_left_x”:2342,”top_left_y”:59,”bottom_right_x”:3232,”bottom_right_y”:949},”bounds”:[0,0,5568,3712],”uploaded_size”:{“width”:5568,”height”:3712},”focal_point”:null,”image_id”:72126835,”alt_text”:”Elon Musk sits onstage holding a microphone.”},”hub_image”:{“ratio”:”*”,”original_url”:”https://cdn.vox-cdn.com/uploads/chorus_image/image/72126835/GettyImages_1164575824.0.jpg”,”network”:”unison”,”bgcolor”:”white”,”pinterest_enabled”:false,”caption”:”Elon Musk speaks onstage during the the World Artificial Intelligence Conference in Shanghai on August 29, 2019.”,”credit”:”Hector Retamal/AFP via Getty Images”,”focal_area”:{“top_left_x”:2342,”top_left_y”:59,”bottom_right_x”:3232,”bottom_right_y”:949},”bounds”:[0,0,5568,3712],”uploaded_size”:{“width”:5568,”height”:3712},”focal_point”:null,”image_id”:72126835,”alt_text”:”Elon Musk sits onstage holding a microphone.”},”lede_image”:{“ratio”:”*”,”original_url”:”https://cdn.vox-cdn.com/uploads/chorus_image/image/72126839/GettyImages_1164575824.0.jpg”,”network”:”unison”,”bgcolor”:”white”,”pinterest_enabled”:false,”caption”:”Elon Musk speaks onstage during the the World Artificial Intelligence Conference in Shanghai on August 29, 2019.”,”credit”:”Hector Retamal/AFP via Getty Images”,”focal_area”:{“top_left_x”:2342,”top_left_y”:59,”bottom_right_x”:3232,”bottom_right_y”:949},”bounds”:[0,0,5568,3712],”uploaded_size”:{“width”:5568,”height”:3712},”focal_point”:null,”image_id”:72126839,”alt_text”:”Elon Musk sits onstage holding a microphone.”},”group_cover_image”:null,”picture_standard_lead_image”:{“ratio”:”*”,”original_url”:”https://cdn.vox-cdn.com/uploads/chorus_image/image/72126839/GettyImages_1164575824.0.jpg”,”network”:”unison”,”bgcolor”:”white”,”pinterest_enabled”:false,”caption”:”Elon Musk speaks onstage during the the World Artificial Intelligence Conference in Shanghai on August 29, 2019.”,”credit”:”Hector Retamal/AFP via Getty Images”,”focal_area”:{“top_left_x”:2342,”top_left_y”:59,”bottom_right_x”:3232,”bottom_right_y”:949},”bounds”:[0,0,5568,3712],”uploaded_size”:{“width”:5568,”height”:3712},”focal_point”:null,”image_id”:72126839,”alt_text”:”Elon Musk sits onstage holding a microphone.”,”picture_element”:{“html”:{},”alt”:”Elon Musk sits onstage holding a microphone.”,”default”:{“srcset”:”https://cdn.vox-cdn.com/thumbor/AehE4e8i1ww6nlaZ_sDcrHMFtl0=/0x0:5568×3712/320×240/filters:focal(2342×59:3232×949)/cdn.vox-cdn.com/uploads/chorus_image/image/72126839/GettyImages_1164575824.0.jpg 320w, https://cdn.vox-cdn.com/thumbor/VI0SgAFgKtHw3LYq6t49RpvYUUY=/0x0:5568×3712/620×465/filters:focal(2342×59:3232×949)/cdn.vox-cdn.com/uploads/chorus_image/image/72126839/GettyImages_1164575824.0.jpg 620w, https://cdn.vox-cdn.com/thumbor/LXjxH70_V0WIpeObgckWK1cUZTo=/0x0:5568×3712/920×690/filters:focal(2342×59:3232×949)/cdn.vox-cdn.com/uploads/chorus_image/image/72126839/GettyImages_1164575824.0.jpg 920w, https://cdn.vox-cdn.com/thumbor/R0-ds5FDtJvvwwhiFmM3c3uxDcA=/0x0:5568×3712/1220×915/filters:focal(2342×59:3232×949)/cdn.vox-cdn.com/uploads/chorus_image/image/72126839/GettyImages_1164575824.0.jpg 1220w, https://cdn.vox-cdn.com/thumbor/GSs34-yMM9r_CPCXYJEvnnPKcgw=/0x0:5568×3712/1520×1140/filters:focal(2342×59:3232×949)/cdn.vox-cdn.com/uploads/chorus_image/image/72126839/GettyImages_1164575824.0.jpg 1520w”,”webp_srcset”:”https://cdn.vox-cdn.com/thumbor/wPu3DKrKx433AWJ6Ms-dpUS1Gw0=/0x0:5568×3712/320×240/filters:focal(2342×59:3232×949):format(webp)/cdn.vox-cdn.com/uploads/chorus_image/image/72126839/GettyImages_1164575824.0.jpg 320w, https://cdn.vox-cdn.com/thumbor/B1qcERGEKemWpVVzu524Gziusy8=/0x0:5568×3712/620×465/filters:focal(2342×59:3232×949):format(webp)/cdn.vox-cdn.com/uploads/chorus_image/image/72126839/GettyImages_1164575824.0.jpg 620w, https://cdn.vox-cdn.com/thumbor/c5I6pqr4-ClJxJDLvJvFI0somL4=/0x0:5568×3712/920×690/filters:focal(2342×59:3232×949):format(webp)/cdn.vox-cdn.com/uploads/chorus_image/image/72126839/GettyImages_1164575824.0.jpg 920w, https://cdn.vox-cdn.com/thumbor/CGHjPzymsN4Z36tQRMhsSV4WGBI=/0x0:5568×3712/1220×915/filters:focal(2342×59:3232×949):format(webp)/cdn.vox-cdn.com/uploads/chorus_image/image/72126839/GettyImages_1164575824.0.jpg 1220w, https://cdn.vox-cdn.com/thumbor/2DvzIZRAJ0m2mMY_PsdElOuuclI=/0x0:5568×3712/1520×1140/filters:focal(2342×59:3232×949):format(webp)/cdn.vox-cdn.com/uploads/chorus_image/image/72126839/GettyImages_1164575824.0.jpg 1520w”,”media”:null,”sizes”:”(min-width: 809px) 485px, (min-width: 600px) 60vw, 100vw”,”fallback”:”https://cdn.vox-cdn.com/thumbor/VAq4h73pGb7OKMKgfuQmtCL1LTQ=/0x0:5568×3712/1200×900/filters:focal(2342×59:3232×949)/cdn.vox-cdn.com/uploads/chorus_image/image/72126839/GettyImages_1164575824.0.jpg”},”art_directed”:[]}},”image_is_placeholder”:false,”image_is_hidden”:false,”network”:”vox”,”omits_labels”:true,”optimizable”:false,”promo_headline”:”AI leaders (and Elon Musk) urge all labs to press pause on powerful AI”,”recommended_count”:0,”recs_enabled”:false,”slug”:”future-perfect/2023/3/29/23660833/ai-pause-musk-artificial-intelligence-moratorium-chatgpt-gpt4″,”dek”:”We got GPT-4. We could stop there for now, placing a moratorium on new AI systems more powerful than that.”,”homepage_title”:”AI leaders (and Elon Musk) urge all labs to press pause on powerful AI”,”homepage_description”:”We got GPT-4. We could stop there for now, placing a moratorium on new AI systems more powerful than that.”,”show_homepage_description”:false,”title_display”:”AI leaders (and Elon Musk) urge all labs to press pause on powerful AI”,”pull_quote”:null,”voxcreative”:false,”show_entry_time”:true,”show_dates”:true,”paywalled_content”:false,”paywalled_content_box_logo_url”:””,”paywalled_content_page_logo_url”:””,”paywalled_content_main_url”:””,”article_footer_body”:”Vox’s journalism is free because we believe that everyone deserves to understand the world that they live in. That kind of knowledge helps create better citizens, neighbors, friends, parents, consumers and stewards of this planet. In short, understanding benefits everyone. You can join in on this mission by making a financial gift to Vox today. Reader support helps keep our work free, for everyone. Will you join us? “,”article_footer_header”:”We have a request“,”use_article_footer”:true,”article_footer_cta_annual_plans”:”{rn “default_plan”: 1,rn “plans”: [rn {rn “amount”: 95,rn “plan_id”: 74295rn },rn {rn “amount”: 120,rn “plan_id”: 81108rn },rn {rn “amount”: 250,rn “plan_id”: 77096rn },rn {rn “amount”: 350,rn “plan_id”: 92038rn }rn ]rn}”,”article_footer_cta_button_annual_copy”:”year”,”article_footer_cta_button_copy”:”Yes, I’ll give”,”article_footer_cta_button_monthly_copy”:”month”,”article_footer_cta_default_frequency”:”annual”,”article_footer_cta_monthly_plans”:”{rn “default_plan”: 1,rn “plans”: [rn {rn “amount”: 9,rn “plan_id”: 77780rn },rn {rn “amount”: 20,rn “plan_id”: 69279rn },rn {rn “amount”: 50,rn “plan_id”: 46947rn },rn {rn “amount”: 100,rn “plan_id”: 46782rn }rn ]rn}”,”article_footer_cta_once_plans”:”{rn “default_plan”: 0,rn “plans”: [rn {rn “amount”: 20,rn “plan_id”: 69278rn },rn {rn “amount”: 50,rn “plan_id”: 48880rn },rn {rn “amount”: 100,rn “plan_id”: 46607rn },rn {rn “amount”: 250,rn “plan_id”: 46946rn }rn ]rn}”,”use_article_footer_cta_read_counter”:true,”use_article_footer_cta”:true,”featured_placeable”:false,”video_placeable”:false,”disclaimer”:null,”volume_placement”:”lede”,”video_autoplay”:false,”youtube_url”:”http://bit.ly/voxyoutube”,”facebook_video_url”:””,”play_in_modal”:true,”user_preferences_for_privacy_enabled”:false,”show_branded_logos”:true}”>

We have a request

Vox’s journalism is free because we believe that everyone deserves to understand the world that they live in. That kind of knowledge helps create better citizens, neighbors, friends, parents, consumers and stewards of this planet. In short, understanding benefits everyone. You can join in on this mission by making a financial gift to Vox today. Reader support helps keep our work free, for everyone. Will you join us?

$95/year

$120/year

$250/year

$350/year

Other

Yes, I’ll give $120/year

Yes, I’ll give $120/year


We accept credit card, Apple Pay, and


Google Pay. You can also contribute via



Read More
Thomas Center

Latest

Study suggests fibroid rates in Latina women may be lower than previously thought

🛡️ Just a quick check We’re checking your connection to prevent automated abuse

Rimas Entertainment Presents SONAR: ‘A Record Label Where Artists Can Develop with Freedom’

The label's roster includes Cris MJ, Yan Block, Hades66 and more. Jesús Rodríguez, head of label, SONAR SONAR / Rimas Entertainment Español Rimas Entertainment officially unveils SONAR, a record label focused on the development and projection of artists within the Latin music market, Billboard can announce exclusively today (April 29). The initiative is part of

YouTube’s Tuma Basa to Exit as Director of Black Music & Culture

MusicAfter eight years at the streaming giant, the...

Feza – Khanyisa

MusicDOWNLOAD MP3 SONG...

Newsletter

Don't miss

Study suggests fibroid rates in Latina women may be lower than previously thought

🛡️ Just a quick check We’re checking your connection to prevent automated abuse

Rimas Entertainment Presents SONAR: ‘A Record Label Where Artists Can Develop with Freedom’

The label's roster includes Cris MJ, Yan Block, Hades66 and more. Jesús Rodríguez, head of label, SONAR SONAR / Rimas Entertainment Español Rimas Entertainment officially unveils SONAR, a record label focused on the development and projection of artists within the Latin music market, Billboard can announce exclusively today (April 29). The initiative is part of

YouTube’s Tuma Basa to Exit as Director of Black Music & Culture

MusicAfter eight years at the streaming giant, the...

Feza – Khanyisa

MusicDOWNLOAD MP3 SONG...

The Vogue Business Funding Tracker

Introducing the Vogue Business Funding Tracker, a running list highlighting the most notable and intriguing investment and M&A activity in fashion and beauty. From emerging disruptors to legacy giants undergoing major changes, we spotlight the deals that are shifting the dynamics of the sectors we cover, including fashion, beauty, tech and sustainability. April 2026 Icicle

Family Business? Tee Grizzley Reacts After His Mom Accuses Him Of Leaving Her To Struggle (PHOTOS)

Y’all… it looks like some family tension might be brewing behind the scenes involving Tee Grizzley and his mom. What seemed like a regular social media post quickly turned into something deeper. And now, folks are side-eyeing the situation and wondering what’s really going on. RELATED: Tee Grizzley Shares A Message For Artists After His

SoE necessary but not sufficient, business leaders say

PE­TER CHRISTO­PHER Se­nior Mul­ti­me­dia Re­porter pe­ter.christo­pher@guardian.co.tt Heavy hand­ed but nec­es­sary giv­en the state of crime in T&T. This was a com­mon as­sess­ment from var­i­ous busi­ness groups when asked for their per­spec­tive on the lat­est de­c­la­ra­tion of a state of emer­gency in the coun­try. The T&T Cham­ber of In­dus­try and Com­merce, in a re­leased is­sued yes­ter­day