More than 1 million Americans died of Covid-19, and while in the early months of the pandemic the country made massive, life-altering, changes to reduce its spread, it has done very close to absolutely nothing to make sure it never happens again. (Maybe this is because of the massive, life-altering changes in the early months of the pandemic; they became unpopular enough that warnings we should avoid having another pandemic often get a hostile response.)
More directly, the US is still conducting research into making deadlier and more contagious diseases, even while there’s legitimate concern that work like that may have even caused Covid. And despite the enormous human and economic toll of the coronavirus, Congress has done little to fund the preparedness work that could blunt the effects of the next pandemic.
Taking AI seriously
I’ve been thinking about all this as AI and the possibility that sufficiently powerful systems will kill us all suddenly emerged onto center stage. An open letter signed by major figures in machine learning research, as well as by leading tech figures like Elon Musk, called for a six-month pause on building models more powerful than OpenAI’s new GPT-4. In Time magazine, AI safety absolutist Eliezer Yudkowsky argued the letter didn’t go far enough and that we need a lasting, enforced international moratorium that treats AI as more dangerous than nuclear weapons.
In a fairly stunning CBS interview last month, Geoff Hinton, a highly respected senior AI researcher, was asked by a disbelieving interviewer, “What do you think the chances are of AI just wiping out humanity?” Hinton, whose pioneering work on deep learning helped make large language models like ChatGPT possible, replied, “It’s not inconceivable.”
On March 30, Fox News correspondent Peter Doocy read a line from Yudkowsky’s Time piece to White House press secretary Karine Jean-Pierre: “‘Literally everyone on Earth will die.’ Would you agree that does not sound good?’” To nervous laughter, Jean-Pierre assured everyone that the White House has a blueprint for safe AI development.
Don’t forget biology
I’ve argued for years that sufficiently powerful AI systems might end civilization as we know it. In a sense, it’s gratifying to see that position given the mainstream hearing and open discussion that I think it deserves.
But it’s also mystifying. Research that seeks to make pathogens more powerful might also end civilization as we know it! Yet our response to that possibility has largely been a big collective shrug.
And while slowing down AI development is going to be difficult, controversial, and complicated given the sheer number of companies working on it and the potential size of the market, there are only a few labs doing dangerous gain-of-function research on pathogens of pandemic potential. That should make shutting that work down much easier — or at least, you’d think so.
Playing dice with existential risks
Ultimately — and this isn’t very satisfying at all my sense is that these fairly momentous changes in our trajectory and priorities often depend on random chance.
If by coincidence someone had happened to discover the 9/11 hijackers in time to stop them, the world we live in today would look radically different.
If by coincidence different people had been in key administration roles when Covid-19 started, we’d know a lot more about its origins and conceivably be a lot more willing to demand better lab safety policy.
And as for where the movement to slow down AI goes from here, a lot of that feels to me like it’s also up to chance. Which messages snatch public attention? Are there notable safety scares, and do they clarify the picture of what we’re up against or make it muddier?
I’d love to live in a world where how we respond to existential risk wasn’t up to chance or what happens to catch the public’s and the media’s attention, onewhere risks to the security of our whole world received sober scrutiny regardless of whether they happened to make the headlines. In practice, though, we seem to be lucky if world-altering dangerous research — whether on AI or biology — gets any public scrutiny at all.
A version of this story was initially published in the Future Perfect newsletter. Sign up here to subscribe!
rn rnvox-markrn rn rn rn rn rn“,”cross_community”:false,”groups”:[{“base_type”:”EntryGroup”,”id”:76815,”timestamp”:1680872403,”title”:”Future Perfect”,”type”:”SiteGroup”,”url”:”https://www.vox.com/future-perfect”,”slug”:”future-perfect”,”community_logo”:”rn“,”community_name”:”Vox”,”community_url”:”https://www.vox.com/”,”cross_community”:false,”entry_count”:1534,”always_show”:false,”description”:”Finding the best ways to do good. “,”disclosure”:””,”cover_image_url”:””,”cover_image”:null,”title_image_url”:”https://cdn.vox-cdn.com/uploads/chorus_asset/file/16290809/future_perfect_sized.0.jpg”,”intro_image”:null,”four_up_see_more_text”:”View All”,”primary”:true},{“base_type”:”EntryGroup”,”id”:27524,”timestamp”:1680823503,”title”:”Technology”,”type”:”SiteGroup”,”url”:”https://www.vox.com/technology”,”slug”:”technology”,”community_logo”:”rn“,”community_name”:”Vox”,”community_url”:”https://www.vox.com/”,”cross_community”:false,”entry_count”:24348,”always_show”:false,”description”:”Uncovering and explaining how our digital world is changing — and changing us.”,”disclosure”:””,”cover_image_url”:””,”cover_image”:null,”title_image_url”:””,”intro_image”:null,”four_up_see_more_text”:”View All”,”primary”:false},{“base_type”:”EntryGroup”,”id”:80311,”timestamp”:1680797143,”title”:”Artificial Intelligence”,”type”:”SiteGroup”,”url”:”https://www.vox.com/artificial-intelligence”,”slug”:”artificial-intelligence”,”community_logo”:”rn“,”community_name”:”Vox”,”community_url”:”https://www.vox.com/”,”cross_community”:false,”entry_count”:347,”always_show”:false,”description”:”Vox’s coverage of how AI is shaping everything from text and image generation to how we live. “,”disclosure”:””,”cover_image_url”:””,”cover_image”:null,”title_image_url”:””,”intro_image”:null,”four_up_see_more_text”:”View All”,”primary”:false},{“base_type”:”EntryGroup”,”id”:95604,”timestamp”:1680800406,”title”:”Coronavirus”,”type”:”SiteGroup”,”url”:”https://www.vox.com/coronavirus-covid19″,”slug”:”coronavirus-covid19″,”community_logo”:”rn“,”community_name”:”Vox”,”community_url”:”https://www.vox.com/”,”cross_community”:false,”entry_count”:2677,”always_show”:false,”description”:”Evidence-based explanations of the Covid-19 pandemic, including how it started, how it might end, and how to protect yourself and others.rn”,”disclosure”:””,”cover_image_url”:””,”cover_image”:null,”title_image_url”:””,”intro_image”:null,”four_up_see_more_text”:”View All”,”primary”:false},{“base_type”:”EntryGroup”,”id”:102794,”timestamp”:1680823503,”title”:”Innovation”,”type”:”SiteGroup”,”url”:”https://www.vox.com/innovation”,”slug”:”innovation”,”community_logo”:”rn“,”community_name”:”Vox”,”community_url”:”https://www.vox.com/”,”cross_community”:false,”entry_count”:145,”always_show”:false,”description”:””,”disclosure”:””,”cover_image_url”:””,”cover_image”:null,”title_image_url”:””,”intro_image”:null,”four_up_see_more_text”:”View All”,”primary”:false},{“base_type”:”EntryGroup”,”id”:112369,”timestamp”:1680872403,”title”:”Health”,”type”:”SiteGroup”,”url”:”https://www.vox.com/health”,”slug”:”health”,”community_logo”:”rn“,”community_name”:”Vox”,”community_url”:”https://www.vox.com/”,”cross_community”:false,”entry_count”:836,”always_show”:false,”description”:”Vox’s coverage of all things health, including personal health, public health, mental health, and more. “,”disclosure”:””,”cover_image_url”:””,”cover_image”:null,”title_image_url”:””,”intro_image”:null,”four_up_see_more_text”:”View All”,”primary”:false}],”internal_groups”:[{“base_type”:”EntryGroup”,”id”:112404,”timestamp”:1680868804,”title”:”Approach — Connects something to larger stakes”,”type”:”SiteGroup”,”url”:””,”slug”:”approach-connects-something-to-larger-stakes”,”community_logo”:”rn“,”community_name”:”Vox”,”community_url”:”https://www.vox.com/”,”cross_community”:false,”entry_count”:75,”always_show”:false,”description”:””,”disclosure”:””,”cover_image_url”:””,”cover_image”:null,”title_image_url”:””,”intro_image”:null,”four_up_see_more_text”:”View All”}],”image”:{“ratio”:”*”,”original_url”:”https://cdn.vox-cdn.com/uploads/chorus_image/image/72153224/GettyImages_1039188748.0.jpg”,”network”:”unison”,”bgcolor”:”white”,”pinterest_enabled”:false,”caption”:”An employee of the State Office for Fair Trading (LAVES) at work in a laboratory in which avian flu samples are being tested, in Oldenburg, Germany, on November 29, 2016.”,”credit”:”Carmen Jaspersen/picture alliance via Getty Image”,”focal_area”:{“top_left_x”:1473,”top_left_y”:826,”bottom_right_x”:2033,”bottom_right_y”:1386},”bounds”:[0,0,3505,2212],”uploaded_size”:{“width”:3505,”height”:2212},”focal_point”:null,”image_id”:72153224,”alt_text”:”A hand in a purple surgical glove holds a tiny vial while a pipette is inserted into a tray of small reservoirs.”},”hub_image”:{“ratio”:”*”,”original_url”:”https://cdn.vox-cdn.com/uploads/chorus_image/image/72153224/GettyImages_1039188748.0.jpg”,”network”:”unison”,”bgcolor”:”white”,”pinterest_enabled”:false,”caption”:”An employee of the State Office for Fair Trading (LAVES) at work in a laboratory in which avian flu samples are being tested, in Oldenburg, Germany, on November 29, 2016.”,”credit”:”Carmen Jaspersen/picture alliance via Getty Image”,”focal_area”:{“top_left_x”:1473,”top_left_y”:826,”bottom_right_x”:2033,”bottom_right_y”:1386},”bounds”:[0,0,3505,2212],”uploaded_size”:{“width”:3505,”height”:2212},”focal_point”:null,”image_id”:72153224,”alt_text”:”A hand in a purple surgical glove holds a tiny vial while a pipette is inserted into a tray of small reservoirs.”},”lede_image”:{“ratio”:”*”,”original_url”:”https://cdn.vox-cdn.com/uploads/chorus_image/image/72153225/GettyImages_1039188748.0.jpg”,”network”:”unison”,”bgcolor”:”white”,”pinterest_enabled”:false,”caption”:”An employee of the State Office for Fair Trading (LAVES) at work in a laboratory in which avian flu samples are being tested, in Oldenburg, Germany, on November 29, 2016.”,”credit”:”Carmen Jaspersen/picture alliance via Getty Image”,”focal_area”:{“top_left_x”:1473,”top_left_y”:826,”bottom_right_x”:2033,”bottom_right_y”:1386},”bounds”:[0,0,3505,2212],”uploaded_size”:{“width”:3505,”height”:2212},”focal_point”:null,”image_id”:72153225,”alt_text”:”A hand in a purple surgical glove holds a tiny vial while a pipette is inserted into a tray of small reservoirs.”},”group_cover_image”:null,”picture_standard_lead_image”:{“ratio”:”*”,”original_url”:”https://cdn.vox-cdn.com/uploads/chorus_image/image/72153225/GettyImages_1039188748.0.jpg”,”network”:”unison”,”bgcolor”:”white”,”pinterest_enabled”:false,”caption”:”An employee of the State Office for Fair Trading (LAVES) at work in a laboratory in which avian flu samples are being tested, in Oldenburg, Germany, on November 29, 2016.”,”credit”:”Carmen Jaspersen/picture alliance via Getty Image”,”focal_area”:{“top_left_x”:1473,”top_left_y”:826,”bottom_right_x”:2033,”bottom_right_y”:1386},”bounds”:[0,0,3505,2212],”uploaded_size”:{“width”:3505,”height”:2212},”focal_point”:null,”image_id”:72153225,”alt_text”:”A hand in a purple surgical glove holds a tiny vial while a pipette is inserted into a tray of small reservoirs.”,”picture_element”:{“html”:{},”alt”:”A hand in a purple surgical glove holds a tiny vial while a pipette is inserted into a tray of small reservoirs.”,”default”:{“srcset”:”https://cdn.vox-cdn.com/thumbor/2JCVNx-24kgTpXmUt51bbIVpm9Y=/0x0:3505×2212/320×240/filters:focal(1473×826:2033×1386)/cdn.vox-cdn.com/uploads/chorus_image/image/72153225/GettyImages_1039188748.0.jpg 320w, https://cdn.vox-cdn.com/thumbor/l9Ct1Zd7mVuk9j3mHpr0ASc-BIM=/0x0:3505×2212/620×465/filters:focal(1473×826:2033×1386)/cdn.vox-cdn.com/uploads/chorus_image/image/72153225/GettyImages_1039188748.0.jpg 620w, https://cdn.vox-cdn.com/thumbor/QRu0_QUGD1MF_gxkgfZ0y34ijvQ=/0x0:3505×2212/920×690/filters:focal(1473×826:2033×1386)/cdn.vox-cdn.com/uploads/chorus_image/image/72153225/GettyImages_1039188748.0.jpg 920w, https://cdn.vox-cdn.com/thumbor/oMZ9TyO8TAuA6K5k134uUuEXZlI=/0x0:3505×2212/1220×915/filters:focal(1473×826:2033×1386)/cdn.vox-cdn.com/uploads/chorus_image/image/72153225/GettyImages_1039188748.0.jpg 1220w, https://cdn.vox-cdn.com/thumbor/BVoMWApeMm6ndaj0u5kFGOJAa78=/0x0:3505×2212/1520×1140/filters:focal(1473×826:2033×1386)/cdn.vox-cdn.com/uploads/chorus_image/image/72153225/GettyImages_1039188748.0.jpg 1520w”,”webp_srcset”:”https://cdn.vox-cdn.com/thumbor/Yx0B0XE7T9yQTSst0DzjRHe0vb8=/0x0:3505×2212/320×240/filters:focal(1473×826:2033×1386):format(webp)/cdn.vox-cdn.com/uploads/chorus_image/image/72153225/GettyImages_1039188748.0.jpg 320w, https://cdn.vox-cdn.com/thumbor/t3CVPETvaja4UDOC2N_XJhdH6cs=/0x0:3505×2212/620×465/filters:focal(1473×826:2033×1386):format(webp)/cdn.vox-cdn.com/uploads/chorus_image/image/72153225/GettyImages_1039188748.0.jpg 620w, https://cdn.vox-cdn.com/thumbor/ryu5QUgGVXdkh3UnnzRqTGC4bjE=/0x0:3505×2212/920×690/filters:focal(1473×826:2033×1386):format(webp)/cdn.vox-cdn.com/uploads/chorus_image/image/72153225/GettyImages_1039188748.0.jpg 920w, https://cdn.vox-cdn.com/thumbor/48H8QHOJmHIalV9EVpg1z5zwi5U=/0x0:3505×2212/1220×915/filters:focal(1473×826:2033×1386):format(webp)/cdn.vox-cdn.com/uploads/chorus_image/image/72153225/GettyImages_1039188748.0.jpg 1220w, https://cdn.vox-cdn.com/thumbor/3lpPlaKSqqEKKJwg1Q708HJ6C5M=/0x0:3505×2212/1520×1140/filters:focal(1473×826:2033×1386):format(webp)/cdn.vox-cdn.com/uploads/chorus_image/image/72153225/GettyImages_1039188748.0.jpg 1520w”,”media”:null,”sizes”:”(min-width: 809px) 485px, (min-width: 600px) 60vw, 100vw”,”fallback”:”https://cdn.vox-cdn.com/thumbor/s0hesJ0k-EpX5J1f60GbAWIToJk=/0x0:3505×2212/1200×900/filters:focal(1473×826:2033×1386)/cdn.vox-cdn.com/uploads/chorus_image/image/72153225/GettyImages_1039188748.0.jpg”},”art_directed”:[]}},”image_is_placeholder”:false,”image_is_hidden”:false,”network”:”vox”,”omits_labels”:true,”optimizable”:false,”promo_headline”:”Why we’re scared of AI and not scared enough of bio risks”,”recommended_count”:0,”recs_enabled”:false,”slug”:”future-perfect/23671304/artificial-intelligence-biotechnology-covid-pandemics-existential-risks-gain-of-function”,”dek”:”What we choose to panic about has less to do with the facts and more to do with chance.”,”homepage_title”:”Why we’re scared of AI and not scared enough of bio risks”,”homepage_description”:”What we choose to panic about has less to do with the facts and more to do with chance.”,”show_homepage_description”:false,”title_display”:”Why we’re scared of AI and not scared enough of bio risks”,”pull_quote”:null,”voxcreative”:false,”show_entry_time”:true,”show_dates”:true,”paywalled_content”:false,”paywalled_content_box_logo_url”:””,”paywalled_content_page_logo_url”:””,”paywalled_content_main_url”:””,”article_footer_body”:”Since Vox launched in 2014, our audience has supported our mission in so many meaningful ways. More than 80,000 people have responded to requests to help with our reporting. Countless teachers have told us about how they’re using our work in their classroom. And in the three years since we launched the Vox Contributions program, tens of thousands of people have chipped in to help keep our unique work free. We’re committed to keeping our work free for all who need it, because we believe that high-quality explanatory journalism is a public good. We can’t rely on ads alone to do that. Will you help us keep Vox free for the next nine years by making a gift today? rn“,”article_footer_header”:”Help us celebrate nine years of Vox“,”use_article_footer”:true,”article_footer_cta_annual_plans”:”{rn “default_plan”: 1,rn “plans”: [rn {rn “amount”: 95,rn “plan_id”: 74295rn },rn {rn “amount”: 120,rn “plan_id”: 81108rn },rn {rn “amount”: 250,rn “plan_id”: 77096rn },rn {rn “amount”: 350,rn “plan_id”: 92038rn }rn ]rn}”,”article_footer_cta_button_annual_copy”:”year”,”article_footer_cta_button_copy”:”Yes, I’ll give”,”article_footer_cta_button_monthly_copy”:”month”,”article_footer_cta_default_frequency”:”annual”,”article_footer_cta_monthly_plans”:”{rn “default_plan”: 1,rn “plans”: [rn {rn “amount”: 9,rn “plan_id”: 77780rn },rn {rn “amount”: 20,rn “plan_id”: 69279rn },rn {rn “amount”: 50,rn “plan_id”: 46947rn },rn {rn “amount”: 100,rn “plan_id”: 46782rn }rn ]rn}”,”article_footer_cta_once_plans”:”{rn “default_plan”: 0,rn “plans”: [rn {rn “amount”: 20,rn “plan_id”: 69278rn },rn {rn “amount”: 50,rn “plan_id”: 48880rn },rn {rn “amount”: 100,rn “plan_id”: 46607rn },rn {rn “amount”: 250,rn “plan_id”: 46946rn }rn ]rn}”,”use_article_footer_cta_read_counter”:true,”use_article_footer_cta”:true,”featured_placeable”:false,”video_placeable”:false,”disclaimer”:null,”volume_placement”:”lede”,”video_autoplay”:false,”youtube_url”:”http://bit.ly/voxyoutube”,”facebook_video_url”:””,”play_in_modal”:true,”user_preferences_for_privacy_enabled”:false,”show_branded_logos”:true}”>
Since Vox launched in 2014, our audience has supported our mission in so many meaningful ways. More than 80,000 people have responded to requests to help with our reporting. Countless teachers have told us about how they’re using our work in their classroom. And in the three years since we launched the Vox Contributions program, tens of thousands of people have chipped in to help keep our unique work free. We’re committed to keeping our work free for all who need it, because we believe that high-quality explanatory journalism is a public good. We can’t rely on ads alone to do that. Will you help us keep Vox free for the next nine years by making a gift today?
Business seminar in Munich highlights Hong Kong's strategic roles amidst global shifts (with photos) ****************************************************************************************** The Hong Kong Economic and Trade Office, Berlin (HKETO Berlin), promoted Hong Kong's unique advantages and strategic roles at the seminar "Hong Kong's strategic role amidst geopolitical tensions" on June 18 (Munich time) in Munich, Germany. Senior executives, investors
Business Insurance-AZ achieves milestone response speeds for commercial construction bids across Arizona, accelerating documentation delivery to keep local projects moving forward without delay. Phoenix, AZ, June 06-2026, ZEX PR WIRE — Business Insurance-AZ has achieved record-breaking processing speeds and response times for commercial construction bids throughout Arizona, directly supporting the state’s massive infrastructure and advanced manufacturing boom
