{"id":18781,"date":"2025-05-10T13:37:15","date_gmt":"2025-05-10T11:37:15","guid":{"rendered":"http:\/\/costops.com\/index.php\/2025\/05\/10\/ai-firms-warned-to-calculate-threat-of-super-intelligence-or-risk-it-escaping-human-control\/"},"modified":"2025-05-10T13:37:15","modified_gmt":"2025-05-10T11:37:15","slug":"ai-firms-warned-to-calculate-threat-of-super-intelligence-or-risk-it-escaping-human-control","status":"publish","type":"post","link":"http:\/\/costops.com\/index.php\/2025\/05\/10\/ai-firms-warned-to-calculate-threat-of-super-intelligence-or-risk-it-escaping-human-control\/","title":{"rendered":"AI firms warned to calculate threat of super intelligence or risk it escaping human control"},"content":{"rendered":"

AI safety campaigner calls for existential threat assessment akin to Oppenheimer\u2019s calculations before first nuclear test<\/p>\n

Artificial intelligence companies have been urged to replicate the safety calculations that underpinned Robert Oppenheimer\u2019s first nuclear test before they release all-powerful systems.<\/p>\n

Max Tegmark, a leading voice in AI safety, said he had carried out calculations akin to those of the US physicist Arthur Compton before the Trinity test and had found a 90% probability that a highly advanced AI would pose an existential threat. <\/p>\n

The US government went ahead with Trinity in 1945, after being reassured there was a vanishingly small chance of an atomic bomb igniting the atmosphere and endangering humanity.<\/p>\n

In a paper published by Tegmark and three of his students<\/a> at the Massachusetts Institute of Technology (MIT), they recommend calculating the \u201cCompton constant\u201d \u2013 defined in the paper as the probability that an all-powerful AI escapes human control. In a 1959 interview with the US writer Pearl Buck, Compton said he had approved the test after calculating the odds of a runaway fusion reaction to be \u201cslightly less\u201d than one in three million.<\/p>\n

Continue reading…<\/a>
\nAI safety campaigner calls for existential threat assessment akin to Oppenheimer\u2019s calculations before first nuclear test
\nArtificial intelligence companies have been urged to replicate the safety calculations that underpinned Robert Oppenheimer\u2019s first nuclear test before they release all-powerful systems.
\n Max Tegmark, a leading voice in AI safety, said he had carried out calculations akin to those of the US physicist Arthur Compton before the Trinity test and had found a 90% probability that a highly advanced AI would pose an existential threat.
\n The US government went ahead with Trinity in 1945, after being reassured there was a vanishingly small chance of an atomic bomb igniting the atmosphere and endangering humanity.
\nIn a paper published by Tegmark and three of his students at the Massachusetts Institute of Technology (MIT), they recommend calculating the \u201cCompton constant\u201d \u2013 defined in the paper as the probability that an all-powerful AI escapes human control. In a 1959 interview with the US writer Pearl Buck, Compton said he had approved the test after calculating the odds of a runaway fusion reaction to be \u201cslightly less\u201d than one in three million. Continue reading…Technology | The Guardian<\/p>\n","protected":false},"excerpt":{"rendered":"

AI safety campaigner calls for existential threat assessment akin to Oppenheimer\u2019s calculations before first nuclear test Artificial intelligence companies have been urged to replicate the safety calculations that underpinned Robert Oppenheimer\u2019s first nuclear test before they release all-powerful systems. Max Tegmark, a leading voice in AI safety, said he had carried out calculations akin to …<\/p>\n

AI firms warned to calculate threat of super intelligence or risk it escaping human control<\/span> Read More »<\/a><\/p>\n","protected":false},"author":0,"featured_media":18782,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[],"_links":{"self":[{"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/posts\/18781"}],"collection":[{"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/comments?post=18781"}],"version-history":[{"count":0,"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/posts\/18781\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/media\/18782"}],"wp:attachment":[{"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/media?parent=18781"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/categories?post=18781"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/tags?post=18781"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}