{"id":17185,"date":"2025-01-10T10:37:57","date_gmt":"2025-01-10T09:37:57","guid":{"rendered":"https:\/\/costops.com\/index.php\/2025\/01\/10\/collaborative-research-on-ai-safety-is-vital-letters\/"},"modified":"2025-01-10T10:37:57","modified_gmt":"2025-01-10T09:37:57","slug":"collaborative-research-on-ai-safety-is-vital-letters","status":"publish","type":"post","link":"http:\/\/costops.com\/index.php\/2025\/01\/10\/collaborative-research-on-ai-safety-is-vital-letters\/","title":{"rendered":"Collaborative research on AI safety is vital | Letters"},"content":{"rendered":"<p>If we are to take seriously the risk facing humanity, regulators need the power to \u2018recall\u2019 deployed models, as well as assess leading, not lagging, indicators of risk, writes <strong>Prof John McDermid<\/strong><\/p>\n<p>Re Geoffrey Hinton\u2019s concerns about the perils of artificial intelligence (<a href=\"https:\/\/www.theguardian.com\/technology\/2024\/dec\/27\/godfather-of-ai-raises-odds-of-the-technology-wiping-out-humanity-over-next-30-years\">\u2018Godfather of AI\u2019 shortens odds of the technology wiping out humanity over next 30 years, 27 December<\/a>), I\u00a0believe these concerns can best be mitigated through collaborative research on AI safety, with a role for regulators at the table.<\/p>\n<p>Currently, <a href=\"https:\/\/www.gov.uk\/government\/publications\/frontier-ai-capabilities-and-risks-discussion-paper\">frontier AI<\/a> is tested post-development using \u201cred teams\u201d who try their best to elicit a\u00a0negative outcome. This approach will never be enough; AI needs to be designed for safety and evaluation \u2013 something that can be done by drawing on expertise and experience in well-established safety-related industries.<\/p>\n<p> <a href=\"https:\/\/www.theguardian.com\/technology\/2025\/jan\/09\/collaborative-research-on-ai-safety-is-vital\">Continue reading&#8230;<\/a><br \/>\n<img src=\"https:\/\/i.guim.co.uk\/img\/media\/204a5b937ea2baaa89f1b444e1b073d0f20e9269\/0_83_4000_2400\/master\/4000.jpg?width=140&amp;quality=85&amp;auto=format&amp;fit=max&amp;s=c7d77564dc2e2f74169f968521d13f2e\" title=\"Collaborative research on AI safety is vital | Letters\" \/>If we are to take seriously the risk facing humanity, regulators need the power to \u2018recall\u2019 deployed models, as well as assess leading, not lagging, indicators of risk, writes Prof John McDermid<br \/>\nRe Geoffrey Hinton\u2019s concerns about the perils of artificial intelligence (\u2018Godfather of AI\u2019 shortens odds of the technology wiping out humanity over next 30 years, 27 December), I\u00a0believe these concerns can best be mitigated through collaborative research on AI safety, with a role for regulators at the table.<br \/>\nCurrently, frontier AI is tested post-development using \u201cred teams\u201d who try their best to elicit a\u00a0negative outcome. This approach will never be enough; AI needs to be designed for safety and evaluation \u2013 something that can be done by drawing on expertise and experience in well-established safety-related industries. Continue reading&#8230;Technology | The Guardian<\/p>\n","protected":false},"excerpt":{"rendered":"<p>If we are to take seriously the risk facing humanity, regulators need the power to \u2018recall\u2019 deployed models, as well as assess leading, not lagging, indicators of risk, writes Prof John McDermid Re Geoffrey Hinton\u2019s concerns about the perils of artificial intelligence (\u2018Godfather of AI\u2019 shortens odds of the technology wiping out humanity over next &hellip;<\/p>\n<p class=\"read-more\"> <a class=\"\" href=\"http:\/\/costops.com\/index.php\/2025\/01\/10\/collaborative-research-on-ai-safety-is-vital-letters\/\"> <span class=\"screen-reader-text\">Collaborative research on AI safety is vital | Letters<\/span> Read More &raquo;<\/a><\/p>\n","protected":false},"author":0,"featured_media":17186,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[],"_links":{"self":[{"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/posts\/17185"}],"collection":[{"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/comments?post=17185"}],"version-history":[{"count":0,"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/posts\/17185\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/media\/17186"}],"wp:attachment":[{"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/media?parent=17185"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/categories?post=17185"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/tags?post=17185"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}