{"id":14545,"date":"2024-05-21T11:38:31","date_gmt":"2024-05-21T09:38:31","guid":{"rendered":"https:\/\/costops.com\/index.php\/2024\/05\/21\/techscape-the-people-charged-with-making-sure-ai-doesnt-destroy-humanity-have-left-the-building\/"},"modified":"2024-05-21T11:38:31","modified_gmt":"2024-05-21T09:38:31","slug":"techscape-the-people-charged-with-making-sure-ai-doesnt-destroy-humanity-have-left-the-building","status":"publish","type":"post","link":"http:\/\/costops.com\/index.php\/2024\/05\/21\/techscape-the-people-charged-with-making-sure-ai-doesnt-destroy-humanity-have-left-the-building\/","title":{"rendered":"TechScape: The people charged with making sure AI doesn\u2019t destroy humanity have left the building"},"content":{"rendered":"

If OpenAI can\u2019t keep its own team together, what hope is there for the rest of the industry? Plus, AI-generated \u2018slop\u2019 is taking over the internet<\/p>\n

\u2022 Don\u2019t get TechScape delivered to your inbox? Sign up for the full article here<\/a><\/strong><\/p>\n

Everything happens so much<\/a>. I\u2019m in Seoul for the International AI summit, the half-year follow-up to last year\u2019s Bletchley Park AI safety summit (the full sequel will be in Paris this autumn). While you read this, the first day of events will have just wrapped up \u2013 though, in keeping with the reduced fuss this time round, that was merely a \u201cvirtual\u201d leaders\u2019 meeting.<\/p>\n

When the date was set for this summit \u2013 alarmingly late in the day for, say, a journalist with two preschool children for whom four days away from home is a juggling act \u2013 it was clear that there would be a lot to cover. The hot AI summer is upon us<\/a>:<\/p>\n

The inaugural AI <\/em>safety <\/em>summit at Bletchley Park in the UK last year announced an international testing framework for AI models, after calls <\/em>\u2026 for a six-month pause in development of powerful systems.<\/em><\/p>\n

There has been no pause. The Bletchley declaration, signed by UK, US, EU, China and others, hailed the \u201cenormous global opportunities\u201d from AI but also warned of its potential for causing \u201ccatastrophic\u201d harm. It also secured a commitment from big tech firms including OpenAI, Google and Mark Zuckerberg\u2019s Meta to cooperate with governments on testing their models before they are released.<\/em><\/p>\n

A former senior employee at OpenAI has said the company behind ChatGPT is prioritising \u201cshiny products\u201d over safety, revealing that he quit after a disagreement over key aims reached \u201cbreaking point\u201d.<\/em><\/p>\n

Leike detailed the reasons for his departure in a thread on X posted on Friday, in which he said safety culture had become a lower priority. \u201cOver the past years, safety culture and processes have taken a backseat to shiny products,\u201d he wrote.<\/em><\/p>\n

I have seen the extremely restrictive off-boarding agreement that contains nondisclosure and non-disparagement provisions former OpenAI employees are subject to. It forbids them, for the rest of their lives, from criticizing their former employer. Even acknowledging that the NDA exists is a violation of it.<\/em><\/p>\n

If a departing employee declines to sign the document, or if they violate it, they can lose all vested equity they earned during their time at the company, which is likely worth millions of dollars. One former employee, Daniel <\/em>Kokotajlo<\/em>, who posted that he quit OpenAI \u201cdue to losing confidence that it would behave responsibly around the time of AGI\u201d, has confirmed publicly that he had to surrender what would have likely turned out to be a huge sum of money in order to quit without signing the document.<\/em><\/p>\n

\u201cSlop\u201d is what you get when you shove artificial intelligence-generated material up on the web for anyone to view.<\/em><\/p>\n

Unlike a chatbot, the slop isn\u2019t interactive, and is rarely intended to actually answer readers\u2019 questions or serve their needs.<\/em><\/p>\n

Continue reading…<\/a>
\nIf OpenAI can\u2019t keep its own team together, what hope is there for the rest of the industry? Plus, AI-generated \u2018slop\u2019 is taking over the internet
\n\u2022 Don\u2019t get TechScape delivered to your inbox? Sign up for the full article here
\nEverything happens so much. I\u2019m in Seoul for the International AI summit, the half-year follow-up to last year\u2019s Bletchley Park AI safety summit (the full sequel will be in Paris this autumn). While you read this, the first day of events will have just wrapped up \u2013 though, in keeping with the reduced fuss this time round, that was merely a \u201cvirtual\u201d leaders\u2019 meeting.
\nWhen the date was set for this summit \u2013 alarmingly late in the day for, say, a journalist with two preschool children for whom four days away from home is a juggling act \u2013 it was clear that there would be a lot to cover. The hot AI summer is upon us:
\nThe inaugural AI safety summit at Bletchley Park in the UK last year announced an international testing framework for AI models, after calls \u2026 for a six-month pause in development of powerful systems.
\nThere has been no pause. The Bletchley declaration, signed by UK, US, EU, China and others, hailed the \u201cenormous global opportunities\u201d from AI but also warned of its potential for causing \u201ccatastrophic\u201d harm. It also secured a commitment from big tech firms including OpenAI, Google and Mark Zuckerberg\u2019s Meta to cooperate with governments on testing their models before they are released.
\nA former senior employee at OpenAI has said the company behind ChatGPT is prioritising \u201cshiny products\u201d over safety, revealing that he quit after a disagreement over key aims reached \u201cbreaking point\u201d.
\nLeike detailed the reasons for his departure in a thread on X posted on Friday, in which he said safety culture had become a lower priority. \u201cOver the past years, safety culture and processes have taken a backseat to shiny products,\u201d he wrote.
\nI have seen the extremely restrictive off-boarding agreement that contains nondisclosure and non-disparagement provisions former OpenAI employees are subject to. It forbids them, for the rest of their lives, from criticizing their former employer. Even acknowledging that the NDA exists is a violation of it.
\nIf a departing employee declines to sign the document, or if they violate it, they can lose all vested equity they earned during their time at the company, which is likely worth millions of dollars. One former employee, Daniel Kokotajlo, who posted that he quit OpenAI \u201cdue to losing confidence that it would behave responsibly around the time of AGI\u201d, has confirmed publicly that he had to surrender what would have likely turned out to be a huge sum of money in order to quit without signing the document.
\n\u201cSlop\u201d is what you get when you shove artificial intelligence-generated material up on the web for anyone to view.
\nUnlike a chatbot, the slop isn\u2019t interactive, and is rarely intended to actually answer readers\u2019 questions or serve their needs. Continue reading…Technology | The Guardian<\/p>\n","protected":false},"excerpt":{"rendered":"

If OpenAI can\u2019t keep its own team together, what hope is there for the rest of the industry? Plus, AI-generated \u2018slop\u2019 is taking over the internet \u2022 Don\u2019t get TechScape delivered to your inbox? Sign up for the full article here Everything happens so much. I\u2019m in Seoul for the International AI summit, the half-year …<\/p>\n

TechScape: The people charged with making sure AI doesn\u2019t destroy humanity have left the building<\/span> Read More »<\/a><\/p>\n","protected":false},"author":0,"featured_media":14546,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[],"_links":{"self":[{"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/posts\/14545"}],"collection":[{"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/comments?post=14545"}],"version-history":[{"count":0,"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/posts\/14545\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/media\/14546"}],"wp:attachment":[{"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/media?parent=14545"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/categories?post=14545"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/tags?post=14545"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}