{"id":10895,"date":"2023-07-25T11:39:42","date_gmt":"2023-07-25T09:39:42","guid":{"rendered":"http:\/\/costops.com\/index.php\/2023\/07\/25\/techscape-will-metas-open-source-llm-make-ai-safer-or-put-it-into-the-wrong-hands\/"},"modified":"2023-07-25T11:39:42","modified_gmt":"2023-07-25T09:39:42","slug":"techscape-will-metas-open-source-llm-make-ai-safer-or-put-it-into-the-wrong-hands","status":"publish","type":"post","link":"http:\/\/costops.com\/index.php\/2023\/07\/25\/techscape-will-metas-open-source-llm-make-ai-safer-or-put-it-into-the-wrong-hands\/","title":{"rendered":"TechScape: Will Meta\u2019s open-source LLM make AI safer \u2013 or put it into the wrong hands?"},"content":{"rendered":"

The AI arms race heats up as Meta makes a deal with Microsoft while its Cupertino competitor toils away on \u2018Apple GPT\u2019. Plus, Twitter\u2019s X-tinction<\/p>\n

\u2022 Don\u2019t get TechScape delivered to your inbox? Sign up for the full article here<\/a><\/strong><\/p>\n

The AI summer is well and truly upon us. (This gag may not play as well for readers in the southern hemisphere.) Whether we call this period the peak of the \u201chype cycle\u201d or simply the moment the curve goes vertical will only be obvious in hindsight, but the cadence of big news in the field has gone from weekly to almost daily. Let\u2019s catch up with what the biggest players in AI \u2013 Meta, Microsoft, Apple and OpenAI \u2013 are doing.<\/p>\n

Apple<\/strong><\/p>\n

The iPhone maker has built its own framework to create large language models \u2014 the AI-based systems at the heart of new offerings like ChatGPT and Google\u2019s Bard \u2013 according to people with knowledge of the efforts. With that foundation, known as \u201cAjax\u201d, Apple also has created a chatbot service that some engineers call \u201cApple GPT\u201d.<\/em><\/p>\n

In recent months, the AI push has become a major effort for Apple, with several teams collaborating on the project, said the people, who asked not to be identified because the matter is private. The work includes trying to address potential privacy concerns related to the technology.<\/em><\/p>\n

We\u2019re now ready to open source the next version of Llama 2 and are making it available free of charge for research and commercial use. We\u2019re including model weights and starting code for the pretrained model and conversational fine-tuned versions too.<\/em><\/p>\n

Starting today, Llama 2 is available in the Azure AI model catalog, enabling developers using Microsoft Azure to build with it and leverage their cloud-native tools for content filtering and safety features. It is also optimized to run locally on Windows, giving developers a seamless workflow as they bring generative AI experiences to customers across different platforms<\/em><\/p>\n

In a study titled \u201cHow is ChatGPT\u2019s behavior changing over <\/em>time?\u201d published on arXiv, Lingjiao Chen, Matei Zaharia, and James Zou, cast doubt on the consistent performance of OpenAI\u2019s large language models (LLMs), specifically GPT-3.5 and GPT-4. Using API access, they tested the March and June 2023 versions of these models on tasks like math problem-solving, answering sensitive questions, code generation, and visual reasoning. Most notably, GPT-4\u2019s ability to identify prime numbers reportedly plunged dramatically from an accuracy of 97.6 percent in March to just 2.4 percent in June. Strangely, GPT-3.5 showed improved performance in the same period.<\/em><\/p>\n

AI researcher Simon Willison also challenges the paper\u2019s conclusions. \u201cI don\u2019t find it very convincing,\u201d he told Ars. \u201cA decent portion of their criticism involves whether or not code output is wrapped in Markdown backticks or not\u201d\u2026 So far, Willison thinks that any perceived change in GPT-4\u2019s capabilities comes from the novelty of LLMs wearing off. After all, GPT-4 sparked a wave of AGI panic shortly after launch and was once tested to see if it could take over the world. Now that the technology has become more mundane, its faults seem glaring.<\/em><\/p>\n

Willison agrees. \u201cHonestly, the lack of release notes and transparency may be the biggest story here,\u201d he told Ars. \u201cHow are we meant to build dependable software on top of a platform that changes in completely undocumented and mysterious ways every few months?\u201d<\/em><\/p>\n

Continue reading…<\/a>
\nThe AI arms race heats up as Meta makes a deal with Microsoft while its Cupertino competitor toils away on \u2018Apple GPT\u2019. Plus, Twitter\u2019s X-tinction
\n\u2022 Don\u2019t get TechScape delivered to your inbox? Sign up for the full article here
\nThe AI summer is well and truly upon us. (This gag may not play as well for readers in the southern hemisphere.) Whether we call this period the peak of the \u201chype cycle\u201d or simply the moment the curve goes vertical will only be obvious in hindsight, but the cadence of big news in the field has gone from weekly to almost daily. Let\u2019s catch up with what the biggest players in AI \u2013 Meta, Microsoft, Apple and OpenAI \u2013 are doing.
\nApple
\nThe iPhone maker has built its own framework to create large language models \u2014 the AI-based systems at the heart of new offerings like ChatGPT and Google\u2019s Bard \u2013 according to people with knowledge of the efforts. With that foundation, known as \u201cAjax\u201d, Apple also has created a chatbot service that some engineers call \u201cApple GPT\u201d.
\nIn recent months, the AI push has become a major effort for Apple, with several teams collaborating on the project, said the people, who asked not to be identified because the matter is private. The work includes trying to address potential privacy concerns related to the technology.
\nWe\u2019re now ready to open source the next version of Llama 2 and are making it available free of charge for research and commercial use. We\u2019re including model weights and starting code for the pretrained model and conversational fine-tuned versions too.
\nStarting today, Llama 2 is available in the Azure AI model catalog, enabling developers using Microsoft Azure to build with it and leverage their cloud-native tools for content filtering and safety features. It is also optimized to run locally on Windows, giving developers a seamless workflow as they bring generative AI experiences to customers across different platforms
\nIn a study titled \u201cHow is ChatGPT\u2019s behavior changing over time?\u201d published on arXiv, Lingjiao Chen, Matei Zaharia, and James Zou, cast doubt on the consistent performance of OpenAI\u2019s large language models (LLMs), specifically GPT-3.5 and GPT-4. Using API access, they tested the March and June 2023 versions of these models on tasks like math problem-solving, answering sensitive questions, code generation, and visual reasoning. Most notably, GPT-4\u2019s ability to identify prime numbers reportedly plunged dramatically from an accuracy of 97.6 percent in March to just 2.4 percent in June. Strangely, GPT-3.5 showed improved performance in the same period.
\nAI researcher Simon Willison also challenges the paper\u2019s conclusions. \u201cI don\u2019t find it very convincing,\u201d he told Ars. \u201cA decent portion of their criticism involves whether or not code output is wrapped in Markdown backticks or not\u201d\u2026 So far, Willison thinks that any perceived change in GPT-4\u2019s capabilities comes from the novelty of LLMs wearing off. After all, GPT-4 sparked a wave of AGI panic shortly after launch and was once tested to see if it could take over the world. Now that the technology has become more mundane, its faults seem glaring.
\nWillison agrees. \u201cHonestly, the lack of release notes and transparency may be the biggest story here,\u201d he told Ars. \u201cHow are we meant to build dependable software on top of a platform that changes in completely undocumented and mysterious ways every few months?\u201d Continue reading…Technology | The Guardian<\/p>\n","protected":false},"excerpt":{"rendered":"

The AI arms race heats up as Meta makes a deal with Microsoft while its Cupertino competitor toils away on \u2018Apple GPT\u2019. Plus, Twitter\u2019s X-tinction \u2022 Don\u2019t get TechScape delivered to your inbox? Sign up for the full article here The AI summer is well and truly upon us. (This gag may not play as …<\/p>\n

TechScape: Will Meta\u2019s open-source LLM make AI safer \u2013 or put it into the wrong hands?<\/span> Read More »<\/a><\/p>\n","protected":false},"author":0,"featured_media":10896,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[],"_links":{"self":[{"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/posts\/10895"}],"collection":[{"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/comments?post=10895"}],"version-history":[{"count":0,"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/posts\/10895\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/media\/10896"}],"wp:attachment":[{"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/media?parent=10895"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/categories?post=10895"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/tags?post=10895"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}