{"id":9209,"date":"2023-03-07T12:38:38","date_gmt":"2023-03-07T11:38:38","guid":{"rendered":"https:\/\/costops.com\/index.php\/2023\/03\/07\/techscape-will-metas-massive-leak-democratise-ai-and-at-what-cost\/"},"modified":"2023-03-07T12:38:38","modified_gmt":"2023-03-07T11:38:38","slug":"techscape-will-metas-massive-leak-democratise-ai-and-at-what-cost","status":"publish","type":"post","link":"http:\/\/costops.com\/index.php\/2023\/03\/07\/techscape-will-metas-massive-leak-democratise-ai-and-at-what-cost\/","title":{"rendered":"TechScape: Will Meta\u2019s massive leak democratise AI \u2013 and at what cost?"},"content":{"rendered":"<p>4Chan users have posted the tech giant\u2019s new ChatGPT-style language model online, putting the future of AI at a crossroads \u2013 and opening up a whole host of dangers<\/p>\n<ul>\n<li><strong><a href=\"https:\/\/ablink.editorial.theguardian.com\/ss\/c\/TBl-lE0k4WbTlFRn6v-lQXxTpTslqnvUsR2ofAkC00vqkHXqakTSxrykj9mrdACFo11SPMvm9ONAti2JcHBqUgcduObToxycReEYHcTAh6nov_u_7l464yKkl5CZpPeg-CqG3ueb-8UiDZ4dOkhK_xu6BZysaGtGOA-w2_0KTqLsMBLqZrcGelEg-7T5C6DRfMSsX1Wcyrv2RlHjbzIGx0ePxMD7meIXmznkqCFxtrflV_YvxDV9cqXgzdq7c2-9qYTW0MyIMCG7p9sc7wIKCg\/3ha\/N7031ZxvS8Cv2AmB8PHP-g\/h27\/towm4HqYM1UtQe3kzAkaoAWT_zh9HyZuTvPyJCk6JeE\">Don\u2019t get TechScape delivered to your inbox? Sign up for the full article here<\/a><\/strong><\/li>\n<\/ul>\n<p>Last week, Meta announced LLaMA, its latest stab at making a GPT-style \u201clarge language model\u201d*. If AI is the future of tech, then big tech companies need to control their own models or be left behind by the competition. LLaMA joins OpenAI\u2019s GPT (licensed by Microsoft for Bing and underpinning OpenAI\u2019s own ChatGPT) and Google\u2019s LaMDA (which will power Bard, its ChatGPT rival) in the upper echelons of the field.<\/p>\n<p>Meta\u2019s goal wasn\u2019t simply to replicate GPT. It says that LLaMA is a \u201csmaller, more performant model\u201d than its peers, built to achieve the same feats of comprehension and articulation with a smaller footprint in terms of <a href=\"https:\/\/www.theguardian.com\/technology\/2023\/feb\/28\/techscape-black-box-neural-networks-ai-acronyms\">compute<\/a>*, and so has a correspondingly smaller environmental impact. (The fact that it\u2019s cheaper to run doesn\u2019t hurt, either.)<\/p>\n<p><em>Even with all the recent advancements in large language models, full research access to them remains limited because of the resources that are required to train and run such large models. This restricted access has limited researchers\u2019 ability to understand how and why these large language models work, hindering progress on efforts to improve their robustness and mitigate known issues, such as bias, toxicity, and the potential for generating misinformation.<\/em><\/p>\n<p><em>By sharing the code for LLaMA, other researchers can more easily test new approaches to limiting or eliminating these problems in large language models.<\/em><\/p>\n<p> <a href=\"https:\/\/www.theguardian.com\/technology\/2023\/mar\/07\/techscape-meta-leak-llama-chatgpt-ai-crossroads\">Continue reading&#8230;<\/a><br \/>\n<img src=\"https:\/\/i.guim.co.uk\/img\/media\/7a733690d69eb07cc902ac86f0f49e2c68ff22f7\/0_0_6000_3600\/master\/6000.jpg?width=140&amp;quality=85&amp;auto=format&amp;fit=max&amp;s=5682513508f0b0ea60b238075fd6ff7d\" title=\"TechScape: Will Meta\u2019s massive leak democratise AI \u2013 and at what cost?\" \/>4Chan users have posted the tech giant\u2019s new ChatGPT-style language model online, putting the future of AI at a crossroads \u2013 and opening up a whole host of dangers<br \/>\nDon\u2019t get TechScape delivered to your inbox? Sign up for the full article here<br \/>\nLast week, Meta announced LLaMA, its latest stab at making a GPT-style \u201clarge language model\u201d*. If AI is the future of tech, then big tech companies need to control their own models or be left behind by the competition. LLaMA joins OpenAI\u2019s GPT (licensed by Microsoft for Bing and underpinning OpenAI\u2019s own ChatGPT) and Google\u2019s LaMDA (which will power Bard, its ChatGPT rival) in the upper echelons of the field.<br \/>\nMeta\u2019s goal wasn\u2019t simply to replicate GPT. It says that LLaMA is a \u201csmaller, more performant model\u201d than its peers, built to achieve the same feats of comprehension and articulation with a smaller footprint in terms of compute*, and so has a correspondingly smaller environmental impact. (The fact that it\u2019s cheaper to run doesn\u2019t hurt, either.)<br \/>\nEven with all the recent advancements in large language models, full research access to them remains limited because of the resources that are required to train and run such large models. This restricted access has limited researchers\u2019 ability to understand how and why these large language models work, hindering progress on efforts to improve their robustness and mitigate known issues, such as bias, toxicity, and the potential for generating misinformation.<br \/>\nBy sharing the code for LLaMA, other researchers can more easily test new approaches to limiting or eliminating these problems in large language models. Continue reading&#8230;Technology | The Guardian<\/p>\n","protected":false},"excerpt":{"rendered":"<p>4Chan users have posted the tech giant\u2019s new ChatGPT-style language model online, putting the future of AI at a crossroads \u2013 and opening up a whole host of dangers Don\u2019t get TechScape delivered to your inbox? Sign up for the full article here Last week, Meta announced LLaMA, its latest stab at making a GPT-style &hellip;<\/p>\n<p class=\"read-more\"> <a class=\"\" href=\"http:\/\/costops.com\/index.php\/2023\/03\/07\/techscape-will-metas-massive-leak-democratise-ai-and-at-what-cost\/\"> <span class=\"screen-reader-text\">TechScape: Will Meta\u2019s massive leak democratise AI \u2013 and at what cost?<\/span> Read More &raquo;<\/a><\/p>\n","protected":false},"author":0,"featured_media":9210,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[],"_links":{"self":[{"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/posts\/9209"}],"collection":[{"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/comments?post=9209"}],"version-history":[{"count":0,"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/posts\/9209\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/media\/9210"}],"wp:attachment":[{"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/media?parent=9209"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/categories?post=9209"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/costops.com\/index.php\/wp-json\/wp\/v2\/tags?post=9209"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}