{"id":1140,"date":"2024-09-17T09:00:00","date_gmt":"2024-09-17T07:00:00","guid":{"rendered":"https:\/\/smalltalks.eu\/blog\/?p=1140"},"modified":"2026-10-06T11:24:05","modified_gmt":"2026-10-06T09:24:05","slug":"lia-ne-peut-pas-franchir-cette-ligne-et-nous-ne-savons-pas-pourquoi-welch-labs","status":"publish","type":"post","link":"https:\/\/smalltalks.eu\/blog\/2024\/09\/17\/lia-ne-peut-pas-franchir-cette-ligne-et-nous-ne-savons-pas-pourquoi-welch-labs\/","title":{"rendered":"L&#8217;IA ne peut pas franchir cette ligne, et nous ne savons pas pourquoi (Welch Labs)"},"content":{"rendered":"\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"AI can&amp;apos;t cross this line and we don&amp;apos;t know why.\" width=\"640\" height=\"360\" src=\"https:\/\/www.youtube.com\/embed\/5eqRuVp65eY?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<div style=\"height:30px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p class=\"wp-block-paragraph\">Aurait-on d\u00e9couvert une \u00ab loi des gaz parfaits \u00bb de l&#8217;intelligence artificielle ? Quand on trace la performance des mod\u00e8les en fonction du calcul, des donn\u00e9es et du nombre de param\u00e8tres, sur une \u00e9chelle logarithmique, tous semblent buter sur la m\u00eame droite : les lois d&#8217;\u00e9chelle.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Welch Labs retrace les articles d&#8217;OpenAI de 2020, GPT-3, l&#8217;article \u00ab Chinchilla \u00bb de DeepMind, GPT-4, et les tentatives d&#8217;explication de cette fronti\u00e8re, comme celle fond\u00e9e sur la dimension de la vari\u00e9t\u00e9 des donn\u00e9es (en anglais).<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Voir aussi : <a href=\"https:\/\/smalltalks.eu\/blog\/?p=1122\">ma m\u00e9ditation \u00ab La vie avant l&#8217;intelligence \u00bb<\/a>, <a href=\"https:\/\/smalltalks.eu\/blog\/?p=1144\">l&#8217;illusion de la pens\u00e9e<\/a>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><em>Vid\u00e9o de Welch Labs.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Aurait-on d\u00e9couvert une \u00ab loi des gaz parfaits \u00bb de l&#8217;intelligence artificielle ? Quand on trace la performance des mod\u00e8les en fonction du calcul, des donn\u00e9es et du nombre de param\u00e8tres, sur une \u00e9chelle logarithmique, tous semblent buter sur la m\u00eame droite : les lois d&#8217;\u00e9chelle. Welch Labs retrace les articles d&#8217;OpenAI de 2020, GPT-3, l&#8217;article \u00ab Chinchilla \u00bb de DeepMind, GPT-4, et les tentatives d&#8217;explication de cette fronti\u00e8re, comme celle fond\u00e9e sur la dimension de la vari\u00e9t\u00e9 des donn\u00e9es&#8230;<\/p>\n<p class=\"read-more\"><a class=\"btn btn-default\" href=\"https:\/\/smalltalks.eu\/blog\/2024\/09\/17\/lia-ne-peut-pas-franchir-cette-ligne-et-nous-ne-savons-pas-pourquoi-welch-labs\/\"> Read More<span class=\"screen-reader-text\">  Read More<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[281,110],"tags":[],"class_list":["post-1140","post","type-post","status-publish","format-standard","hentry","category-sciences-physique","category-theme-intelligence-artificielle"],"_links":{"self":[{"href":"https:\/\/smalltalks.eu\/blog\/wp-json\/wp\/v2\/posts\/1140","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/smalltalks.eu\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/smalltalks.eu\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/smalltalks.eu\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/smalltalks.eu\/blog\/wp-json\/wp\/v2\/comments?post=1140"}],"version-history":[{"count":1,"href":"https:\/\/smalltalks.eu\/blog\/wp-json\/wp\/v2\/posts\/1140\/revisions"}],"predecessor-version":[{"id":1163,"href":"https:\/\/smalltalks.eu\/blog\/wp-json\/wp\/v2\/posts\/1140\/revisions\/1163"}],"wp:attachment":[{"href":"https:\/\/smalltalks.eu\/blog\/wp-json\/wp\/v2\/media?parent=1140"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/smalltalks.eu\/blog\/wp-json\/wp\/v2\/categories?post=1140"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/smalltalks.eu\/blog\/wp-json\/wp\/v2\/tags?post=1140"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}