{"id":566,"date":"2023-11-26T09:00:00","date_gmt":"2023-11-26T08:00:00","guid":{"rendered":"https:\/\/smalltalks.eu\/blog\/?p=566"},"modified":"2026-09-27T17:30:57","modified_gmt":"2026-09-27T15:30:57","slug":"introduction-aux-grands-modeles-de-langage-andrej-karpathy","status":"publish","type":"post","link":"https:\/\/smalltalks.eu\/blog\/2023\/11\/26\/introduction-aux-grands-modeles-de-langage-andrej-karpathy\/","title":{"rendered":"Introduction aux grands mod\u00e8les de langage (Andrej Karpathy)"},"content":{"rendered":"\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"[1hr Talk] Intro to Large Language Models\" width=\"640\" height=\"360\" src=\"https:\/\/www.youtube.com\/embed\/zjkBMFhNj_g?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<div style=\"height:30px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p class=\"wp-block-paragraph\">En une heure, pour un public non sp\u00e9cialiste, <strong>Andrej Karpathy<\/strong> (cofondateur d&#8217;OpenAI, ancien directeur de l&#8217;IA chez Tesla) explique ce que sont les grands mod\u00e8les de langage, le composant technique au c\u0153ur de ChatGPT, Claude ou Bard : comment on les entra\u00eene, ce qu&#8217;ils font vraiment, et o\u00f9 ils vont.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Il les compare \u00e0 un nouveau type de <em>syst\u00e8me d&#8217;exploitation<\/em>, et termine par les d\u00e9fis de s\u00e9curit\u00e9 propres \u00e0 ce nouveau paradigme informatique : contournements (<em>jailbreaks<\/em>), injections de prompt, empoisonnement des donn\u00e9es.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Et une mise en garde, ajout\u00e9e par l&#8217;auteur : les \u00ab r\u00eaves \u00bb et hallucinations de ces mod\u00e8les ne sont pas corrig\u00e9s par l&#8217;affinage, qui ne fait que les orienter vers des \u00ab r\u00eaves d&#8217;assistant serviable \u00bb.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><em>Conf\u00e9rence enregistr\u00e9e en novembre 2023, en anglais (\u00ab ce domaine va vite ! \u00bb).<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>En une heure, pour un public non sp\u00e9cialiste, Andrej Karpathy (cofondateur d&#8217;OpenAI, ancien directeur de l&#8217;IA chez Tesla) explique ce que sont les grands mod\u00e8les de langage, le composant technique au c\u0153ur de ChatGPT, Claude ou Bard : comment on les entra\u00eene, ce qu&#8217;ils font vraiment, et o\u00f9 ils vont. Il les compare \u00e0 un nouveau type de syst\u00e8me d&#8217;exploitation, et termine par les d\u00e9fis de s\u00e9curit\u00e9 propres \u00e0 ce nouveau paradigme informatique : contournements (jailbreaks), injections de prompt, empoisonnement&#8230;<\/p>\n<p class=\"read-more\"><a class=\"btn btn-default\" href=\"https:\/\/smalltalks.eu\/blog\/2023\/11\/26\/introduction-aux-grands-modeles-de-langage-andrej-karpathy\/\"> Read More<span class=\"screen-reader-text\">  Read More<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[212,35,32,110],"tags":[],"class_list":["post-566","post","type-post","status-publish","format-standard","hentry","category-andrej-karpathy","category-conferences","category-theme-information-technologies","category-theme-intelligence-artificielle"],"_links":{"self":[{"href":"https:\/\/smalltalks.eu\/blog\/wp-json\/wp\/v2\/posts\/566","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/smalltalks.eu\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/smalltalks.eu\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/smalltalks.eu\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/smalltalks.eu\/blog\/wp-json\/wp\/v2\/comments?post=566"}],"version-history":[{"count":1,"href":"https:\/\/smalltalks.eu\/blog\/wp-json\/wp\/v2\/posts\/566\/revisions"}],"predecessor-version":[{"id":667,"href":"https:\/\/smalltalks.eu\/blog\/wp-json\/wp\/v2\/posts\/566\/revisions\/667"}],"wp:attachment":[{"href":"https:\/\/smalltalks.eu\/blog\/wp-json\/wp\/v2\/media?parent=566"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/smalltalks.eu\/blog\/wp-json\/wp\/v2\/categories?post=566"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/smalltalks.eu\/blog\/wp-json\/wp\/v2\/tags?post=566"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}