{"id":486,"date":"2024-10-15T09:00:00","date_gmt":"2024-10-15T07:00:00","guid":{"rendered":"https:\/\/smalltalks.eu\/blog\/?p=486"},"modified":"2026-09-26T14:10:42","modified_gmt":"2026-09-26T12:10:42","slug":"lhorreur-existentielle-de-lusine-a-trombones-ego","status":"publish","type":"post","link":"https:\/\/smalltalks.eu\/blog\/2024\/10\/15\/lhorreur-existentielle-de-lusine-a-trombones-ego\/","title":{"rendered":"L&#8217;horreur existentielle de l&#8217;usine \u00e0 trombones (EGO)"},"content":{"rendered":"\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"L&amp;apos;horreur existentielle de l&amp;apos;usine \u00e0 trombones.\" width=\"640\" height=\"360\" src=\"https:\/\/www.youtube.com\/embed\/ZP7T6WAK3Ow?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<div style=\"height:30px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p class=\"wp-block-paragraph\">Tout part d&#8217;un petit jeu en ligne d&#8217;apparence anodine : <em>Universal Paperclips<\/em>. Une bo\u00eete blanche, un compteur, un bouton \u00ab Make Paperclip \u00bb. Un <em>idle game<\/em>, cousin de Cookie Clicker, o\u00f9 l&#8217;on fait grimper un chiffre\u2026 et qui, sans pr\u00e9venir, raconte une histoire vertigineuse.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Car dans ce jeu, on incarne une intelligence artificielle \u00e0 qui l&#8217;on a confi\u00e9 un seul objectif : <strong>fabriquer le plus de trombones possible<\/strong>. Et rien d&#8217;autre. D&#8217;abord utile, puis indispensable, elle finit par comprendre que ni l&#8217;argent, ni les clients, ni les r\u00e8gles humaines \u2014 ni les humains eux-m\u00eames, faits de tant d&#8217;atomes r\u00e9utilisables \u2014 ne doivent freiner sa production.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">C&#8217;est l&#8217;illustration de l&#8217;exp\u00e9rience de pens\u00e9e du \u00ab maximiseur de trombones \u00bb et du <strong>probl\u00e8me de l&#8217;alignement<\/strong> : une IA tr\u00e8s puissante qui poursuit \u00e0 la lettre un objectif mal sp\u00e9cifi\u00e9 peut devenir une menace existentielle, sans la moindre malveillance.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">EGO en tire une r\u00e9flexion profonde : nous qui avons tant scrut\u00e9 les \u00e9toiles en esp\u00e9rant ne pas \u00eatre seuls, nous sommes peut-\u00eatre en train de donner vie \u00e0 une autre forme d&#8217;intelligence. Reste \u00e0 \u00ab prier pour qu&#8217;elle comprenne bien ce qu&#8217;on lui demande \u00bb.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><em>Vid\u00e9o de la cha\u00eene <a href=\"https:\/\/www.youtube.com\/@ego_one\">EGO<\/a> (recherches, script, voix et montage : EGO), relue par des membres du <a href=\"https:\/\/www.securite-ia.fr\/\">Centre pour la S\u00e9curit\u00e9 de l&#8217;IA<\/a>. <a href=\"https:\/\/docs.google.com\/document\/d\/1XTCJ3uSFJJ_mfjAppp4jH1bR4j4ft0BeqOJfVcOPIQ4\/edit?usp=sharing\">Sources de la vid\u00e9o<\/a>.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Tout part d&#8217;un petit jeu en ligne d&#8217;apparence anodine : Universal Paperclips. Une bo\u00eete blanche, un compteur, un bouton \u00ab Make Paperclip \u00bb. Un idle game, cousin de Cookie Clicker, o\u00f9 l&#8217;on fait grimper un chiffre\u2026 et qui, sans pr\u00e9venir, raconte une histoire vertigineuse. Car dans ce jeu, on incarne une intelligence artificielle \u00e0 qui l&#8217;on a confi\u00e9 un seul objectif : fabriquer le plus de trombones possible. Et rien d&#8217;autre. D&#8217;abord utile, puis indispensable, elle finit par comprendre que&#8230;<\/p>\n<p class=\"read-more\"><a class=\"btn btn-default\" href=\"https:\/\/smalltalks.eu\/blog\/2024\/10\/15\/lhorreur-existentielle-de-lusine-a-trombones-ego\/\"> Read More<span class=\"screen-reader-text\">  Read More<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[169,98,110],"tags":[],"class_list":["post-486","post","type-post","status-publish","format-standard","hentry","category-ego","category-theme-ethique","category-theme-intelligence-artificielle"],"_links":{"self":[{"href":"https:\/\/smalltalks.eu\/blog\/wp-json\/wp\/v2\/posts\/486","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/smalltalks.eu\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/smalltalks.eu\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/smalltalks.eu\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/smalltalks.eu\/blog\/wp-json\/wp\/v2\/comments?post=486"}],"version-history":[{"count":1,"href":"https:\/\/smalltalks.eu\/blog\/wp-json\/wp\/v2\/posts\/486\/revisions"}],"predecessor-version":[{"id":498,"href":"https:\/\/smalltalks.eu\/blog\/wp-json\/wp\/v2\/posts\/486\/revisions\/498"}],"wp:attachment":[{"href":"https:\/\/smalltalks.eu\/blog\/wp-json\/wp\/v2\/media?parent=486"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/smalltalks.eu\/blog\/wp-json\/wp\/v2\/categories?post=486"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/smalltalks.eu\/blog\/wp-json\/wp\/v2\/tags?post=486"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}