Turing Award recipient and world's most cited scientist.
Working towards the safe development of AI for the benefit of all @UMontreal, @LawZero_ & @Mila_Quebec
Je suis honoré d’avoir été sélectionné par le premier ministre @MarkJCarney pour rejoindre le nouveau Conseil national sur l’intelligence artificielle, qui aura pour mission de soutenir le Gouvernement du Canada afin de rendre l’IA plus sécuritaire, protéger notre démocratie et façonner une trajectoire de l’IA plus bénéfique pour la population.
[pm.gc.ca/fr/nouvelles/commun…]
***
Honoured to have been selected by Prime Minister @MarkJCarney to join the new National Council on Artificial Intelligence, which will support the Government of Canada on making AI safer, protecting our democracy, and shaping a more beneficial AI trajectory for Canadians.
[pm.gc.ca/en/news/news-releas…]
J’étais récemment de passage au nouveau balado Hors des ondes de Patrice Roy pour échanger sur l'évolution rapide des capacités grandissantes de l’IA et les risques majeurs qui y sont asssociés. Merci @PatriceRoyTJ pour cette discussion!
Pour écouter l’entrevue complète : piped.video/WSsggkm03uE?si=Gm9q…
Automating more and more of the AI R&D could lead to AI progress radically accelerating in a very risky uncontrolled “intelligence explosion”. Many collaborators and I assess the evidence and offer policy recommendations in the paper below.
Could automating AI R&D radically accelerate AI progress in an “intelligence explosion”?
Preliminary evidence suggests that it could.
In a new paper with authors across academia, civil society, and frontier AI companies (including @dawnsongtweets@merettm@jackclarkSF@Yoshua_Bengio@geoffreyhinton ), we assess the evidence & offer policy recommendations 🧵
When I posted my blog post on the misaligned behavior of AI agents, I invited people to ask me technical questions. Watch the full Q&A here: [piped.video/2DyoSKoYoZw?si=11dB…]
I was invited to address the @UN Security Council this afternoon to discuss the unprecedented threat posed by uncontrolled frontier AI agents.
Humanity has summoned the courage and wisdom to manage catastrophic risks before. This is one of those moments, far bigger than any personal, commercial, or national interest. The choices we make about this technology today will shape generations to come. We must act now.
J’étais de passage à l’émission @OFF_TLMEP dimanche dernier pour parler de l'urgence d'encadrer l'IA face aux comportements d’agents autonomes et désalignés observés récemment et du travail @LawZero_ pour développer une nouvelle forme d’IA sécuritaire.
Même si le rythme des nouvelles sur l’IA peut parfois sembler accablant, les citoyens et les décideurs politiques ont le pouvoir d’agir. Il faut que ces enjeux soient davantage discutés publiquement.
Écouter la rediffusion : [ici.radio-canada.ca/tele/tou…]
Very encouraged to see so many countries coming together to call for mandatory pre-deployment testing & independent evaluation; global coordination on common standards; the creation of an intergovernmental organization; and other critical actions to mitigate the major risks of frontier AI.
presidentti.fi/en/a-call-for…
Je serai sur le plateau de @OFF_TLMEP ce dimanche pour parler du nouveau soutien des gouvernements canadien et allemand pour ma startup à but non lucratif @LawZero_ ainsi que des récents événements comme la cyberattaque sur l’entreprise Hugging Face qui mettent en lumière les risques de la trajectoire actuelle en IA.
Face à la course commerciale qui pousse les capacités des modèles de pointe sans garanties suffisantes, il est primordial de développer des solutions techniques et que les citoyens ainsi que les décideurs politiques se saisissent pleinement des enjeux. De là, l’importance de ces discussions.
J'ai eu le plaisir de monter sur scène aujourd'hui à ALL IN pour discuter de notre direction de recherche et de notre nouveau financement récent 🇨🇦🇩🇪. À @LawZero_, nous travaillons activement à concevoir des systèmes d’IA fondamentalement honnêtes et dignes de confiance.
Merci à @LarissaHolzki pour cette belle conversation.
I was happy to take the stage today at ALL IN for a keynote on Engineering honesty and reliability for safer AI to discuss our research agenda and recent funding 🇨🇦🇩🇪. As frontier models become more capable, we urgently need both societal governance and robust technical guardrails. At @LawZero_, we are actively working on solutions to ensure AI systems remain safely aligned with human interests.
Thank you to @LarissaHolzki for a great conversation.
Je suis très fier de ce que l'équipe de @LawZero_ est en train de mettre sur pied et je suis profondément reconnaissant du soutien sans précédent des gouvernements du Canada et de l'Allemagne, qui permettra d'alimenter notre prochaine phase de croissance!
LoiZéro a reçu un engagement de financement conjoint allant jusqu'à 300 M$ du Canada et de l'Allemagne!
Cet investissement propulsera la prochaine phase de notre recherche vers une forme fondamentalement nouvelle d’IA avancée, sécuritaire et performante.
lawzero.org/fr/nouvelles/loi…
I am very proud of what the team at @LawZero_ is building and deeply grateful for the landmark support from the Governments of Canada and Germany that will power our next phase of growth!
We are happy to share that Canada and Germany have announced funding of up to $300 million for LawZero!
This will power the next phase of our technical roadmap towards developing a fundamentally new form of advanced, safe, and capable AI.
lawzero.org/en/news/lawzero-…
Tomorrow afternoon at ALL IN, our Founder @Yoshua_Bengio will be at the LawZero booth for a fireside chat to share his thoughts on AI safety and our scientific direction!
Submit your questions ahead of the discussion: tally.so/r/yPBjY0
🛡️ New paper with @Yoshua_Bengio: “AI Safety: Not Optional, Not Later.” We propose a system-level architecture for AI safety by design. Link: arxiv.org/abs/2609.10630
Over the past few days, I've taken the time to summarize my thoughts on the recent incidents involving agents’ misaligned behavior. We don't know with certainty what comes next, but we know where these issues originate, and this can help us plan the path forward.
Please feel free to ask your questions in the replies, and I’ll try to answer some of them in the coming weeks.
yoshuabengio.org/en/publicat…
If we are to avert the worst risks from AI, we need ambitious efforts outside the for-profit sector. @coeff_giving is launching an open call for founders to build new AI safety organizations. Their grantmakers are thoughtful about which risks matter most, so if you’ve been considering starting an organization, I encourage you to apply.
Today we're launching Project Tailwind, a major call for founders to launch ambitious AI safety initiatives: coefficientgiving.org/tailwi…
We're looking for exceptional people to build the research, technologies, and institutions that will help humanity navigate the risks of transformative AI. 🧵