Channel Title: Future of Life Institute Channel Description: The Future of Life Institute (FLI) is a nonprofit working to reduce global catastrophic and existential risk from powerful technologies. In particular, FLI focuses on risks from artificial intelligence (AI), biotechnology, and nuclear weapons. The Institute's work is made up of three main strands: grantmaking for risk reduction, educational outreach, and advocacy within the United Nations, US government and European Union institutions. FLI has become one of the world's leading voices on the governance of AI having created one of the earliest and most influential sets of governance principles: the Asilomar AI Principles. <video> Three thinkers who defined computer safety & ethics | Future of Life Award 2024 Description: As artificial intelligence development continues at breakneck speed, people worldwide - from computer experts, to lawmakers, to the general public - are increasingly concerned about the ethics and safety of this technology. The 2024 Future of Life Award honors three groundbreaking researchers and scientists who pioneered the integration of such topics into computing and AI, and helped spotlight the need to align these game-changing technologies with human values. Over the last half century, these three individuals introduced and developed the concepts that shape technology development and design to this day, from theoretical foundations, to ethical integration, to technical safety. Watch how their invaluable contributions continue to help ensure AI remains a force for good in the world. ––– Every year, the Future of Life Award honors unsung individuals whose achievements helped make today dramatically better than it might otherwise have been. Read more about this year’s award: https://futureoflife.org/award ––– See the YouTube playlist containing all previous Future of Life Awards: https://www.youtube.com/playlist?list=PLpxRpA6hBNry5na0icDwM7Tde5t6CdIQ- Why the Future of Life Award matters: https://www.youtube.com/watch?v=29StLsImVfM Our limited-series podcast ‘Imagine A World’ envisions a positive future with AI: https://www.youtube.com/playlist?list=PLpxRpA6hBNrxFgCcbC4h-nE3CZ4gvRppp </video> <video> Paris AI Safety Breakfast with Rumman Chowdhury | November 2024 Description: Description in English (Anglaise) and French (Français). — English (Anglaise) — Sign up to be notified about upcoming AI Safety Breakfasts: https://futureoflife.org/ai-safety-breakfasts/ The blog post and transcript associated with this event: https://futureoflife.org/ai-policy/breakfast-4-rumman-chowdhury/ 00:00 – Introduction 01:24 – What are you working on these days, and why do you think it’s important? 03:37 – In what manner should algorithmic auditing be performed? Could an investigative approach be made more systematic? 07:52 – How easy it is to bypass safety mitigations by a knowledgeable and persistent hacker? 16:50 – You delivered a talk called “Your Right to Repair AI Systems”. Tell us more about this right to repair and how it might be crucial in the next waves of models and systems. 25:47 – Do we have technologies that support our ability to learn and be less dependent? Or does the convenience of technology sometimes make us overreliant? 31:34 – What concrete mechanisms would you propose to ensure a global governance body remains independent and avoids capture by corporate or governmental interests? 38:34 – As an expert, is there anything you wish would become more common knowledge among policymakers, journalists, and the general public on audits? Or are there any common misconceptions about this topic that you frequently encounter and would like to address? 39:50 – What would you consider an ideal outcome for the upcoming French Summit? 42:44 – Audience Question: Is it a good idea to build more agentic AI systems? Do the benefits outweigh the risks? 48:14 – Audience Question: What do you think could be the most effective incentives for companies to identify and mitigate risks from their products? 54:09 – Audience Question: What are the main similarities and differences between AI and cybersecurity? 01:00:01 – Audience Question: With regards to auditing, how do you define or find the steps that could be wrong? 01:04:12 – Audience Question: Do you think we should have a more in-depth look at the overreliance risks that AI systems might have on individuals and society before we decide if they are safe or not? — French (Français) — Inscrivez-vous pour être informé des prochains petits-déjeuners sur la sécurité de l'IA : https://futureoflife.org/ai-safety-breakfasts/ L'article de blog et la transcription associés à cet événement : https://futureoflife.org/fr/politique-de-l-ai/breakfast-4-rumman-chowdhury/ 00:00 - Introduction 01:24 - Sur quoi travaillez-vous en ce moment et pourquoi pensez-vous que c'est important ? 03:37 - De quelle manière l'audit algorithmique doit-il être réalisé ? Une approche d'investigation peut-elle être rendue plus systématique ? 07:52 - Est-il facile de contourner les mesures d'atténuation de la sécurité par un pirate informatique bien informé et persévérant ? 16:50 - Vous avez présenté un exposé intitulé "Votre droit de réparer les systèmes d'IA". Parlez-nous de ce droit à la réparation et de la manière dont il pourrait être crucial dans les prochaines vagues de modèles et de systèmes. 25:47 - Les technologies nous aident-elles à apprendre et à être moins dépendants ? Ou bien la commodité de la technologie nous rend-elle parfois trop dépendants ? 31:34 - Quels mécanismes concrets proposeriez-vous pour garantir l'indépendance d'un organe de gouvernance mondiale et éviter qu'il ne soit accaparé par des intérêts corporatistes ou gouvernementaux ? 38:34 - En tant qu'expert, y a-t-il quelque chose que vous souhaiteriez voir devenir plus communément connu des décideurs politiques, des journalistes et du grand public en matière d'audit ? Ou y a-t-il des idées fausses sur ce sujet que vous rencontrez fréquemment et auxquelles vous aimeriez remédier ? 39:50 - Quel serait, selon vous, le résultat idéal du prochain sommet français ? 42:44 - Question du public : Est-ce une bonne idée de construire des systèmes d'IA plus agentiques ? Les avantages l'emportent-ils sur les risques ? 48:14 - Question du public : Quelles seraient, selon vous, les incitations les plus efficaces pour que les entreprises identifient et atténuent les risques liés à leurs produits ? 54:09 - Question du public : Quelles sont les principales similitudes et différences entre l'IA et la cybersécurité ? 01:00:01 - Question du public : En ce qui concerne l'audit, comment définissez-vous ou trouvez-vous les étapes qui pourraient être erronées ? 01:04:12 - Question du public : Pensez-vous que nous devrions examiner de manière plus approfondie les risques de dépendance excessive que les systèmes d'IA pourraient avoir sur les individus et la société avant de décider s'ils sont sûrs ou non ? </video> <video> The EU AI Act Newsletter #68: New Year Kickoff Description: Korea has passed the "Basic Act on the Development of Artificial Intelligence and the Establishment of Trust", becoming the second nation globally after the EU to enact comprehensive AI legislation. Legislative Process Second draft of the Code of Practice published: The second draft of the General-Purpose AI Code of Practice has been published following stakeholder consultation involving approximately 1000 participants, including EU Member States representatives and international observers. The draft was shaped by Working Group meetings held in November 2024, when participants provided feedback through verbal discussions and interactive polls. The process included 354 written submissions on the first draft and input from AI model providers through dedicated workshops. The Code serves as guidance for general-purpose AI model providers to demonstrate compliance with the AI Act throughout the lifecycles of their models. It is particularly relevant for models released after 2 August 2025, when new regulations take effect. [...] --- Outline: (00:21) Legislative Process (02:55) Analyses The original text contained 1 image which was described by AI. --- First published: January 6th, 2025 Source: https://artificialintelligenceact.substack.com/p/the-eu-ai-act-newsletter-68-new-year (https://artificialintelligenceact.substack.com/p/the-eu-ai-act-newsletter-68-new-year?utm_source=TYPE_III_AUDIO&utm_medium=Podcast&utm_content=Source+URL+in+episode+description&utm_campaign=ai_narration) --- Narrated by TYPE III AUDIO (https://type3.audio/?utm_source=TYPE_III_AUDIO&utm_medium=Podcast&utm_content=Narrated+by+TYPE+III+AUDIO&utm_term=future_of_life_institute&utm_campaign=ai_narration) . --- Images from the article: (https://substackcdn.com/image/fetch/w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F897ccbe7-47b5-463f-a98e-91c4e81a0cea_1920x1920.png) Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts (https://pocketcasts.com/) , or another podcast app. </video> <video> The EU AI Act Newsletter #64: Draft on the Scientific Panel Description: The European Commission is seeking feedback on a draft act regarding the establishment of a scientific panel of independent experts under the AI Act. Legislative Process Implementing act on scientific panel: The European Commission is seeking feedback on a draft act regarding the establishment of a scientific panel of independent experts under the AI Act. This panel will advise and assist the AI Office and national market surveillance authorities in implementing and enforcing the Act. The feedback period runs from 18 October to 15 November, lasting four weeks. All feedback received will be published on the site and must comply with established feedback rules. The collected input will be considered when finalising the initiative, which sets out rules for the establishment and operation of this panel. McNamara and Benifei to lead AI Act monitoring: Cynthia Kroet, Senior EU Policy Reporter at Euronews, reported that the European Parliament has [...] --- Outline: (00:19) Legislative Process (02:57) Analysis The original text contained 1 image which was described by AI. --- First published: October 28th, 2024 Source: https://artificialintelligenceact.substack.com/p/the-eu-ai-act-newsletter-64-draft (https://artificialintelligenceact.substack.com/p/the-eu-ai-act-newsletter-64-draft?utm_source=TYPE_III_AUDIO&utm_medium=Podcast&utm_content=Source+URL+in+episode+description&utm_campaign=ai_narration) --- Narrated by TYPE III AUDIO (https://type3.audio/?utm_source=TYPE_III_AUDIO&utm_medium=Podcast&utm_content=Narrated+by+TYPE+III+AUDIO&utm_term=future_of_life_institute&utm_campaign=ai_narration) . --- Images from the article: (https://substackcdn.com/image/fetch/w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F43646315-f1b9-4096-80b3-c9cee73ed694_1920x1536.png) Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts (https://pocketcasts.com/) , or another podcast app. </video> <video> Andrea Miotti on a Narrow Path to Safe, Transformative AI Description: Andrea Miotti joins the podcast to discuss "A Narrow Path" — a roadmap to safe, transformative AI. We talk about our current inability to precisely predict future AI capabilities, the dangers of self-improving and unbounded AI systems, how humanity might coordinate globally to ensure safe AI development, and what a mature science of intelligence would look like. Here's the document we discuss in the episode: https://www.narrowpath.co Timestamps: 00:00 A Narrow Path 06:10 Can we predict future AI capabilities? 11:10 Risks from current AI development 17:56 The benefits of narrow AI 22:30 Against self-improving AI 28:00 Cybersecurity at AI companies 33:55 Unbounded AI 39:31 Global coordination on AI safety 49:43 Monitoring training runs 01:00:20 Benefits of cooperation 01:04:58 A science of intelligence 01:25:36 How you can help </video> <video> The EU AI Act Newsletter #66: Huge Edition Description: Independent experts have presented the initial draft of the General-Purpose AI Code of Practice and consultation on AI Act prohibitions and AI system definition is now open. Legislative Process First draft of the Code of Practice available now: Independent experts have presented the initial draft of the General-Purpose AI Code of Practice, having completed the first of four drafting rounds scheduled before April 2025. This draft was discussed with approximately a thousand stakeholders, including EU Member State representatives and international observers, in dedicated working group meetings. The document, facilitated by the European AI Office, was developed by appointed Chairs and Vice-Chairs of four thematic working groups, incorporating input from general-purpose AI model providers and considering international approaches. The draft outlines guiding principles and objectives, with open questions highlighting areas for further development. The final Code will establish rules for transparency and copyright compliance for providers of general-purpose AI [...] --- Outline: (00:20) Legislative Process (04:58) Analyses (10:34) Jobs The original text contained 1 image which was described by AI. --- First published: December 2nd, 2024 Source: https://artificialintelligenceact.substack.com/p/the-eu-ai-act-newsletter-66-huge (https://artificialintelligenceact.substack.com/p/the-eu-ai-act-newsletter-66-huge?utm_source=TYPE_III_AUDIO&utm_medium=Podcast&utm_content=Source+URL+in+episode+description&utm_campaign=ai_narration) --- Narrated by TYPE III AUDIO (https://type3.audio/?utm_source=TYPE_III_AUDIO&utm_medium=Podcast&utm_content=Narrated+by+TYPE+III+AUDIO&utm_term=future_of_life_institute&utm_campaign=ai_narration) . --- Images from the article: (https://substackcdn.com/image/fetch/w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4b430ecf-66f0-4dec-88ea-073ce80c8a48_1920x1920.png) Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts (https://pocketcasts.com/) , or another podcast app. </video> <video> The EU AI Act Newsletter #65: Free Speech and National Plans Description: Ireland's Minister of State Dara Calleary has published a list of nine national public authorities responsible for protecting fundamental rights under the EU AI Act. Legislative Process Ireland publishes list of public authorities: Ireland's Minister of State Dara Calleary has published a list of nine national public authorities responsible for protecting fundamental rights under the AI Act. These authorities will receive additional powers to perform their existing responsibilities when AI poses high risks to fundamental rights, including access to mandatory documentation from AI system developers and deployers. The named authorities include An Coimisiún Toghcháin, Coimisiún na Meán, Data Protection Commission, Environmental Protection Agency, Financial Services & Pensions Ombudsman, Irish Human Rights & Equality Commission, Ombudsman, Ombudsman for Children and Ombudsman for the Defence Forces. The list fulfils Ireland's first obligation under the AI Act. Italy's approach to implementation: Luca Bertuzzi, Senior AI Correspondent at MLex, reported that [...] --- Outline: (00:20) Legislative Process (02:43) Analysis The original text contained 1 image which was described by AI. --- First published: November 12th, 2024 Source: https://artificialintelligenceact.substack.com/p/the-eu-ai-act-newsletter-65-free (https://artificialintelligenceact.substack.com/p/the-eu-ai-act-newsletter-65-free?utm_source=TYPE_III_AUDIO&utm_medium=Podcast&utm_content=Source+URL+in+episode+description&utm_campaign=ai_narration) --- Narrated by TYPE III AUDIO (https://type3.audio/?utm_source=TYPE_III_AUDIO&utm_medium=Podcast&utm_content=Narrated+by+TYPE+III+AUDIO&utm_term=future_of_life_institute&utm_campaign=ai_narration) . --- Images from the article: (https://substackcdn.com/image/fetch/w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa8865c73-45c1-47ed-811b-d3047daa55bc_1920x1920.png) Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts (https://pocketcasts.com/) , or another podcast app. </video> <video> Suzy Shepherd on Imagining Superintelligence and "Writing Doom" Description: Suzy Shepherd joins the podcast to discuss her new short film "Writing Doom", which deals with AI risk. We discuss how to use humor in film, how to write concisely, how filmmaking is evolving, in what ways AI is useful for filmmakers, and how we will find meaning in an increasingly automated world. Here's Writing Doom: https://www.youtube.com/watch?v=xfMQ7hzyFW4 Timestamps: 00:00 Writing Doom 08:23 Humor in Writing Doom 13:31 Concise writing 18:37 Getting feedback 27:02 Alternative characters 36:31 Popular video formats 46:53 AI in filmmaking 49:52 Meaning in the future </video> <video> David Dalrymple on Safeguarded, Transformative AI Description: David "davidad" Dalrymple joins the podcast to explore Safeguarded AI — an approach to ensuring the safety of highly advanced AI systems. We discuss the structure and layers of Safeguarded AI, how to formalize more aspects of the world, and how to build safety into computer hardware. You can learn more about David's work here: https://www.aria.org.uk/opportunity-spaces/mathematics-for-safe-ai/safeguarded-ai/ Timestamps: 00:00 What is Safeguarded AI? 16:28 Implementing Safeguarded AI 22:58 Can we trust Safeguarded AIs? 31:00 Formalizing more of the world 37:34 The performance cost of verified AI 47:58 Changing attitudes towards AI 52:39 Flexible‬‭ Hardware-Enabled‬‭ Guarantees 01:24:15 Mind uploading 01:36:14 Lessons from David's early life </video> <video> Connor Leahy on Why Humanity Risks Extinction from AGI Description: Connor Leahy joins the podcast to discuss the motivations of AGI corporations, how modern AI is "grown", the need for a science of intelligence, the effects of AI on work, the radical implications of superintelligence, open-source AI, and what you might be able to do about all of this. Here's the document we discuss in the episode: https://www.thecompendium.ai Timestamps: 00:00 The Compendium 15:25 The motivations of AGI corps 31:17 AI is grown, not written 52:59 A science of intelligence 01:07:50 Jobs, work, and AGI 01:23:19 Superintelligence 01:37:42 Open-source AI 01:45:07 What can we do? </video> <video> The EU AI Act Newsletter #67: More Jobs at the AI Office Description: The European Commission is currently recruiting Legal and Policy Officers for the European AI Office. Analyses Analysis of the 1st Code of Practice Draft: Yacine Jernite and Lucie-Aimée Kaffee from Hugging Face evaluated the proposed measures for AI Act Code of Practice for general-purpose AI. Jernite and Kaffee state that whilst the transparency measures are generally well-directed, requiring detailed documentation and performance evaluation, improvements are needed to increase public accessibility of information and adapt language for collaborative development settings. The copyright-related measures are deemed promising, particularly in their emphasis on stakeholder collaboration and standardisation. However, the authors raise concerns about potential fragmentation and the impact on smaller developers and copyright holders. The most significant criticism targets the proposed taxonomy of systemic risks, which is considered too narrowly focused on remote hazards whilst overlooking more immediate concerns. The authors suggest a restructured taxonomy addressing, for example, three key areas [...] --- Outline: (00:16) Analyses (07:03) Jobs The original text contained 1 image which was described by AI. --- First published: December 16th, 2024 Source: https://artificialintelligenceact.substack.com/p/the-eu-ai-act-newsletter-67-more (https://artificialintelligenceact.substack.com/p/the-eu-ai-act-newsletter-67-more?utm_source=TYPE_III_AUDIO&utm_medium=Podcast&utm_content=Source+URL+in+episode+description&utm_campaign=ai_narration) --- Narrated by TYPE III AUDIO (https://type3.audio/?utm_source=TYPE_III_AUDIO&utm_medium=Podcast&utm_content=Narrated+by+TYPE+III+AUDIO&utm_term=future_of_life_institute&utm_campaign=ai_narration) . --- Images from the article: (https://substackcdn.com/image/fetch/w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff20ff097-e46a-4d8f-a001-4b83bba7de49_1920x1440.png) Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts (https://pocketcasts.com/) , or another podcast app. </video> <video> The EU AI Act Newsletter #69: Big Tech and AI Standards Description: Corporate Europe Observatory has published an overview arguing that European AI standard-setting bodies are heavily dominated by tech industry representatives. Analysis Feedback on the second Code of Practice draft: Leverhulme Centre for Future Intelligence academics reviewed the second draft of the Code of Practice for General-Purpose AI and acknowledged significant improvements from the first version. The authors praise the balanced approach between Commitments, Measures and KPIs in establishing governance for general-purpose AI models. Their recommendations for the new draft focus on the following areas: increased attention to inference-time considerations, development of a more adaptable tiered system of obligations, stronger external assessment requirements and refinement of the framework for capabilities, propensities and context. The document also suggests methodological improvements to risk assessment, including changes to the taxonomy and more thorough AI evaluations of risk sources, alongside complementary capability-based evaluations with concrete outcome metrics and vulnerability assessments. Specific recommendations include [...] The original text contained 1 image which was described by AI. --- First published: January 20th, 2025 Source: https://artificialintelligenceact.substack.com/p/the-eu-ai-act-newsletter-69-big-tech (https://artificialintelligenceact.substack.com/p/the-eu-ai-act-newsletter-69-big-tech?utm_source=TYPE_III_AUDIO&utm_medium=Podcast&utm_content=Source+URL+in+episode+description&utm_campaign=ai_narration) --- Narrated by TYPE III AUDIO (https://type3.audio/?utm_source=TYPE_III_AUDIO&utm_medium=Podcast&utm_content=Narrated+by+TYPE+III+AUDIO&utm_term=future_of_life_institute&utm_campaign=ai_narration) . --- Images from the article: (https://substackcdn.com/image/fetch/w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F24f9d5e0-b894-4b44-861b-6ff3a29b2923_1578x1062.png) Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts (https://pocketcasts.com/) , or another podcast app. </video> <video> Nick Allardice on Using AI to Optimize Cash Transfers and Predict Disasters Description: Nick Allardice joins the podcast to discuss how GiveDirectly uses AI to target cash transfers and predict natural disasters. Learn more about Nick's work here: https://www.nickallardice.com Timestamps: 00:00 What is GiveDirectly? 15:04 AI for targeting cash transfers 29:39 AI for predicting natural disasters 46:04 How scalable is GiveDirectly's AI approach? 58:10 Decentralized vs. centralized data collection 1:04:30 Dream scenario for GiveDirectly </video> <video> Why we should build Tool AI, not AGI | Max Tegmark at WebSummit 2024 Description: Has big tech distracted the world from the existential risk of AI? Or can AI be the answer to problems we face daily? There is still a lot to learn about the potential of this accelerating technology, but are we ready for what it could be capable of? Learn more about what can be done to make AI safe: https://futureoflife.org/safety/ “Is AI the answer or the problem?” delivered on 12 November 2024 by Max Tegmark on Centre Stage at WebSummit 2024. Fireside chat hosted by Parmy Olson, Technology Columnist at Bloomberg. </video> <video> Nathan Labenz on the State of AI and Progress since GPT-4 Description: Nathan Labenz joins the podcast to provide a comprehensive overview of AI progress since the release of GPT-4. You can find Nathan's podcast here: https://www.cognitiverevolution.ai Timestamps: 00:00 AI progress since GPT-4 10:50 Multimodality 19:06 Low-cost models 27:58 Coding versus medicine/law 36:09 AI agents 45:29 How much are people using AI? 53:39 Open source 01:15:22 AI industry analysis 01:29:27 Are some AI models kept internal? 01:41:00 Money is not the limiting factor in AI 01:59:43 AI and biology 02:08:42 Robotics and self-driving 02:24:14 Inference-time compute 02:31:56 AI governance 02:36:29 Big-picture overview of AI progress and safety </video>

Contacts and Links

Description

The Future of Life Institute (FLI) is a nonprofit working to reduce global catastrophic and existential risk from powerful technologies. In particular, FLI focuses on risks from artificial intelligence (AI), biotechnology, and nuclear weapons.

The Institute's work is made up of three main strands: grantmaking for risk reduction, educational outreach, and advocacy within the United Nations, US government and European Union institutions.

FLI has become one of the world's leading voices on the governance of AI having created one of the earliest and most influential sets of governance principles: the Asilomar AI Principles.

Videos from channel