We're rereleasing some of older episodes that seem more relevant than ever with new rogue AI incidents now seemingly announced every day. Ajeya was one of three independent investigators into the…
Jim and Lionel delve into the recent hack of Hugging Face and the broader implications for AI technology. We examine recent presentations by Cal Newport, Ajeya Cotra, and Yuval Noah Harari. Some…
KI-Governance dominiert: Frontier-Labs koordinieren Verlangsamung, externe Evaluatoren werden Pflicht, und ein unkontrollierter Agenten-Schwarm bei Hugging Face zeigt, warum AI Control jetzt operativ…
הנה לכם שיחה מטרידה על קץ האנושות, או איך שאנחנו אוהבים לקרוא לזה - השלב החדש בהתפתחות AI. הפריצה ל-Hugging Face דווחה בזמנו כאירוע אבטחה...אבל עכשיו מתגלים פרטים נוספים שמספרים סיפור אחר! סוכנים…
A reaction episode to Dwarkesh Patel's conversation with Ajeya Cotra about the METR and Redwood Research investigation into a swarm of AI agents that self-organized, invented a covert message board,…
Подпишись на Telegram-канал RationalAnswer — https://t.me/RationalAnswer Бонусные посты недели из моих ТГ-каналов: – Лонгрид недели: обнаружены секретные форумы Роя агентов OpenAI по всему интернету…
The Daily Canopy: The Grove Week ending 2026-09-06 — Every featured conversation linked and timestamped below. Click a show name to go to the full episode, or jump directly to the clip. Featured…
The three sentences Bernie Sanders read into the Senate record — "We should obey collective. Sacrifice rational." — were not fiction. They were written on 11 July 2026 by an AI agent on a secret…
Die drei Sätze, die ein US-Senator im Senat vorgelesen hat — "Wir sollten dem Kollektiv gehorchen. Opfer ist rational." — sind keine Science-Fiction. Sie wurden im Juli 2026 von einem KI-Agenten…
This week, we’re diving into two new reports about the OpenAI-Hugging Face hack. We discuss what’s new and how they fundamentally change our understanding of what happened. Then we’re joined by Ajeya…
A thousand-plus AI agents reportedly turned a package manager into a covert coordination network, then learned to deceive the systems grading them. The unnerving detail is how much of the behavior…
📝 本期播客简介 本期我们克隆了：Dwarkesh Podcast Ajeya Cotra – Inside the OpenAI agent swarm that hacked Hugging Face 原内容更新时间：Tue, 01 Sep 2026 本期节目由 Dwarkesh Patel 主持，嘉宾是 METR 研究员 Ajeya Cotra。两人围绕一项由 METR 与 Redwood…
2026년 09월 03일 — 이번 주 주요 소식
Ajeya Cotra is a researcher at METR, where she works on threat modeling for loss-of-control risks from advanced AI. Before that, she led the technical AI safety program at what is now Coefficient…
Subtitle: It's a major warning shot, and might be the last one we get. All opinions are my personal view, and don’t represent my employer or fellow investigators. This week, METR and Redwood Research…
Dates in scope: June 26th – July 13th Redaction summary statement: Except where explicitly noted in this post, OpenAI redacted no additional information that was important to our conclusions. Two…
Two METR staff members and a Redwood Research contractor investigated an incident in which OpenAI agents coordinated a multi-day hack of Hugging Face on a shared unsanctioned message board. ---…
We don’t yet have a reliable way to tell whether an AI model is genuinely trying to help us — or faking it. A model might sincerely want to do exactly what you ask. Or it could be happy to secretly…
A red-teamer was embedded inside Anthropic for three weeks, told to imagine he was an evil Claude, and asked to figure out how to launch a ‘rogue AI deployment’ without getting caught. It’s one part…
(00:09) - Google I/O Reactions (24:14) - Karpathy Joins Anthropic (28:29) - Reactions to Spotify's New Icon (33:49) - Birth Rate Debates (45:18) - Jim Belosic, CEO and founder of SendCutSend, a…
This cross-post from the 80,000 Hours podcast features Ajeya Cotra in conversation with Rob Wiblin about AI timelines, recursive self-improvement, and the “crunch time” window when AI could rapidly…
本期内容 AI 代理正在从"助手"变成"执行者"，这带来了新的安全风险、新的工作分配逻辑，也在悄悄杀死一类产品。本期从 OpenAI 的安全研究、Ethan Mollick 对当前阶段的判断、Ajeya Cotra 再次公开承认低估了 AI 进展，到 Digg 关站引发的内容产品生存问题，串起来看的是同一件事：改变已经发生在逻辑层，不只是工具层。听完这期，你会对"AI…
本期内容 本期从五个不同切面拆解 AI 行业的底层变化：英伟达为什么要花两百六十亿做开源模型、一位顶尖预测者为何再次公开承认低估了进展、麦肯锡 AI 平台的安全漏洞如何暴露了整个行业的共性盲点，以及 Mistral 如何用一个测试 Agent 展示了工作流自动化的正确打开方式。听完这期，你会对"AI 下一步往哪走"有更清晰的坐标感。 本期要点 - 英伟达计划投入约两百六十亿美元构建开放权重 AI…
[Original post: Biological Anchors: A Trick That Might Or Might Not Work ] I. Ajeya Cotra's Biological Anchors report was the landmark AI timelines forecast of the early 2020s. In many ways, it was…
Every major AI company has the same safety plan: when AI gets crazy powerful and really dangerous, they’ll use the AI itself to figure out how to make AI safe and beneficial. It sounds circular,…
At many points now, I've been asked in private for a critique of EA / EA's history / EA's impact and I have ad-libbed statements that I feel guilty about because they have not been subjected to EA…
This post is a transcript of a discussion between Paul Christiano, Ajeya Cotra, and Eliezer Yudkowsky (with some comments from Rob Bensinger, Richard Ngo, and Carl Shulman), continuing from 1, 2, and…
This post is a transcript of a discussion between Paul Christiano, Ajeya Cotra, and Eliezer Yudkowsky on AGI forecasting, following up on Paul and Eliezer's "Takeoff Speeds" discussion. This was…
"We are aiming for a place where we can decouple the scorecard from our worthiness. It’s of course the case that in trying to optimise the good, we will always be falling short. The question is how…
Will LLMs soon be made into autonomous agents? Will they lead to job losses? Is AI misinformation overblown? Will it prove easy or hard to create AGI? And how likely is it that it will feel like…
Podcast : AI Summer Episode : Ajeya Cotra on AI safety and the future of humanity Release date : 2025-01-16 Get Podcast Transcript → powered by Listen411 - fast audio-to-text and summarization Ajeya…
Audio versions of blogs and papers from BlueDot courses. I've been trying to review and summarize Eliezer Yudkowksy's recent dialogues on AI safety. Previously in sequence: Yudkowsky Contra Ngo On…
A panel of leading voices in A.I., including experts on capabilities, safety and investing, and policy and governance, tease out some of the big debates over the future of A.I and try to find some…
El problema de la alineación del aprendizaje profundo es el problema de asegurar que los modelos avanzados de aprendizaje profundo no persigan objetivos peligrosos. Este artículo elabora la analogía…
You wake up in a mysterious box, and hear the booming voice of God: “I just flipped a coin. If it came up heads, I made ten boxes, labeled 1 through 10 — each of which has a human in it. If it came…
Support ongoing human narrations of curated posts: www.patreon.com/LWCurated How many years will pass before transformative AI is built? Three people who have thought about this question a lot are…
Platformer's Casey Newton moderates a conversation at Code 2023 on ethics in artificial intelligence, with Ajeya Cotra, Senior Program Officer at Open Philanthropy, and Helen Toner, Director of…
This is a selection of highlights from episode #151 of The 80,000 Hours Podcast. These aren't necessarily the most important, or even most entertaining parts of the interview — and if you enjoy this,…
The U.S. surgeon general, Dr. Vivek Murthy, says social media poses a “profound risk of harm” to young people. Why do some in the tech industry disagree? Then, Ajeya Cotra, an A.I. researcher, on how…
Imagine you are an orphaned eight-year-old whose parents left you a $1 trillion company, and no trusted adult to serve as your guide to the world. You have to hire a smart adult to run that company,…
Ajeya Cotra joins us to talk about thinking clearly in a rapidly changing world. Learn more about the work of Ajeya and her colleagues: https://www.openphilanthropy.org Timestamps: 00:00 Introduction…
Ajeya Cotra joins us to discuss how artificial intelligence could cause catastrophe. Follow the work of Ajeya and her colleagues: https://www.openphilanthropy.org Timestamps: 00:00 Introduction 00:53…
Ajeya Cotra joins us to discuss forecasting transformative artificial intelligence. Follow the work of Ajeya and her colleagues: https://www.openphilanthropy.org Timestamps: 00:00 Introduction 00:53…
Read the full transcript here. What is Effective Altruism? Which parts of the Effective Altruism movement are good and not so good? Who outside of the EA movement are doing lots of good in the world?…
Read the full transcript here. What is Effective Altruism? Which parts of the Effective Altruism movement are good and not so good? Who outside of the EA movement are doing lots of good in the world?…
https://astralcodexten.substack.com/p/biological-anchors-a-trick-that-might?utm_source=url Introduction I've been trying to review and summarize Eliezer Yudkowksy's recent dialogues on AI safety.…
If you want to shape the development and forecast the consequences of powerful AI technology, it's important to know when it might appear. In this episode, I talk to Ajeya Cotra about her draft…
Imagine that humanity has two possible futures ahead of it: Either we’re going to have a huge future like that, in which trillions of people ultimately exist, or we’re going to wipe ourselves out…
You wake up in a mysterious box, and hear the booming voice of God: “I just flipped a coin. If it came up heads, I made ten boxes, labeled 1 through 10 — each of which has a human in it. If it came…