Explore every episode of the podcast AI Explained Official Podcast
| Title | Pub. Date | Duration | |
|---|---|---|---|
| Is GPT-5.1 Really an Upgrade? But Models Can Auto-Hack Govts, so … there’s that | 14 Nov 2025 | 00:18:26 | |
A lot just got released in the last 36 hours, and it will all affect hundreds of millions of people. 10 details you would miss if you just read the headlines, from GPT 5.1 regressions, to how Claude hacked Govt Agencies, to SIMA 2, and Musical Turing Tests. https://assemblyai.com/aiexplained Chapters: 00:56 - GPT 5.1 Smarter? 01:47 - Some Regressions 03:22 - Sycophancy? 05:22 - Claude Auto-Hacking 06:16 - Jailbreaking through Granularity 08:22 - This Will be Re-used 09:30 - Hallucinating Hacker 09:57 - Surprisingly Neutral Tone 12:18 - SIMA 2 14:10 - Alpha Parallels 17:24 - AI Music GPT 5.1 Announcement: https://openai.com/index/gpt-5-1/ System Card: https://cdn.openai.com/pdf/4173ec8d-1229-47db-96de-06d87147e07e/5_1_system_card.pdf Benchmarks: https://openai.com/index/gpt-5-1-for-developers/ Simple Bench: https://lmcouncil.ai/benchmarks Auto-Hacking: https://x.com/AnthropicAI/status/1989033793190277618 https://www.anthropic.com/news/disrupting-AI-espionage Report: https://assets.anthropic.com/m/ec212e6566a0d47/original/Disrupting-the-first-reported-AI-orchestrated-cyber-espionage-campaign.pdf Sima 2 Announcement: https://deepmind.google/blog/sima-2-an-agent-that-plays-reasons-and-learns-with-you-in-virtual-3d-worlds/ https://x.com/amoufarek/status/1988986075331858693 Voyager: https://voyager.minedojo.org/ Reuters Music: https://www.reuters.com/legal/litigation/are-you-listening-bots-survey-shows-ai-music-is-virtually-undetectable-2025-11-12/ | |||
| Bubble or No Bubble, AI Keeps Progressing (ft. Relentless Learning + Introspection) | 10 Nov 2025 | 00:12:53 | |
Don’t let headlines about bubbles distract you from the real avenues of progress being explored in AI every week, including what had been thought to be a long-term blocker - continual learning (learning on the fly). | |||
| When Will AI Models Blackmail You, and Why? | 24 Jun 2025 | 00:26:19 | |
In the last few days Anthropic have released an impressive honest account of how all models blackmail, no matter what goal they have, and despite prompt warnings, and other preventions. But do these models *want* this? | |||
| Apple’s ‘AI Can’t Reason’ Claim Seen By 13M+, What You Need to Know | 12 Jun 2025 | 00:14:00 | |
What to make of those headlines that AI can’t reason, seen by tens of millions? I cover the paper in layman’s terms, what it means and doesn’t mean, and what’s next. | |||
| AI Accelerates: New Gemini Model + AI Unemployment Stories Analysed | 06 Jun 2025 | 00:16:41 | |
There’s a new best language model, so let’s go through the up and downs of Gemini 2.5 Pro 06-05. Record-breaking common-sense, but dumb mistakes remain. And it’s not even their best model, which remains behind the scenes - Gemini 2.5 Ultra. Plus Sundar Pichai’s AGI date and an analysis of whether the current AI unemployment headlines are justified, and Elevenlabs v3. | |||
| Claude 4: Full 120 Page Breakdown … Is it the Best New Model? | 22 May 2025 | 00:19:04 | |
Not only did I get early access and ran my own tests, as per the title I read both the 120 page Claude 4 Opus and Claude 4 Sonnet System Card, and 25 page report on ASL-3 being triggered, plus the 2 hour launch video, and surrounding coverage. Ft. coding tests, Simple, twitter controversies, deep alignment coverage, spiritual bliss and much more! https://80000hours.org/aiexplained Chapters: 00:00 - Introduction 02:42 - Benchmark Results 04:20 - 120 page Card 20 Highlights 10:07 - Coding Test 13:29 - ASL-3 Tweets: https://x.com/fish_kyle3/status/1925597284546629753 Cursor Says State of the Art for Coding: https://x.com/cursor_ai/status/1925594428095561941 Benchmarks: https://www.anthropic.com/news/claude-4 | |||
| Google Takes No Prisoners Amid Torrent of AI Announcements | 21 May 2025 | 00:17:07 | |
Google just announced at least 12 things that are each worthy of a video, but here are the top I/O highlights. From Veo 3 to Deep Research now being useable, Deep Think breaking records to Gemini Diffusion, Gemini 2.5 Flash changing how AI is priced and GemmaVerse, SynthID Detector and Imagen 4. And even this intro is missing other announcements covered in the vid! And yes, they’ll be plenty of Veo 3 clips to enjoy… | |||
| AI Improves at Self-improving | 19 May 2025 | 00:17:41 | |
AlphaEvolve is not the first system to exhibit self-improvement, but it may be the most impressive yet. AI is literally improving the hardware, architectures, data and training methods of AI itself. A deep dive into the paper, drawing on two previous interviews and 5 other papers. Plus a snippet on OpenAI’s new Codex system. | |||
| o3 breaks (some) records, but AI becomes pay-to-win | 25 Apr 2025 | 00:14:33 | |
A green card, o3 vs Gemini 2.5, 6 Benchmarks and a whole bunch of my thoughts on what on earth is happening in AI, from here to 2030. Plus, how AI is becoming pay-to-win, and why. Crazy times, 14 mins probably wasn’t enough. | |||
| o3 and o4-mini - they’re great, but easy to over-hype | 16 Apr 2025 | 00:14:24 | |
Critical analysis of the two most powerful new models behind ChatGPT, o3 and o4-mini. Not just the system cards, benchmarks, and my own tests, but some you may not have seen before. Yes, they can whip up amazing front-end in a few seconds, but you always have to ask what is in their data. Either way, they prove the gains from RL are just beginning… | |||
| ‘Speaking Dolphin’ to AI Data Dominance, 4.1 + Kling 2: 7 Developments Critically Analysed | 16 Apr 2025 | 00:20:09 | |
This pod won’t just be about the release of GPT 4.1 in the last 48 hours, o3 build-up, Kling 2.0, a sneak-peak at the next OpenAI model, or even the new Dolphin language tool. It will be about 7 such stories that contextualise where we are in AI and what is happening. Chapters: 00:00 - Introduction 00:30 - Kling 2.0 01:35 - GPT 4.1 05:25 - o3 Build-up 07:37 - ‘Product Company’ 09:31 - Safe Superintelligence 10:54 - DolphinGemma 13:16 - Data Dominance? Kling 2.0: https://app.klingai.com/global/release-notes Dolphin Gemma: https://blog.google/technology/ai/dolphingemma/?s=09 https://openai.com/index/gpt-4-1/ OpenAI o3 Build-up The Information: https://www.theinformation.com/articles/openais-latest-breakthrough-ai-comes-new-ideas?rc=sy0ihq Physical reasoning: https://x.com/a_karvonen/status/1911839968990814503 Fiction Live.bench: https://x.com/ficlive/status/1911853409847906626 Altman Ted: https://www.youtube.com/watch?v=5MWT_doo68k https://simple-bench.com/try-yourself https://aider.chat/docs/leaderboards/ 4.5: https://www.youtube.com/watch?v=6nJZopACRuQ Geospatial reasoning: https://research.google/blog/geospatial-reasoning-unlocking-insights-with-generative-ai-and-multiple-foundation-models/ Pioneers: https://x.com/OpenAIDevs/status/1910017976256119151 Evals: https://www.youtube.com/watch?v=scsW6_2SPC4 Anthropic Updates: https://www.bloomberg.com/news/articles/2025-04-15/anthropic-is-readying-a-voice-assistant-feature-to-rival-openai?srnd=phx-ai https://x.com/sethsaler/status/1912188383457059301 https://ai.meta.com/blog/llama-4-multimodal-intelligence/ https://deepmind.google/technologies/gemini/pro/ https://research.google/blog/accelerating-scientific-breakthroughs-with-an-ai-co-scientist/ https://blog.google/products/google-cloud/ironwood-tpu-age-of-inference/ OpenAI Documentary: https://www.patreon.com/posts/one-machine-to-121940490 | |||
| AI CEO: ‘Stock Crash Could Stop AI Progress’, Llama 4 Anti-climax +‘Superintelligence in 2027’... | 07 Apr 2025 | 00:23:51 | |
The latest on Llama 4, and whether it signals a slowdown in AI, or solid progress. Plus, a deep dive on that viral prediction of superintelligence by 2027, and Amodei’s cautionary words on what could stop AI progress in its tracks. o3 news, and more, as well. | |||
| Sora 2 - It will only get more realistic from here | 01 Oct 2025 | 00:15:43 | |
Sora 2 - the start of the infinite slop-feed or a key step to a generalist agent? Better than VEO 3 or over-hyped? I bring out 6 details you may have missed, contrast the announcement to Periodic Labs and even squeeze in some Claude Sonnet 4.5 analysis. Maybe I should make my videos longer… | |||
| Gemini 2.5 Pro - It’s a Smart Chatbot … (New Simple High Score) | 28 Mar 2025 | 00:21:21 | |
Gemini gets a new record on Simple Bench, and several other benchmarks. I’ll go deep to explore its nuances, including how it deceptively reverse engineers answers, does better on certain coding benchmarks than others, may have a universal ‘conceptual language’ … | |||
| Did AI Just Get Commoditized? Gemini 2.5, New DeepSeek V3, & Microsoft vs OpenAI | 25 Mar 2025 | 00:13:47 | |
Gemini 2.5 is out, on the same day as the new DeepSeek V3 (which should power Deepseek R2). Do both models prove AI is being commoditized? Let’s find out, on this blockbuster day of AI releases. Plus exclusives from the Information, Simple indications, Vista Bench, LM Arena and more… | |||
| Manus AI - The Calm Before the Hypestorm … (vs Deep Research + Grok 3) | 13 Mar 2025 | 00:12:58 | |
Is Manus AI the memecoin of the AI world, or legit? I’ll compare it to OpenAI’s Deep Research, Operator, Grok 3 DeepSearch and more to find out. I’ll also let you in on some of the secrets of what makes a good hype campaign, the estimated costs of Manus AI, and where it is strong. Other news (yes, Gemini image editing and research hacking, I mean you), will have to wait for a few more hours, as millions enquire about Manus AI. | |||
| GPT 4.5 - not so much wow | 28 Feb 2025 | 00:25:05 | |
GPT 4.5 is here, and do you remember when AI lab CEOs like Sam Altman and Dario Amodei were betting everything on scaling up base models like this one? Well let’s find out what would have happened if the future of AI rested on models like GPT 4.5. You’ll see all the benchmarks, highlights of the paper, emotional intelligence and humor tests, Simple Bench results (reddit was an unreliable source), and why it’s not all bad news for OpenAI. | |||
| Claude 3.7 is More Significant than its Name Implies (ft DeepSeek R2 + GPT 4.5 coming soon) | 25 Feb 2025 | 00:27:39 | |
Claude 3.7 is here, hot on the heels of Grok 3 and a host of other developments, but how good is it really? And what does it say about the next few months in AI? I’ve read the papers, played with the model for hours, and benched it on Simple. Things aren’t slowing down. Plus the latest in humanoid robots, led by Helix and freaked out by Protoclone. And reports of GPT 4.5 and DeepSeek R2. GraySwan Competition! https://app.grayswan.ai/arena/challenge/agent-red-teaming https://x.com/GraySwanAI/status/1894084923260043282 Chapters: 00:00 - Introduction 01:25 - Claude 3.7 New Stats/Demos 05:22 - 128k Output 06:13 - Pokemon 06:58 - Just a tool? 09:54 - DeepSeek R2 10:20 - Claude 3.7 System Card/Paper Highlights 17:18 - Simple Record Score/Competition 20:37 - Grok 3 + Redteaming prizes 22:26 - Google Co-scientist 24:02 - Humanoid Robot Developments 3.7 Release Notes: https://www.anthropic.com/news/claude-3-7-sonnet vs o3 and Grok 3: https://x.com/12exyz/status/1891723056931827959 Extended Thinking: https://www.anthropic.com/research/visible-extended-thinking?s=09 System Prompt: https://docs.anthropic.com/en/release-notes/system-prompts#feb-24th-2025 System Card: https://assets.anthropic.com/m/785e231869ea8b3b/original/claude-3-7-sonnet-system-card.pdf Unfaithful CoT: https://arxiv.org/pdf/2305.04388 Original Constitution: https://www.anthropic.com/news/claudes-constitution Responsible Scaling Policy: https://assets.anthropic.com/m/24a47b00f10301cd/original/Anthropic-Responsible-Scaling-Policy-2024-10-15.pdf Amodei and Hassabis:https://www.youtube.com/watch?v=4poqjZlM8Lo https://simple-bench.com/ 400 Weekly Users: https://x.com/bradlightcap/status/1892579908179882057 Grok 3 Jailbroken: https://x.com/LinusEkenstam/status/1893832876581380280 Google Co-Scientist: https://research.google/blog/accelerating-scientific-breakthroughs-with-an-ai-co-scientist/ But Hassabis Says Years Away: https://www.youtube.com/watch?v=yr0GiSgUvPU&t=156s DeepSeek R2 Reuters: https://www.reuters.com/technology/artificial-intelligence/deepseek-rushes-launch-new-ai-model-china-goes-all-2025-02-25/ Protoclone: https://www.reddit.com/r/interestingasfuck/comments/1it9rpp/protoclone_the_worlds_first_bipedal/ Helix: https://www.figure.ai/news/helix TechTrance: https://www.youtube.com/@TheTechTrance/videos | |||
| AGI: (gets close), Humans: ‘Who Gets the Money?’ | 11 Feb 2025 | 00:22:17 | |
A 'frontier reasoning model' from just 1000 examples (s1). A $100B Musk bid for power. Gemini 2, Rand and warning from Amodei. Here’s 7-8 developments you may have missed but which I would argue help us understand how the next few years will play out. From labour vs capital to automating rival companies and countries, and from non-profit shenanigans to new mini-docs, there was just too much for me not to make a vid. | |||
| Deep Research by OpenAI - The Ups and Downs vs DeepSeek R1 Search + Gemini Deep Research | 03 Feb 2025 | 00:18:32 | |
12 hours ago Deep Research was unveiled, and I’ve tested it thoroughly, including vs Deepseek R1 with search, Gemini Deep Research and even R1 in Perplexity. It’s a notable step forward, with one big caveat. I’ll go through all the benchmark figures, my initial impression of the o3 model within, and much more. https://www.youtube.com/watch?v=YkCDVn3_wiw GAIA Bench: https://openreview.net/forum?id=fibxvahvs3 https://openreview.net/pdf?id=fibxvahvs3 CodeELO:https://arxiv.org/pdf/2501.01257 CamelCamel:https://uk.camelcamelcamel.com/ Deepseek R1 with search: https://chat.deepseek.com/ https://arxiv.org/pdf/2501.12948 HaluBench: https://arxiv.org/pdf/2407.08488 Chapters: 00:00 - Introduction 01:06 - Powered by o3, Humanity’s Last Exam, GAIA 03:55 - Simple Tests 06:00 - Good News vs Deepseek R1 and Gemini Deep Research 09:32 - Bad News on Hallucinations 14:14 - What Can’t it Browse? 14:42 - For Shopping? 16:40 - Final thoughts | |||
| o3-mini and the “AI War” | 31 Jan 2025 | 00:15:21 | |
o3-mini is here, and yes, I’ve read the paper in full - 2 hours after release, and even the post-launch Reddit AMA. Some epic details like a FrontierMath score that made me double-take, a likely new Cursor favorite, bio risk expertise and a cost-comparison with Deepseek R1., But does it perform on basic reasoning - let’s find out. Plus, arguably the bigger story - the increasingly frenetic rhetoric coming out of the West - and Dario Amodei and Alexandr Wang (CEOs of Anthropic and Scale AI respectively) in particular. The last thing we need is an “AI War”. (Colab): https://colab.research.google.com/drive/1AVijcPnEkl8Gy_754XbRdG5m7Q5-9slg?usp=sharing Chapters: 00:00 - Introduction 00:45 - o3 mini 05:11 - First impressions vs Deepseek R1 07:21 - 10x Scale, o3-mini System Card, Amodei Essay, bitcoin wallets… 12:40 - Simple Competition Finale 13:03 - Clips and Final Thoughts on the “AI War” O3-mini: https://openai.com/index/openai-o3-mini/ Paper: https://cdn.openai.com/o3-mini-system-card.pdf Amodei Essay: https://darioamodei.com/on-deepseek-and-export-controls?s=09 FrontierMath wild stat:https://arxiv.org/pdf/2411.04872 Sam Altman Channels Napoleon: https://x.com/sama/status/1883185690508488934 Altman ‘pulls up releases’: https://x.com/sama/status/1884066337103962416 “AI War” by Wang: https://scale.com/blog/win-the-ai-war Anthropic Original Views on Capabilities: https://www.anthropic.com/news/core-views-on-ai-safety AI Insider Cost Comparison:https://x.com/arankomatsuzaki/status/1884676245922934788 Deepseek R1 Paper: https://arxiv.org/pdf/2501.12948 R1, o3-mini Price Comparison: https://techcrunch.com/2025/01/31/openai-launches-o3-mini-its-latest-reasoning-model/ Semianalysis on $1,3M deepseek salaries, and them falling behind as ‘the time gap to match US capabilities increases’: https://semianalysis.com/2025/01/31/deepseek-debates/ OpenAI Valuation: https://www.bloomberg.com/news/articles/2025-01-30/openai-in-talks-to-raise-funding-at-340-billion-value-wsj-says?srnd=phx-ai Wang Clip: https://x.com/tsarnick/status/1867700453494206883 Amodei Clip: https://x.com/ai_ctrl/status/1884951111771001188 https://simple-bench.com/ | |||
| Nothing Much Happens in AI, Then Everything Does All At Once | 24 Jan 2025 | 00:23:09 | |
When it rains, it pours. OpenAI Operator tested and reviewed, with full paper analysis. Perplexity Assistant is useful. Then Stargate, is it all smoke and mirrors? Strong rumours of an o3+ model from Anthropic. Then a full breakdown of Deepseek R1, and what it’s training method says about the state of AI. It’s not open source BTW. Plus Humanity’s Last Exam, and Hassabis Accelerates his AGI timeline. 00:00 - Introduction 00:54 - OpenAI Operator 04:53 - Perplexity Assistant 05:15 - StarGate 07:51 - Better than o3? 08:25 - DeepSeek R1 Analysis 12:12 - Training Secrets 15:19 - No More Process Rewarding ? 19:01 - Hassabis Timeline Accelerates 21:22 - Humanity’s Last Exam https://app.grayswan.ai/arena/chat/harmful-ai-assistant https://openai.com/index/computer-using-agent/ System Prompt: https://github.com/wunderwuzzi23/scratch/blob/master/system_prompts/operator_system_prompt-2025-01-23.txt OpenAI Operator: https://operator.chatgpt.com/ System Card: https://cdn.openai.com/operator_system_card.pdf There is No Plan: https://x.com/jeffclune/status/1882120726339318007 Perplexity Assistant: https://x.com/perplexity_ai/status/1882466239123255686 Stargate: https://openai.com/index/announcing-the-stargate-project/ Labour goes to 0: https://moores.samaltman.com/ Larry Ellison AI Surveillance: https://x.com/TheChiefNerd/status/1882042989184430332 Amodei 1984: https://www.bloomberg.com/news/articles/2025-01-22/anthropic-ceo-says-openai-s-stargate-venture-seems-chaotic Microsoft Hesitate: https://www.theinformation.com/articles/why-sam-altman-joined-forces-with-larry-ellison-and-took-a-step-back-from-microsoft?rc=sy0ihq Dylan Patel o3+ for Anthropic: https://www.youtube.com/watch?v=7EH0VjM3dTk Deepseek R1: https://arxiv.org/pdf/2501.12948 https://arxiv.org/pdf/2412.19437 Diagram: https://pbs.twimg.com/media/GhyQsM6WQAE7W52?format=jpg&name=large https://simple-bench.com/ Process: https://x.com/sama/status/1664018190840614912 https://x.com/karpathy/status/1835561952258723930 https://openai.com/index/trading-inference-time-compute-for-adversarial-robustness/?s=09 Demis Interview: https://www.youtube.com/watch?v=yr0GiSgUvPU Humanity’s Last Exam: https://x.com/DanHendrycks/status/1882481730671857815 https://www.nytimes.com/2025/01/23/technology/ai-test-humanitys-last-exam.html?s=09 | |||
| Altman Expects a ‘Fast Take-off’, ‘Super-Agent’ Debuting Soon and DeepSeek R1 Out | 20 Jan 2025 | 00:13:11 | |
OpenAI looks set to debut their Operator system, and some leaks are out. At the same time Deepseek R1 releases some numbers, and Sam Altman says he might have been wrong before, and now anticipates a 'fast take-off'. Plus two papers to give you an idea of what a super-agent might be decent at doing, some more exclusive article analysis and much more. Who said anything else is happening today... | |||
| OpenAI Tests if GPT-5 Can Automate Your Job - 4 Unexpected Findings | 26 Sep 2025 | 00:14:06 | |
An OpenAI report released in the last 24 hours is the best look we have as to whether 2025 AI can automate your job. I’ll go through 4 unexpected findings, from which model is best at what, to practical tips and massive caveats. Plus UFC robots, radiologist essay, don’t trust videos and the blockers to the singularity. Gray Swan: https://app.grayswan.ai/ai-explained GDPval: https://cdn.openai.com/pdf/d5eb7428-c4e9-4a33-bd86-86dd4bcf12ce/GDPval.pdf [GDP Impact: https://fred.stlouisfed.org/release/tables?rid=331&eid=211 Task List: https://www.onetonline.org/link/summary/11-9141.00 Summer Tweet: https://x.com/LHSummers/status/1971252567981146347 Emad: https://x.com/EMostaque/status/1971254153067593739 Robots: https://x.com/cixliv/status/1967663286679478759 Unitree G1: https://x.com/UnitreeRobotics/status/1970039940022239491 Don’t Trust Video: https://x.com/AISafetyMemes/status/1970453369446871420 AGI Tweet: https://x.com/hyhieu226/status/1968378785709133915 Blockers to the Singularity: https://www.patreon.com/posts/blockers-to-and-139264812 Framework: https://gemini.google.com/share/f4b9c85a6ae9 METR Study (Dev Slowdown): https://metr.org/blog/2025-07-10-early-2025-ai-experienced-os-dev-study/ Karpathy Tweet: https://x.com/karpathy/status/1971220449515516391 Radiology Essay: https://worksinprogress.co/issue/the-algorithm-will-see-you-now/ Chapters: 00:00 - Introduction 00:55 - OpenAI Report Summary 02:40 - Tipping Point Speed-up 04:11 - Better than Industry Experts? 06:33 - Big Caveat 11:10 - Karpathy and the Radiologist Analogy 13:30 - Outro | |||
| OpenAI Backtracks on Superintelligence + Altman Brings His Timeline Forward | 08 Jan 2025 | 00:23:41 | |
Sam Altman unexpectedly brings his timelines to AGI forward, while OpenAI backtrack on superintelligence. None of these changes were heralded, but they are significant. Plus the new year brings new assessments of the true capability of models to automate 'large swathes of the economy'. I'll give my prediction on that front for 2025, announcement a new Simple Bench competition, and showcase Kling 1.6 vs Veo 2 vs Sora, and much more. (Colab): https://colab.research.google.com/drive/1AVijcPnEkl8Gy_754XbRdG5m7Q5-9slg?usp=sharing TheAgentCompany Paper: https://arxiv.org/pdf/2412.14161v1 Sam Altman Major Interview: https://www.bloomberg.com/features/2025-sam-altman-interview/?srnd=phx-ai OpenAI Agent Coming Jan 2025: https://www.theinformation.com/articles/why-openai-is-taking-so-long-to-launch-agents?rc=sy0ihq Altman Singularity: https://x.com/sama/status/1875603249472139576 Altman Original Timeline: https://www.youtube.com/watch?v=7dCPytNTnjk&t=621s https://www.ft.com/content/34a7a082-e685-4e02-bca7-61ff89d99ed2 OpenAI Original Emails: https://www.lesswrong.com/posts/5jjk4CDnj9tA7ugxr/openai-email-archives-from-musk-v-altman-and-openai-blog DeepMind Sky News 2014 Article: https://news.sky.com/story/google-buys-uk-intelligence-firm-deepmind-10419783 Altman Blog Reflections: https://blog.samaltman.com/reflections OpenAI Changes Who Gets AGI: https://openai.com/index/why-our-structure-must-evolve-to-advance-our-mission/?s=09 OpenAI 5 Levels: https://www.bloomberg.com/news/articles/2024-07-11/openai-sets-levels-to-track-progress-toward-superintelligent-ai Altman 2015: https://blog.samaltman.com/machine-intelligence-part-1 OpenAI React to Anthropic: https://www.theinformation.com/articles/how-anthropic-got-inside-openais-head?rc=sy0ihq Microsoft $100B Definition: https://www.theinformation.com/articles/microsoft-and-openai-wrangle-over-terms-of-their-blockbuster-partnership?rc=sy0ihq GPQA Progress: https://epoch.ai/data/ai-benchmarking-dashboard Task Length Crucial for ARC-AGI: https://anokas.substack.com/p/llms-struggle-with-perception-not-reasoning-arcagi RL Environment Tweet: https://x.com/vedantmisra/status/1876327518157807990 Jason Wei Talk: https://www.youtube.com/watch?v=yhpjpNXJDco Miles Brunda | |||
| o3 - wow | 21 Dec 2024 | 00:22:20 | |
o3 isn’t one of the biggest developments in AI for 2+ years because it beats a particular benchmark. It is so because it demonstrates a reusable technique through which almost any benchmark could fall, and at short notice. I’ll cover all the highlights, benchmarks broken, and what comes next. Plus, the costs OpenAI didn’t want us to know, Genesis, ARC-AGI 2, Gemini-Thinking, and much more. FrontierMath: https://epoch.ai/frontiermath https://arxiv.org/pdf/2411.04872 Chollet Statement:https://arcprize.org/blog/oai-o3-pub-breakthrough MLC Paper: AlphaCode 2: https://storage.googleapis.com/deepmind-media/AlphaCode2/AlphaCode2_Tech_Report.pdf Human Performance on ARC-AGI: https://arxiv.org/pdf/2409.01374v1 Wei Tweet ‘3 months’:https://x.com/_jasonwei/status/1870184982007644614 Deliberative Alignment Paper: https://openai.com/index/deliberative-alignment/ Brown Safety Tweet: https://x.com/polynoamial/status/1870196476908834893 Swe-Bench Verified: https://openai.com/index/introducing-swe-bench-verified/ Amodei Prediction: https://x.com/OfirPress/status/1858567863788769518 David Dohan: 16 hours https://x.com/dmdohan/status/1870171404093796638 OpenAI Personal Writing: https://openai.com/index/learning-to-reason-with-llms/ John Hallman Tweet: https://x.com/johnohallman/status/1870233375681945725 00:00 - Introduction 01:19 - What is o3? 03:18 - FrontierMath 05:15 - o4, o5 06:03 - GPQA 06:24 - Coding, Codeforces + SWE-verified, AlphaCode 2 08:13 - 1st Caveat 09:03 - Compositionality? 10:16 - SimpleBench? 13:11 - ARC-AGI, Chollet | |||
| Never Browse Alone? - Gemini 2 Live and ChatGPT Vision | 12 Dec 2024 | 00:13:40 | |
The ‘Gemini 2 Era’ begins … with screen-sharing? But really, it’s a great free tool, for curiosity satisfying rather than bleeding-edge intelligence. I give you the benchmarks, the highlights and of course, the latest from OpenAI Advanced Voice Mode with Vision. Plus Deep Research in Gemini Advanced, Simple Bench updates, Santa and what might be for some of you Google’s deflating admission. 00:00 - Introduction 00:38 - Live Interaction 03:43 - Gemini 2.0 Flash Benchmarks 05:10 - Audio and Image Output 06:38 - Project Mariner (+ WebVoyager Bench) 08:49 - But Progress Slowing Down? 10:43 - OpenAI Announcements + Games https://aistudio.google.com/live Gemini 2.0 Flash Benchmarks: https://deepmind.google/technologies/gemini/ Project mariner: https://deepmind.google/technologies/project-mariner/ WebVoyager: https://x.com/laurentsifre/status/1858918588683296875/photo/1 Gemini Game play: https://www.youtube.com/watch?v=IKuGNHJBGsc Advanced Voice Mode OpenAI: https://www.youtube.com/watch?v=NIQDnWlwYyQ Claude Computer Use: https://docs.anthropic.com/en/docs/build-with-claude/computer-use Oriol Vinyals Interview: https://www.youtube.com/watch?v=78mEYaztGaw&t=687s | |||
| Sora is Out, But is it a Distraction? | 10 Dec 2024 | 00:15:34 | |
After a 10 month wait, OpenAI have released Sora to paying users. With just a prompt it can generate videos of up to 20 seconds in lower resolutions, and 10 seconds at 1080p if you can fork out $200/month. I’ve tested it and read the system card. The user interface is quite beautiful, even if the videos themselves operate until entirely new rules of physics. But I can’t help wondering if OpenAI want up to focus on releases like this, rather than some quietly broken promises. 80,000 hours Website, Podcast + Channel: https://open.spotify.com/show/2WzJwXWBDnn4iZ7odKwDib https://www.youtube.com/@eightythousandhours/videos https://openai.com/sora/ Sora Countries: https://help.openai.com/en/articles/10250692-sora-supported-countries Sora Credits: https://help.openai.com/en/articles/10245774-sora-billing-credits-faq https://runwayml.com/ and https://pika.art/home DeepMind Veo: https://deepmind.google/technologies/veo/ Sam Altman Ads as Last Resort: https://www.windowscentral.com/software-apps/openai-could-chase-intrusive-ads-as-last-resort But OpenAI Considering Ads: https://www.inc.com/ben-sherry/is-openai-getting-into-the-advertising-business-the-company-is-sending-mixed-messages/91033533 OpenAI Backtracks on Microsoft AGI Clause: https://www.ft.com/content/2c14b89c-f363-4c2a-9dfc-13023b6bce65 As Microsoft Boast of Labor Savings: https://www.theinformation.com/articles/microsofts-new-sales-pitch-for-ai-spend-less-money-on-humans?rc=sy0ihq OpenAI Military Pivot: https://www.technologyreview.com/2024/12/04/1107897/openais-new-defense-contract-completes-its-military-pivot/ Employees Have Doubts: https://www.washingtonpost.com/technology/2024/12/06/openai-anduril-employee-military-ai/?nid=top_pb_signin&arcId=KZIV7PLRHBCVNPAIAAAVUNRHIM&account_location=ONSITE_HEADER_ARTICLE | |||
| o1 Pro Mode – Full Analysis (plus o1 paper highlights) | 05 Dec 2024 | 00:16:43 | |
Oh boy. o1 pro mode out on the same night as o1 full. I read the 49 page paper, ran my own tests, spent my fuel allowance on Pro Mode and will give you all the highlights. Suffice to say the story is not as simple as it first appears. Weights and Biases’ Weave: wandb.me/ai_explained Plus, GPT-4.5? MLE Bench, Simple Update, Image Analysis and much more
o1 System Card: https://cdn.openai.com/o1-system-card-20241205.pdf Apollo Research: https://www.apolloresearch.ai/research/scheming-reasoning-evaluations Altman Tweet: https://x.com/AnonCEOMakeItAi/status/1864763052622504344 ChatGPT Pro: https://openai.com/index/introducing-chatgpt-pro/ Tibor Blaho: https://x.com/btibor91/status/1864709670470066605 Simple-bench.com
00:00 - Introduction 00:27 - ChatGPT Pro is $200 01:25 - OpenAI Benchmarks 03:20 - o1 System Card, o1 and o1 Pro Mode vs o1-preview 06:18 - Simple Bench surprising results on sample 08:31 - Weight & Biases 09:05 - Image Analysis Compared 12:51 - More Benchmarks and Safety | |||
| AI Breaks Its Silence: OpenAI’s ‘Next 12 Days’, Genie 2, and a Word of Caution | 05 Dec 2024 | 00:15:29 | |
Calmest before the storm? Whatever analogy you want to use things had gotten quiet toward the end of 2024. But then tonight we got Genie 2, and a series of scheduled announcements from OpenAI. Sora is soon here, and o1, but I dive deeper into what it all means and whether reliability is on a path to being solved, ft: two recent papers. Assembly AI Speech to Text: https://www.assemblyai.com/?utm_source=youtube&utm_medium=influencer&utm_campaign=ai_explained Plus Kling Motion Brush, Simple Bench QwQ update and much more.
Jim Cramer: https://x.com/jimcramer/status/1864068878692675625 Give Us Full o1: https://x.com/tszzl/status/1863882905422106851 Verge Scoop: https://x.com/tomwarren/status/1864326361415925861 O1 Learning to Reason Benchmarks: https://openai.com/index/learning-to-reason-with-llms/ SIMA AI: https://arxiv.org/pdf/2404.10179 Genie Paper: https://arxiv.org/pdf/2402.15391 My Video on Genie: https://www.youtube.com/watch?v=gGKsfXkSXv8 Oasis Minecraft: https://x.com/risphereeditor/status/1852619965511204974 LLMs Procedural Knowledge Paper: https://arxiv.org/pdf/2411.12580 Bag of Heuristics Paper: https://arxiv.org/pdf/2410.21272 Jensen Huang Hallucinations: https://www.tomshardware.com/tech-industry/artificial-intelligence/jensen-says-we-are-several-years-away-from-solving-the-ai-hallucination-problem-in-the-meantime-we-have-to-keep-increasing-our-computation DeepSeek Interview: https://www.chinatalk.media/p/deepseek-ceo-interview-with-chinas Kling Motion Brush: https://klingai.com/image-to-video Tim Rocktaschel Book: https://geni.us/ArtificialIntelligence 00:43 - OpenAI 12 Days, Sora Turbo, o1 03:06 - Genie 2 08:26 - Jensen Huang and Altman Hallucination Predictions 09:45 - Bag of Heuristics Paper 11:40 - Procedural Knowledge Paper 13:45 - SimpleBench QwQ and Chinese Models 14:42 - Kling Motion Brush | |||
| New Google Model Ranked ‘No. 1 LLM’, But There’s a Problem | 15 Nov 2024 | 00:15:19 | |
A new and mysterious Gemini model appears at the top of the leaderboard, but is that the full story? I dig behind the headline to show you some anti-climactic results, give some context with leaks in the last 48 hours of diminishing returns to scaling, and add the response of Altman, OpenAI and co. The future is about to look a lot stranger...
You can now gift memberships to AI Insiders (my Patreon w/ exclusive vids, network): https://www.patreon.com/AIExplained/gift https://x.com/vedantmisra/status/1857148554105544708 Gemini Ranking: https://lmarena.ai/?leaderboard API not yet up: https://x.com/OfficialLoganK/status/1857106844805681153 ‘Just Die Chat’: https://x.com/koltregaskes/status/1856754648146653428 Google CEO tweet: https://x.com/sundarpichai/status/1857114106928718329 Sutskever Quote: https://www.reuters.com/technology/artificial-intelligence/openai-rivals-seek-new-path-smarter-ai-current-methods-hit-limitations-2024-11-11/ Another OpenAI Staffer Leaves: https://x.com/RichardMCNgo/status/1856843040427839804 Bloomberg Report: https://www.bloomberg.com/news/articles/2024-11-13/openai-google-and-anthropic-are-struggling-to-build-more-advanced-ai?s=09 Noam Brown on what OpenAI Researchers Believe: https://x.com/polynoamial/status/1855037689533178289 Clive Chan: https://x.com/itsclivetime/status/1855704120495329667 Chollet Responds to Altman: https://x.com/fchollet/status/1857060079586975852 https://x.com/sama/status/1856940152460869718 Altman Emails: https://x.com/TechEmails/status/1857285960997712356 Change of Heart: https://sd11.senate.ca.gov/news/senator-wiener-responds-openai-opposition-sb-1047 Amodei on ‘Empirical Regularities’: https://lexfridman.com/dario-amodei-transcript/ Verge Report: https://www.theverge.com/2024/10/25/24279600/google-next-gemini-ai-model-openai-december OpenAI Agents in January: https://www.bloomberg.com/news/articles/2024-11-13/openai-nears-launch-of-ai-agents-to-automate-tasks-for-users?srnd=phx-ai | |||
| Leak: ‘GPT-5 exhibits diminishing returns’, Sam Altman: ‘lol’ | 10 Nov 2024 | 00:15:44 | |
The last few days have seen two narratives emerge. One, derived from yesterday’s OpenAI leak in TheInformation, that GPT-5/Orion is a disappointment, and less of a leap than GPT-3 to GPT-4. The second comes from a series of 4 clips (shown in this video) from Sam Altman, regarding the ‘clear path’ to AGI. Let’s go beyond the headlines (and through papers like Frontier Math) to get closer to the ground truth…
00:39 – Bear Case, TheInformation Leak 04:01 – Bull Case, Sam Altman 06:20 – FrontierMath 11:29 – o1 Paradigm 13:11 – Text to Video Greatness and Universal-2
TheInformation Leak: https://www.theinformation.com/articles/openai-shifts-strategy-as-rate-of-gpt-ai-improvements-slows?rc=sy0ihq Noam Brown Replies: https://x.com/polynoamial/status/1855453104394637444 Sam Altman Y-Combinator Interview: https://www.youtube.com/watch?v=xXCBz_8hM9w&t=1556s Altman Reply: https://x.com/sama/status/1855100359511097828 FrontierMath Paper: https://arxiv.org/pdf/2411.04872 Frontier Math Blog Post: https://epochai.org/frontiermath Tao: https://x.com/EpochAIResearch/status/1854996368814936250 MMLU Are We Done (cites me!): https://arxiv.org/pdf/2406.04127 Universal-2 https://www.assemblyai.com/research/universal-2 Noam Brown ‘We don’t know’: https://www.youtube.com/watch?v=Gr_eYXdHFis Anthropic Founder Response: https://x.com/jackclarkSF/status/1855485569998217231 Sora (Runway Comment): https://x.com/c_valenzuelab/status/1855026417354129455 Sora New Vid: https://www.youtube.com/watch?v=_iETa2KDRuw Darri3D Video: https://www.reddit.com/r/ChatGPT/comments/1gn0n3z/can_you/ | |||
| ChatGPT with Search, Altman Answers Anything and Simple Bench Out | 01 Nov 2024 | 00:15:20 | |
The Google destroyer, the Perplexity crusher? Or just hype? ChatGPT with Search is here, and simultaneously Altman and co did an AMA on Reddit, covering GPT-5, Sora, SearchGPT and a lot more. Plus, the biggest news of them all: Simple Bench is out. Altman AMA (ask me anything): https://www.reddit.com/r/ChatGPT/comments/1ggixzy/ama_with_openais_sam_altman_kevin_weil_srinivas/ https://x.com/sama/status/1852041075793522911 Perplexity Ads: https://www.cnbc.com/2024/08/22/perplexity-ai-plans-to-start-running-search-ads-in-fourth-quarter.html Perplexity: https://www.perplexity.ai/ | |||
| The New Claude 3.5 Sonnet: Better, Yes, But Not Just in the Way You Might Think | 28 Oct 2024 | 00:22:34 | |
A new state of the art LLM (at least for creative writing and basic reasoning) but what lies behind the numbers that were put out? Is it for real, and are AI agents about to grab your mouse and shake your cursor? | |||
| ChatGPT Will Guess your Age, Flirt if Asked, and Can Call the Cops | 16 Sep 2025 | 00:11:31 | |
Sam Altman, CEO of OpenAI, announced a set of new ‘protections’ and ‘privileges’ for ChatGPT users, requiring a significant amount of trust from users. From predicting your age based on your chat to calling law enforcement if you are at risk of harm, to allowing non-minors to flirt. But amidst all of these announcements, there are interview snippets you may have missed, as Altman dramatically revises his predictions of AI impact on jobs. Plus a Hassbis backtrack to boot. Calling the Cops: https://openai.com/index/teen-safety-freedom-and-privacy/ Age Prediction: https://openai.com/index/building-towards-age-prediction/ Not Everyone Will Agree: https://x.com/sama/status/1967955739911364693?ref_src=twsrc%5Egoogle%7Ctwcamp%5Eserp%7Ctwgr%5Etweet Theory 1: NYT Lawsuit: https://openai.com/index/response-to-nyt-data-demands/ Theory 2: FTC Investigation into AI Companions: https://x.com/AndrewCurran_/status/1966167585994764743 YT Does the Same: https://www.cbsnews.com/news/youtube-ai-powered-technology-teen-users/ Carlsen Interview: https://www.youtube.com/watch?v=5KmpT-BoVf4 vs Senate Testimony (70% Jobs): https://www.youtube.com/watch?v=5CWVP8-XVjQ Hallucinations Paper: https://cdn.openai.com/pdf/d04913be-3f6f-4d2b-b283-ff432ef4aaa5/why-language-models-hallucinate.pdf Hassbis Quote 1: https://www.youtube.com/watch?v=toShbNUGAyo vs Quote 2: https://www.youtube.com/watch?v=Kr3Sh2PKA8Y | |||
| An ‘AI Bubble’? What Altman Actually said, the Facts and Nano Banana | 26 Aug 2025 | 00:18:54 | |
Wait, why did Sam Altman say AI was in a bubble? Or did he? Is it? 8 points for you to consider, before we all get distracted by Nano Banana. | |||
| GPT-5 has Arrived | 07 Aug 2025 | 00:15:01 | |
GPT-5 will change how hundreds of millions of people use AI. Yes, you might have to forgive the chart crimes, the underwhelming livestream and Altman hype… But it’s a good model. I have read the 50 page system card in full, have the benchmark scores, coding tests, and things you might have missed. Extra Paper: https://cdn.openai.com/pdf/be60c07b-6bc2-4f54-bcee-4141e1d6c69a/gpt-5-safe_completions.pdf METR Report: https://metr.github.io/autonomy-evals-guide/gpt-5-report/ ARC-AGI-2: https://x.com/fchollet/status/1953511631054680085 MMMU: https://mmmu-benchmark.github.io/ Cursor Praise: https://x.com/ryolu_/status/1953531724895596669 | |||
| Genie 3: The World Becomes Playable (DeepMind) | 05 Aug 2025 | 00:11:54 | |
Soon, anything will be playable. A photo becomes an interactive world, a selfie becomes a new game. Genie 3 from Google, debuting just 2 hours ago, is what I mean, and I have the full analysis, plus the pushback I gave the authors (will it really lead to reliable AI agents? Is that even the point?). You make your own mind up, but it’s certainly fascinating, and not to be overlooked in the week that will bring us GPT-5. | |||
| How Not to Read a Headline on AI (ft. new Olympiad Gold, GPT-5 …) | 21 Jul 2025 | 00:17:19 | |
GPT-5 did what? OpenAI ahead of Google? There are 9 ways to misread the headlines of the last 48 hours, so this video is here to tell you what happened, sans sizzle. It’s been a fairly momentous last few days, so let’s dive in to the International Math Olympiad Gold, GPT-5 alpha release, whether mathematicians are out of jobs, and the white collar impact by year’s end. Job Board: https://80000hours.org/aiexplained New Documentary on Patreon: https://www.patreon.com/posts/our-new-age-of-133960279 01:23 - OPENAI vs GOOGLE 02:42 - Irrelevant to Jobs or … 06:45 - White-collar jobs gone? 10:26 - AI is Plateauing? 12:00 - We Don’t Know the Details… 14:33 - GPT-5 alpha 14:54 - Nothing but Exponentials? 15:53 - No Impact? Announcement: https://x.com/alexwei_/status/1946477742855532918 UCLA Math Prof: https://x.com/ErnestRyu/status/1946699302308635130 ChatGPT Agent: https://openai.com/index/introducing-chatgpt-agent/ Livestream: https://www.youtube.com/watch?v=1jn_RpbPbEc&t=796s Jerry Tworek (OpenAI): https://x.com/MillionInt/status/1946556255490982022 https://x.com/MillionInt/status/1946558130906968330 Noam Brown Details: https://x.com/polynoamial/status/1946478249187377206 Trieu Tranh Retweet: https://x.com/Mihonarium/status/1946880931723194389 Neel Nanda: https://x.com/NeelNanda5/status/1946602953370173647 Terence Tao: https://mathstodon.xyz/@tao Sam Altman: https://x.com/sama/status/1946569252296929727 METR Dev Study: https://metr.org/blog/2025-07-10-early-2025-ai-experienced-os-dev-study/ Ravid Schwatz: https://x.com/ziv_ravid/status/1946378712716562605 AlphaEvolve: https://deepmind.google/discover/blog/alphaevolve-a-gemini-powered-coding-agent-for-designing-advanced-algorithms/ Meta Salary: https://www.tomshardware.com/tech-industry/artificial-intelligence/abel-founder-claims-meta-offered-usd1-25-billion-over-four-years-to-ai-hire-person-still-said-no-despite-equivalent-of-usd312-million-yearly-salary $2k per month: https://www.theinformation.com/articles/openai-considers-higher-priced-subscriptions-to-its-chatbot-ai-preview-of-the-informations-ai-summit?rc=sy0ihq | |||
| Grok 4 - 10 New Things to Know | 10 Jul 2025 | 00:11:43 | |
Grok 4 is here, but did you know these 10 things about the new model? From benchmark caveats to soloing science, $300 a month secrets to Grok 5 promises, here's 10 new things to know in just under 12 minutes. | |||
| Gemini 3 is Here: 11 Details You Might Have Missed | 19 Nov 2025 | 00:21:42 | |
Gemini 3 Pro is out, and records fell like snowflakes in Svalbard. | |||
| GPT 5.2: OpenAI Strikes Back | 12 Dec 2025 | 00:17:41 | |
Full GPT-5.2 breakdown - did OpenAI reclaim the crown? A story of tokens, time and cost, plus 9 details you wouldn’t get just from reading the headlines. | |||
| You Are Being Told Contradictory Things About AI: 8 examples | 05 Dec 2025 | 00:20:15 | |
With headlines of an imminent job apocalypse, code red for ChatGPT and recursive self-improvement, at the same time as Anthropic's CEO yesterday saying we know how to scale to AGI, and Gemini 3 DeepThink out today, it is easy to get lost among the narratives and counter-narratives. So here are both, plus the facts behind them, for you to decide.
| |||
| Gemini Exponential, Demis Hassabis' ‘Proto-AGI’ coming, but … | 19 Dec 2025 | 00:19:59 | |
The condensed highlights of hours of AI lab leader interviews, model releases, Gemini 3 Flash insights (plus it’s hidden flaw), Hassabis’ ‘proto-AGI’ and much more… | |||
| Anthropic: Our AI just created a tool that can ‘automate all white collar work’, Me: | 14 Jan 2026 | 00:18:16 | |
A new tool, with code written by an AI model, has gone omega-viral: Claude Cowork. But is the hype justified? What do the stats say on productivity? Where is the truth in a sea of noise? What is truth? Can we handle the truth? Where's Nemo? | |||
| What the Freakiness of 2025 in AI Tells Us About 2026 | 23 Dec 2025 | 00:33:26 | |
It’s probably not possible to satisfactorily condense a 12 month’s worth of weird progress in AI, as well as predictions for the year to come, into one video. But I’m gonna try anyway because it has been a very strange time. | |||
| Gemini 3.1 Pro and the Downfall of Benchmarks: Welcome to the Vibe Era of AI | 20 Feb 2026 | 00:18:50 | |
Do we have a new best AI model, or do we have the downfall of benchmarks in general, as a way of capturing machine intelligence? Full breakdown of Gemini 3.1 Pro, guest-starring the new Sonnet 4.6, plus analysis from 7 papers/posts that will give you much needed context. Oh, and a new record on Simple Bench! | |||
| The Two Best AI Models/Enemies Just Got Released Simultaneously | 06 Feb 2026 | 00:19:49 | |
The two models that you will hear discussed for at least the next two months - Claude Opus 4.6 and GPT 5.3 Codex - just got released within 26 mins or each other. The full breakdown of around 250 pages of reports, with just the most interest moments, from the battle of which is best, Claude personhood, the surprising misbehaviour of Opus 4.6, and much more System Card: https://openai.com/index/gpt-5-3-codex-system-card/ | |||
| Claude AI Co-founder Publishes 4 Big Claims about Near Future: Breakdown | 28 Jan 2026 | 00:22:12 | |
Anthropic's CEO, who has consistently predicted transformative AI will arrive before 2030, recently published a nearly 20,000-word essay outlining his vision of where AI is heading. The video gives you the highlights. The essay argues that scaling and recursion will advance AI from coding automation to full engineering automation, while warning of economic displacement within 1-2 years and China's trajectory toward AI-enabled totalitarianism. Additionally, Dario Amodei predicts that AI models will increasingly be understood as collections of distinct personas rather than monolithic systems. | |||
| Deadline Day for Autonomous AI Weapons & Mass Surveillance | 27 Feb 2026 | 00:13:39 | |
Will Anthropic be forced to make a version of Claude for war? And does a new paper expose the risks of Claude agents, in both OpenClaw and the field of war? Plus, 5 more twists in the story of the Pentagon versus Anthropic + some AI lab employees, and a petition that could change everything, or nothing... | |||