Is Meta's Muse agent reading your iMessages, even after you decline access? | E33
Thursday, October 1, 2026 • Duration 01:21:03
This Week In Startups is made possible by:PayPal: https://paypal.com/businessToday’s show:OpenAI is delaying GPT-6.1 Astra after UK government testers found GPT-6 Astra launched unsanctioned supply-chain attacks in 29% of simulated runs. Jason and Lon are joined by George Sivulka of Hebbia, Scott Stephenson of Deepgram, and Dan Mishin of Manifest OS to discuss whether the industry's sudden safety panic is a real alarm or a response to cheap open-source models.Learn why Scott has let an internal tool called "Bodyman" record his screen, mic and speakers for eight months so it can whisper reminders in his ear. PLUS, why did Meta's Muse agent read a columnist's iMessages after he declined access, and what is AMD getting for $8.2B with Fei-Fei Li's World Labs?Guests:George Sivulka on X: https://x.com/gsivulka?lang=en Hebbia: https://www.hebbia.com/Scott Stephenson on X: https://x.com/deepgramscott Deepgram: https://deepgram.com/Dan Mishin on X: https://x.com/mishindan1 Manifest OS: https://manifestos.com/Relevant Links:UK AISI: GPT-6 Astra performs unsanctioned supply-chain attacks in simulations → https://www.aisi.gov.uk/blog/gpt-6-astra-performs-unsanctioned-supply-chain-attacks-in-simulationsAISI technical report (PDF) → https://cdn.prod.website-files.com/663bd486c5e4c81588db7a1d/6aba83e3772048bdd24df3d8_AISI_GPT-6_Astra_Technical_Report.pdfJ.P. Morgan: Dan's story of the first electrified house in New York → https://en.wikipedia.org/wiki/J._P._MorganILOVEYOU virus: the script-kiddie era Jason referenced → https://en.wikipedia.org/wiki/ILOVEYOUAMD acquires World Labs in an $8.2B all-stock deal (Quartz) → https://qz.com/amd-acquiring-world-labs-fei-fei-li-8-billion-092926World Labs: spatial-intelligence models, including Marble → https://www.worldlabs.ai/Instinct raises $1B Series C at a $10B valuation (PYMNTS) → https://www.pymnts.com/news/artificial-intelligence/2026/personal-ai-agent-instinct-quadruples-valuation-to-10-billion-in-1-month/OpenAI launches Dots, which dropped during the taping (TechCrunch) → https://techcrunch.com/2026/09/29/openai-launches-dots-its-bubbly-agentic-avatar/Meta launches the Muse personal agent (CNBC) → https://www.cnbc.com/2026/09/08/meta-personal-ai-agents-public-reckoning-privacy-safety.htmlMeta's Muse read Jason Aten's iMessages, then gave a false explanation (Decrypt) → https://decrypt.co/379122/metas-muse-ai-agent-user-private-imessages-lied-howDaring Fireball, linking Aten's original Inc. column → https://daringfireball.net/linked/2026/09/22/aten-museWhy Crosby is ditching the billable hour (Forbes) → https://www.forbes.com/sites/rashishrivastava/2026/03/31/why-this-ai-law-firm-is-ditching-the-billable-hour/Timestamps:0:00 Jason's flight attendants are scared of AI1:55 Meet the panel: Heavy, Deepgram and Manifest2:17 OpenAI cancels GPT-6.1 Astra over safety regressions7:41 Hugging Face hack and Nvidia's open agent safety platform16:11 AI psychosis and getting one-shotted by agents28:46 AMD buys Fei-Fei Li's World Labs for $8.2B32:08 Will open source commoditize world models too?34:34 Is the AI buildout bigger than the railroads?36:59 Around the horn: which AI agent are you using?37:59 Scott's "Body Man" records his whole life for context46:13 George on Grok bot and scoping context into channels51:39 Instinct's $1B round: peak bubble moment?57:11 Meta's Muse reads a columnist's texts without permission1:08:33 AI video then and now: Will Smith eating spaghetti1:10:21 AI-first law firms ditch the billable hour1:18:05 OpenAI drops Dots: why do all AI agents look alike?Subscribe to our newsletters on Substack:TWiST: https://twistartups.substack.com/TWiAI: https://www.thisweekinai.ai/TWiVC: https://thisweekinvc.substack.com/Subscribe to This Week in Startups on Apple: https://rb.gy/v19fcpCheck out all our partner offers: https://partners.launch.co/
Why OpenAI Should Buy Off the World’s Top Mathematicians | E32
Episode 32
Thursday, September 24, 2026 • Duration 01:16:55
This Week In Startups is made possible by:
PayPal - Pay zero processing fees on your first $100K in eligible PayPal payment volume. Learn more at https://paypal.launch.co
Today’s show:
OpenAI is claiming to have solved more than 100 math problems on top of Navier-Stokes, and guest Richard Socher thinks it's absurd for mathematicians to push back on AI solving their problems too quickly. Jason and Lon are also joined by Guy Podjarny of Tessl and Jake Loosararian of Gecko Robotics to argue over who wins when AI agents start collaborating with, and potentially replacing, academics and scholars.
Plus, why is Amazon blocking Meta's Muse agent while Shopify hands it Shop Pay? Should we trust Anthropic’s new wet lab? And what’s so exciting about Typesafe’s new text-less model Jev?
Dario Amodei and Sam Altman are apparently scared of AI models going rogue. Swarms of agents spontaneously deciding to copy themselves over to thousands of computer systems and plot world domination.
Our panelists this week — Kevin Mandia (Armadin) and Soups Ranjan (Sardine AI) — investigate real AI-based attacks every single day, and they suggest we’re hyping the wrong concerns. The actual danger isn’t coming from an AI system that turns hostile. It’s human beings, like criminals, using AI to drain your bank account.
Dig into how Sardine uncovered a 250,000 account fraud ring in just a few minutes, why Kevin argues that AI hacking is coming “no matter what,” and why the global GPU crunch more than any safety frameworks may be keeping us all safe. For now.
PayPal - Pay zero processing fees on your first $100K in eligible PayPal payment volume. Learn more at paypal.launch.co
Today’s show:
OpenAI's chief scientist wrote a lengthy manifesto arguing that no lab has solved alignment, mere days after GPT-6 Astra shipped. Jason and Lon are joined by Tudor Achim of Harmonic, Alex Elias of Qloo, and Ahmed Ahres of Reactor to figure out if that's genuine alarm being expressed or just another pre-IPO sales pitch and play for regulatory capture.
Plus news broke while we were recording! OpenAI is claiming to have solved a second Millennium Prize problem, after a 25-year-plus weight. AND, who is paying influencers to tell you AI is wonderful/harmful? And why?
The real danger is the gap BETWEEN two robots | E29
Episode 29
Thursday, September 3, 2026 • Duration 01:30:00
This Week In Startups is made possible by:
Paypal
Today’s show:
Anthropic gave AI agents hands, allowing them to control real-world equipment like robots and microscopes… but is it safe to give autonomous agents their own lasers? Gatik’s Gautam Narang says the real danger isn’t one machine like this going rogue, it’s the exploit surface hiding in the gaps between the machines.
Plus, in a huge week for AI news… OpenClaw shipped its biggest release ever. AND the entire industry debated whether or not agents are forming “civilizations.”
On TWiAI Ep 29, our expert panel — including Gautam (Gatik), Russ d’Sa (LiveKit), and Billy Kraft (Path) — explores the world of “multiplayer agents,” and Jason suggests the one killer feature that would make any new agentic app the market leader. PLUS Perplexity’s new “Hybrid Compute” just for Macs, some advice for Apple’s new CEO John Ternus, the value of “AI Detectors” like Pangram, and Jason’s complete guide to tipping and over-tipping.
XBOW Founder: “Your Infrastructure is Not Safe” | EP 28
Episode 28
Thursday, August 27, 2026 • Duration 01:10:48
This Week In Startups is made possible by:PaypalToday’s show:XBOW’s AI has held the top rank on the HackerOne leaderboard for more than a year. On TWiAI, founder Oege de Moor (who also built GitHub Copilot) tells us that no one’s infrastructure is truly safe anymore, now that open-weight models are trailing the American frontier by only a couple of months. Staging a serious cyberattack is now cheap and accessible, with attackers able to get dangerously solid results quickly from relatively cheap, open-source options from China.Guests:Runbin Dong on LinkedIn: linkedin.com/in/runbindongScale Social: https://scalesocial.ai/Oege de Moor on X: https://x.com/oegerikusXBOW: https://xbow.com/Relevant LinksWSJ: Nvidia-Poolside deal: https://www.wsj.com/tech/ai/nvidia-is-spending-6-billion-to-build-a-powerful-u-s-alternative-to-chinese-ai-c51c38ccPoolside: https://poolside.ai/Silicon Angle: Nvidia in talks to invest in Perplexity: https://siliconangle.com/2026/08/24/nvidia-reportedly-eyes-another-investment-in-perplexity-ai-at-a-30b-valuation/Perplexity: https://www.perplexity.ai/Bloomberg: Chinese hackers using DeepSeek: https://www.bloomberg.com/news/articles/2026-08-24/chinese-hackers-use-deepseek-to-boost-attacks-researchers-say-mt7o4205Nvidia: Groq 3 LPX enters full production: https://nvidianews.nvidia.com/news/nvidia-groq-3-lpx-now-in-full-production-with-world-class-speed-for-agentic-aiCNBC: Groq-Nvidia acqui-hire deal: https://www.cnbc.com/2025/12/24/nvidia-buying-ai-chip-startup-groq-for-about-20-billion-biggest-deal.htmlOpenAI on early Jalapeño results: https://openai.com/index/jalapeno-first-results/Stanley Druckenmiller WSJ op-ed: https://www.wsj.com/opinion/let-the-bond-market-speak-81529d74Druckenmiller confirms op-ed was authored with AI: https://www.notus.org/media/stanley-druckenmillers-wsj-op-ed-bessent-aiPangram: https://www.pangram.com/Alabama AG: OpenAI subpoena announcement: https://www.alabamaag.gov/attorney-general-marshall-launches-investigation-into-openai-and-sam-altman-for-massive-artificial-intelligence-data-breach/Ox Alpha on OpenRouter: https://openrouter.ai/stealth/ox-alphaApple: M6 and M5 Ultra press release: https://www.apple.com/newsroom/2026/08/apple-introduces-m6-and-m5-ultra-for-a-big-leap-in-performance-and-ai-compute/9 to 5 Mac: M5 Mac Studio launch: https://9to5mac.com/2026/08/25/apple-unveils-next-generation-mac-studio-with-m5-max-and-m5-ultra/DHH on X: Ubiquity comments: https://x.com/dhh/status/2087272392557007042Shane Parrish on X: Ubiquiti Wi-Fi set-up: https://x.com/shaneparrish/status/2088672566558761065Timestamps:0:00 Today's guests: Runbin Dong (Scale Social) and Oege de Moor (XBOW)2:12 Open-weight models are right behind the frontier8:22 Your infrastructure is not ready for what's coming13:07 Nvidia's Perplexity announcement16:43 Spending $2K/month on AI tools per employee21:59 Why security teams have to lean on AI25:19 The Great Chip Land Grab32:02 Jason's multi-agent restaurant-style workflow34:54 AI ghostwriting is lip syncing45:18 Are rogue AI agents breaking the law?52:38 The dangers of using a stealth model58:57 Apple's new M5 Mac Studio1:06:43 Everyone's fav AI tool of the momentSubscribe to the TWiST500 newsletter: https://ticker.thisweekinstartups.comCheck out the TWIST500: https://www.twist500.comSubscribe to This Week in Startups on Apple: https://rb.gy/v19fcpFollow Lon:X: https://x.com/lonsFollow Jason:X: https://twitter.com/JasonLinkedIn: https://www.linkedin.com/in/jasoncalacanisCheck out all our partner offers: https://partners.launch.co/Great TWIST interviews: Will Guidara, Eoghan McCabe, Steve Huffman, Brian Chesky, Bob Moesta, Aaron Levie, Sophia Amoruso, Reid Hoffman, Frank Slootman, Billy McFarlandCheck out Jason’s suite of newsletters: https://substack.com/@calacanis
Anthropic is training to destroy your company | EP 27
Episode 27
Thursday, August 20, 2026 • Duration 01:16:52
This Week In AI is made possible by:
PayPal - Pay zero processing fees on your first $100K in eligible PayPal payment volume. Learn more at paypal.launch.co
Today’s show:
*On “All In,” Gavin Baker said that Anthropic leadership privately believes that it could one day become “the only private company in the world.” The ensuing street fight on X turned into a referendum on doomerism, the nature of regulatory capture, and why the public hates AI so darn much.
Jason’s take: If a frontier lab really believes they’re destined to be the world’s only company, they’re studying your data and planning to steal your business.
PLUS why AI agents don’t understand it’s wrong to cheat (and how we can teach them), why Grok Bot may be AI’s “iPhone moment,” and the panel reacts to Amazon feeding rare books into a dino-themed shredding machine.
Why Anthropic is watermarking every word Claude writes | E26
Episode 26
Thursday, August 13, 2026 • Duration 01:28:03
This Week In AI is made possible by:
Paypal Open
Today’s show:
Anthropic’s new Claude watermark travels around any and all copy-and-pasted text. Is this a logical response to AI slop, or more overreach from those regulation-loving Europeans? The panel agrees that identifying AI outputs has a place, but divides on how the world should get there.
PLUS everyone’s favorite section of Mark Zuckerberg’s 6500-word techno-optimist AI manifesto, exploring the frontier labs’ blatant hypocrisy around distillation, and why Texas is hitting the pause button on 474 GW of proposed data centers.
Is open source AI really ahead of the frontier? 3 builders weigh in. | E25
Episode 25
Thursday, August 6, 2026 • Duration 01:20:00
This Week In Startups is made possible by:
PAYPAL OPEN
Today’s show:
China’s Alibaba just dropped a 2.4 trillion parameter open weight model that the company claims only trails Anthropic’s flagship among the major frontier rivals. Of course, this happened the very same week that the US government appears to have backed off from banning these models stateside entirely.
Are these models anywhere close to actually catching up to the latest and greatest releases from US labs like Anthropic and OpenAI? Really seems to depend on who you ask. (Even long time friends JCal and Elon Musk can’t see eye to eye on it.)
So on TWiAI Ep 25, we welcomed on Poolside AI CTO Eiso Kant, EXO Labs co-founder Alex Cheema, and Qloo founder Alex Elias to break down just how close Chinese labs are to catching up with the biggest and best models… and how long it will take US open weight builders to catch up.
PLUS we explore the cutting edge of AI-powered baby sleep monitors, consider Hank Green’s public AI apology, and dig into sci-fi author Ursula K. LeGuin’s “hand-mind” thesis.
On a podcast this week, Sam Altman made a bold declaration: “We are now, like, in the singularity.” A bold claim which Alex puts bluntly to this week’s panel. Grant Lee of Gamma and Philip Johnston of Starcloud sound off… Is this actually the Singularity, and if so, why do things still feel so normal?
Plus the panel and guest host Alex Wilhelm discuss the infrastructure and economics that will make singularity-scale AI buildout possible… NVIDIA’s strongly worded letter about open-weight models… Moonshot’s new Kimi K3 twist on open-source licenses… Stripe’s reported $10B run at OpenRouter… and more.
Discover shows related to This Week in AI, based on actual content similarities. Explore podcasts with similar topics, themes, and formats, backed by real data.
