Mystery AI Hype Theater 3000 – Details, episodes & analysis

Did your summer feel like an unending barrage of terrible ideas for how to use “AI”? You’re not alone. It's time for Emily and Alex to clear out the poison, purge some backlog, and take another journey through AI hell -- from surveillance of emotions, to continued hype in education and art.

Fresh AI Hell:

Synthetic data for Hollywood test screenings

NaNoWriMo's AI fail

• AI is built on exploitation
• NaNoWriMo sponsored by an AI writing company
• NaNoWriMo's AI writing sponsor creates bad writing

AI assistant rickrolls customers

Programming LLMs with "fiduciary duty"

Canva increasing prices thank to "AI" features

Ad spending by AI companies

Clearview AI hit with largest GDPR fine yet

'AI detection' in schools harms neurodivergent kids

CS prof admits unethical ChatGPT use

College recruiter chatbot can't discuss politics

"The AI-powered nonprofits reimagining education"

Teaching AI at art schools

Professors' 'AI twins' as teaching assistants

A teacherless AI classroom

Another 'AI scientist'

LLMs still biased against African American English

AI "enhances" photo of Black people into white-appearing

Eric Schmidt: Go ahead, steal data with ChatGPT

The environmental cost of Google's "AI Overviews"

Jeff Bezos' "Grand Challenge" for AI in environment

What I found in an AI-company's e-waste

xAI accused of worsening smog with unauthorized gas turbines

Smile surveillance of workers

AI for "emotion recognition" of rail passengers

Chatbot harassment scenario reveals real victim

AI has hampered productivity

"AI" in a product description turns off consumers

Is tripe kosher? It depends on the religion of the cow.

Check out future streams at on Twitch, Meanwhile, send us any AI Hell you see.

Our book, 'The AI Con,' is out now! Get your copy now.

Subscribe to our newsletter via Buttondown.

Follow us!

Emily

• Bluesky: emilymbender.bsky.social
• Mastodon: dair-community.social/@EmilyMBender

Alex

• Bluesky: alexhanna.bsky.social
• Mastodon: dair-community.social/@alex
• Twitter: @alexhanna

Music by Toby Menon.
Artwork by Naomi Pleasure-Park.
Production by Christie Taylor.

Dr. Clara Berridge joins Alex and Emily to talk about the many 'uses' for generative AI in elder care -- from "companionship," to "coaching" like medication reminders and other encouragements toward healthier (and, for insurers, cost-saving) behavior. But these technologies also come with questionable data practices and privacy violations. And as populations grow older on average globally, technology such as chatbots is often used to sidestep real solutions to providing meaningful care, while also playing on ageist and ableist tropes.

Dr. Clara Berridge is an associate professor at the University of Washington’s School of Social Work. Her research focuses explicitly on the policy and ethical implications of digital technology in elder care, and considers things like privacy and surveillance, power, and decision-making about technology use.

References:

Care.Coach's 'Avatar' chat program*

For Older People Who Are Lonely, Is the Solution a Robot Friend?

Care Providers’ Perspectives on the Design of Assistive Persuasive Behaviors for Socially Assistive Robots

Socio-Digital Vulnerability

***Care.Coach's 'Fara' and 'Auger' products, also discussed in this episode, are no longer listed on their site.

Fresh AI Hell:

Apple Intelligence hidden prompts include the command "don't hallucinate"

The US wants to use facial recognition to identify migrant children as they age

Family poisoned after following fake mushroom book

It is a beautiful evening in the neighborhood, and you are a horrible Waymo robotaxi

Dynamic pricing + surveillance hell at the grocery store

Chinese social media's newest trend: imitating AI-generated videos

Check out future streams at on Twitch, Meanwhile, send us any AI Hell you see.

Our book, 'The AI Con,' is out now! Get your copy now.

Subscribe to our newsletter via Buttondown.

Follow us!

Emily

• Bluesky: emilymbender.bsky.social
• Mastodon: dair-community.social/@EmilyMBender

Alex

• Bluesky: alexhanna.bsky.social
• Mastodon: dair-community.social/@alex
• Twitter: @alexhanna

Music by Toby Menon.
Artwork by Naomi Pleasure-Park.
Production by Christie Taylor.

Will AI someday do all our scientific research for us? Not likely. Drs. Molly Crockett and Lisa Messeri join for a takedown of the hype of "self-driving labs" and why such misrepresentations also harm the humans who are vital to scientific research.

Dr. Molly Crockett is an associate professor of psychology at Princeton University.
Dr. Lisa Messeri is an associate professor of anthropology at Yale University, and author of the new book, In the Land of the Unreal: Virtual and Other Realities in Los Angeles.

References:

AI For Scientific Discovery - A Workshop
Nature: The Nobel Turing Challenge
Nobel Turing Challenge Website
Eric Schmidt: AI Will Transform Science
Molly Crockett & Lisa Messeri in Nature: Artificial intelligence and illusions of understanding in scientific research
404 Media: Is Google's AI actually discovering 'millions of new materials?'

Fresh Hell:

Yann LeCun realizes generative AI sucks, suggests shift to objective-driven AI
In contrast:
https://x.com/ylecun/status/1592619400024428544
https://x.com/ylecun/status/1594348928853483520
https://x.com/ylecun/status/1617910073870934019

CBS News: Upselling “AI” mammograms
Ars Technica: Rhyming AI clock sometimes lies about the time
Ars Technica: Surveillance by M&M's vending machine

Check out future streams at on Twitch, Meanwhile, send us any AI Hell you see.

Our book, 'The AI Con,' is out now! Get your copy now.

Subscribe to our newsletter via Buttondown.

Follow us!

Emily

• Bluesky: emilymbender.bsky.social
• Mastodon: dair-community.social/@EmilyMBender

Alex

• Bluesky: alexhanna.bsky.social
• Mastodon: dair-community.social/@alex
• Twitter: @alexhanna

Music by Toby Menon.
Artwork by Naomi Pleasure-Park.
Production by Christie Taylor.

Dr. Timnit Gebru guest-hosts with Alex in a deep dive into Marc Andreessen's 2023 manifesto, which argues, loftily, in favor of maximizing the use of 'AI' in all possible spheres of life.

Timnit Gebru is the founder and executive director of the Distributed Artificial Intelligence Research Institute (DAIR). Prior to that she was fired by Google, where she was serving as co-lead of the Ethical AI research team, in December 2020 for raising issues of discrimination in the workplace. Timnit also co-founded Black in AI, a nonprofit that works to increase the presence, inclusion, visibility and health of Black people in the field of AI, and is on the board of AddisCoder, a nonprofit dedicated to teaching algorithms and computer programming to Ethiopian highschool students, free of charge.

References:
Marc Andreessen: "The Techno-Optimism Manifesto"
First Monday: The TESCREAL bundle: Eugenics and the promise of utopia through artificial general intelligence (Timnit Gebru & Émile Torres)
Business Insider: Explaining 'Pronatalism' in Silicon Valley

Fresh AI Hell:
CBS New York: NYC subway testing out weapons detection technology, Mayor Adams says.
The Markup: NYC's AI chatbot tells businesses to break the law

• Read Emily's Twitter / Mastodon thread about this chatbot.

The Guardian: DrugGPT: New AI tool could help doctors prescribe medicine in England
The Guardian: Wearable AI: Will it put our smartphones out of fashion?
TheCurricula.com

Check out future streams at on Twitch, Meanwhile, send us any AI Hell you see.

Our book, 'The AI Con,' is out now! Get your copy now.

Subscribe to our newsletter via Buttondown.

Follow us!

Emily

• Bluesky: emilymbender.bsky.social
• Mastodon: dair-community.social/@EmilyMBender

Alex

• Bluesky: alexhanna.bsky.social
• Mastodon: dair-community.social/@alex
• Twitter: @alexhanna

Music by Toby Menon.
Artwork by Naomi Pleasure-Park.
Production by Christie Taylor.

Award-winning AI journalist Karen Hao joins Alex and Emily to talk about why LLMs can't possibly replace the work of reporters -- and why the hype is damaging to already-struggling and necessary publications.

References:

Adweek: Google Is Paying Publishers to Test an Unreleased Gen AI Platform

The Quint: AI Invents Quote From Real Person in Article by Bihar News Site: A Wake-Up Call?

Fresh AI Hell:

Alliance for the Future

VentureBeat: Google researchers unveil ‘VLOGGER’, an AI that can bring still photos to life

Business Insider: A car dealership added an AI chatbot to its site. Then all hell broke loose.

• More pranks on chatbots

Check out future streams at on Twitch, Meanwhile, send us any AI Hell you see.

Our book, 'The AI Con,' is out now! Get your copy now.

Subscribe to our newsletter via Buttondown.

Follow us!

Emily

• Bluesky: emilymbender.bsky.social
• Mastodon: dair-community.social/@EmilyMBender

Alex

• Bluesky: alexhanna.bsky.social
• Mastodon: dair-community.social/@alex
• Twitter: @alexhanna

Music by Toby Menon.
Artwork by Naomi Pleasure-Park.
Production by Christie Taylor.

Alex and Emily put on their social scientist hats and take on the churn of research papers suggesting that LLMs could be used to replace human labor in social science research -- or even human subjects. Why these writings are essentially calls to fabricate data.

References:

PNAS: ChatGPT outperforms crowd workers for text-annotation tasks

• Beware the Hype: ChatGPT Didn't Replace Human Data Annotators
• ChatGPT Can Replace the Underpaid Workers Who Train AI, Researchers Say

Political Analysis: Out of One, Many: Using Language Models to Simulate Human Samples

Behavioral Research Methods: Can large language models help augment English psycholinguistic datasets?

Information Systems Journal: Editorial: The ethics of using generative AI for qualitative data analysis

Fresh AI Hell:

Advertising vs. reality, synthetic Willy Wonka edition

• https://x.com/AlsikkanTV/status/1762235022851948668?s=20
• https://twitter.com/CultureCrave/status/1762739767471714379
• https://twitter.com/xriskology/status/1762891492476006491?t=bNQ1AQlju36tQYxnm8BPVQ&s=19

A news outlet used an LLM to generate a story...and it falsely quoted Emily

• AI Invents Quote From Real Person in Article by Bihar News Site: A Wake-Up Call?

Trump supporters target Black voters with faked AI images

• Seeking Reliable Election Information? Don’t Trust AI

Check out future streams at on Twitch, Meanwhile, send us any AI Hell you see.

Our book, 'The AI Con,' is out now! Get your copy now.

Subscribe to our newsletter via Buttondown.

Follow us!

Emily

• Bluesky: emilymbender.bsky.social
• Mastodon: dair-community.social/@EmilyMBender

Alex

• Bluesky: alexhanna.bsky.social
• Mastodon: dair-community.social/@alex
• Twitter: @alexhanna

Music by Toby Menon.
Artwork by Naomi Pleasure-Park.
Production by Christie Taylor.

Science fiction authors and all-around tech thinkers Annalee Newitz and Charlie Jane Anders join this week to talk about Isaac Asimov's oft-cited and equally often misunderstood laws of robotics, as debuted in his short story collection, 'I, Robot.' Meanwhile, both global and US military institutions are declaring interest in 'ethical' frameworks for autonomous weaponry.

Plus, in AI Hell, a ballsy scientific diagram heard 'round the world -- and a proposal for the end of books as we know it, from someone who clearly hates reading.

Charlie Jane Anders is a science fiction author. Her recent and forthcoming books include Promises Stronger Than Darkness in the ‘Unstoppable’ trilogy, the graphic novel New Mutants: Lethal Legion, and the forthcoming adult novel Prodigal Mother.

Annalee Newitz is a science journalist who also writes science fiction. Their most recent novel is The Terraformers, and in June you can look forward to their nonfiction book, Stories Are Weapons: Psychological Warfare and the American Mind.

They both co-host the podcast, 'Our Opinions Are Correct', which explores how science fiction is relevant to real life and our present society.

Also, some fun news: Emily and Alex are writing a book! Look forward (in spring 2025) to The AI Con, a narrative takedown of the AI bubble and its megaphone-wielding boosters that exposes how tech’s greedy prophets aim to reap windfall profits from the promise of replacing workers with machines.

Watch the video of this episode on PeerTube.

References:

International declaration on "Responsible Military Use of Artificial Intelligence and Autonomy" provides "a normative framework addressing the use of these capabilities in the military domain."

DARPA's 'ASIMOV' program to "objectively and quantitatively measure the ethical difficulty of future autonomy use-cases...within the context of military operational values."
Short version
Long version (pdf download)

Fresh AI Hell:

"I think we will stop publishing books, but instead publish “thunks”, which are nuggets of thought that can interact with the “reader” in a dynamic and multimedia way."

AI generated illustrations in a scientific paper -- rat balls edition.

• Per Retraction Watch: the paper with illustrations of a rat with enormous "testtomcels" has been retracted

"[Abramovic's

Check out future streams at on Twitch, Meanwhile, send us any AI Hell you see.

Our book, 'The AI Con,' is out now! Get your copy now.

Subscribe to our newsletter via Buttondown.

Follow us!

Emily

• Bluesky: emilymbender.bsky.social
• Mastodon: dair-community.social/@EmilyMBender

Alex

• Bluesky: alexhanna.bsky.social
• Mastodon: dair-community.social/@alex
• Twitter: @alexhanna

Music by Toby Menon.
Artwork by Naomi Pleasure-Park.
Production by Christie Taylor.

Just Tech Fellow Dr. Chris Gilliard aka "Hypervisible" joins Emily and Alex to talk about the wave of universities adopting AI-driven educational technologies, and the lack of protections they offer students in terms of data privacy or even emotional safety.

References:

Inside Higher Ed: Arizona State Joins ChatGPT in First Higher Ed Partnership

ASU press release version: New Collaboration with OpenAI Charts theFuture of AI in Higher Education

MLive: Your Classmate Could Be an AI Student at this Michigan University

Chris Gilliard: How Ed Tech Is Exploiting Students

Fresh AI Hell:

Various: “AI learns just like a kid”
Infants' gaze teaches AI the nuances of language acquisition
Similar from NeuroscienceNews

Politico: Psychologist apparently happy with fake version of himself

WSJ: Employers Are Offering a New Worker Benefit: Wellness Chatbots

NPR: Artificial intelligence can find your location in photos, worrying privacy expert

Palette cleanser: Goodbye to NYC's useless robocop.

Check out future streams at on Twitch, Meanwhile, send us any AI Hell you see.

Our book, 'The AI Con,' is out now! Get your copy now.

Subscribe to our newsletter via Buttondown.

Follow us!

Emily

• Bluesky: emilymbender.bsky.social
• Mastodon: dair-community.social/@EmilyMBender

Alex

• Bluesky: alexhanna.bsky.social
• Mastodon: dair-community.social/@alex
• Twitter: @alexhanna

Music by Toby Menon.
Artwork by Naomi Pleasure-Park.
Production by Christie Taylor.

Is ChatGPT really going to take your job? Emily and Alex unpack two hype-tastic papers that make implausible claims about the number of workforce tasks LLMs might make cheaper, faster or easier. And why bad methodology may still trick companies into trying to replace human workers with mathy-math.

Visit us on PeerTube for the video of this conversation.

References:

OpenAI: GPTs are GPTs
Goldman Sachs: The Potentially Large Effects of Artificial Intelligence on Economic Growth

FYI: Over the last 60 years, automation has totally eliminated just one US occupation.

Fresh AI Hell:

Microsoft adding a dedicated "AI" key to PC keyboards.

• Dr. Damien P Williams: "Yikes."

The AI-led enshittification at Duolingo

• Shot: https://twitter.com/Rahll/status/1744234385891594380
• Chaser: https://twitter.com/Maccadaynu/status/1744342930150560056

University of Washington Provost highlighting “AI”
“Using ChatGPT, My AI eBook Creation Pro helps you write an entire e-book with just three clicks -- no writing or technical experience required.”
"Can you add artificial intelligence to the hydraulics?"

Check out future streams at on Twitch, Meanwhile, send us any AI Hell you see.

Our book, 'The AI Con,' is out now! Get your copy now.

Subscribe to our newsletter via Buttondown.

Follow us!

Emily

• Bluesky: emilymbender.bsky.social
• Mastodon: dair-community.social/@EmilyMBender

Alex

• Bluesky: alexhanna.bsky.social
• Mastodon: dair-community.social/@alex
• Twitter: @alexhanna

Music by Toby Menon.
Artwork by Naomi Pleasure-Park.
Production by Christie Taylor.

New year, same Bullshit Mountain. Alex and Emily are joined by feminist technosolutionism critics Eleanor Drage and Kerry McInerney to tear down the ways AI is proposed as a solution to structural inequality, including racism, ableism, and sexism -- and why this hype can occlude the need for more meaningful changes in institutions.

Dr. Eleanor Drage is a Senior Research Fellow at the Leverhulme Centre for the Future of Intelligence. Dr. Kerry McInerney is a Research Fellow at the Leverhulme Centre for the Future of Intelligence and a Research Fellow at the AI Now Institute. Together they host The Good Robot, a podcast about gender, feminism, and whether technology can be "good" in either outcomes or processes.

Watch the video version of this episode on PeerTube.

References:

HireVue promo: How Innovative Hiring Technology Nurtures Diversity, Equity, and Inclusion

Algorithm Watch: The [German Federal Asylum Agency]'s controversial dialect recognition software: new languages and an EU pilot project

Want to see how AI might be processing video of your face during a job interview? Play with React App, a tool that Eleanor helped develop to critique AI-powered video interview tools and the 'personality insights' they offer.

Philosophy & Technology: Does AI Debias Recruitment? Race, Gender, and AI’s “Eradication of Difference” (Drage & McInerney, 2022)

Communication and Critical/Cultural Studies: Copies without an original: the performativity of biometric bordering technologies (Drage & Frabetti, 2023)

Fresh AI Hell

Internet of Shit 2.0: a "smart" bidet

Fake AI “students” enrolled at Michigan University

Synthetic images destroy online crochet groups

“AI” for teacher performance feedback

Palette cleanser: “Stochastic parrot” is the American Dialect Society’s AI-related word of the year for 2023!

Check out future streams at on Twitch, Meanwhile, send us any AI Hell you see.

Our book, 'The AI Con,' is out now! Get your copy now.

Subscribe to our newsletter via Buttondown.

Follow us!

Emily

• Bluesky: emilymbender.bsky.social
• Mastodon: dair-community.social/@EmilyMBender

Alex

• Bluesky: alexhanna.bsky.social
• Mastodon: dair-community.social/@alex
• Twitter: @alexhanna

Music by Toby Menon.
Artwork by Naomi Pleasure-Park.
Production by Christie Taylor.