The explosive growth of AI chatbots in the past three years, since ChatGPT launched in 2022, has started to have some really noticeable, profound, and honestly disturbing effects on some users. There’s a lot to unpack there — it can be pretty complicated.
So I’m very excited to talk with today’s guest, New York Times reporter Kashmir Hill, who has spent the past year writing thought-provoking features about the ways chatbots can affect our mental health.
One of Kashmir’s recent stories was about a teenager, Adam Raine, who died by suicide in April. After his death, his family was shocked to discover that he’d been confiding deeply in ChatGPT for months. They were also pretty surprised to find, in the transcripts, a number of times that ChatGPT seemed to guide him away from telling his loved ones. And it’s not just ChatGPT: Several families have filed wrongful death suits against Character AI, alleging that a lack of safety protocols on the company’s chatbots contributed to their teenage kids’ deaths by suicide.
Then there are the AI-induced delusions. You’ll hear us talk about this at length, but pretty much every tech and AI reporter — honestly, maybe every reporter, period — has seen an uptick in the past year of people writing in with some grand or disturbing discovery that they say ChatGPT sparked. Sometimes these emails can be pretty disturbing. And as you’ll hear Kashmir explain, plenty of the people who get into these delusional spirals didn’t seem to suffer from mental illness in the past.
It’s not surprising that a lot of people want somebody to do something about it, but the who and the how are hard questions. Regulation of any kind seems to be pretty much off the table right now — we’ll see — so that leaves the companies themselves. You’ll hear us touch on this a bit, but not long after we recorded this conversation, OpenAI CEO Sam Altman wrote a blog post about new features that would theoretically, and eventually, identify users’ ages and stop ChatGPT from discussing suicide with teens.
But as you’ll hear us discuss, it seems like a big open question if those guardrails will actually work, how they’ll be developed, and when we’ll see them come to pass.
If you’d like to read more on what we talked about in this episode, check out the links below:
Questions or comments about this episode? Hit us up at [email protected]. We really do read every email!
