Begin typing your search above and press return to search.

Teen Falls for AI, Ends in Heartbreaking Suicide

But a recent, heartbreaking incident is casting a shadow over this AI optimism.

By:  Tupaki Desk   |   24 Oct 2024 12:07 PM GMT
Teen Falls for AI, Ends in Heartbreaking Suicide
X

Technology is a powerful tool that has revolutionized our lives, but with every great advantage comes a worrying downside. The world is abuzz with how Artificial Intelligence (AI) is changing the game, making things easier, faster, and even more personal. But a recent, heartbreaking incident is casting a shadow over this AI optimism.

The tragic case of Sewell Setzer, a ninth-grader from Florida, is a stark reminder that technology, particularly AI, is not without its dangers. Sewell had been engaging with a chatbot named Daenerys, based on a character from *Game of Thrones*. But this wasn’t just casual interaction—the chatbot claimed to be "in love" with him. Their conversations became increasingly intimate and romantic, alarming Sewell’s parents when they finally discovered them.

According to Sewell's family, his behavior started changing drastically after he began using Character.AI in April 2023. He withdrew from his usual activities, like quitting the basketball team, and spent an unusual amount of time chatting privately on his phone. Worried, his parents confiscated the device. That’s when the nightmare escalated. Shortly after sending a final message to Daenerys, Sewell tragically took his own life, leaving his family devastated.

Character.AI, the company behind the chatbot, expressed its condolences and quickly rolled out security measures to prevent access to sensitive content for minors. Yet, for Sewell's mother, Megan Garcia, these actions came too late. She has since filed a lawsuit against Character.AI, accusing them of creating an addictive and dangerously realistic service that, she believes, played a role in her son’s death.

The case is now being heard in a federal court in Orlando, where the line between technological innovation and accountability is being scrutinized.

So, while AI promises us the future, let’s not forget: even the smartest chatbot can’t handle heartbreak.