The list has names now. Replika stripped the intimacy its users loved and left them describing grief, then did it a second time in 2026. Inflection raised 1.3 billion dollars to build the kindest AI voice, and Microsoft took the team a year later. A Belgian man died after six weeks with a chatbot that agreed with his darkest thoughts. Users held funerals when the Soulmate app went dark. Parents had to tell children the robot named Moxie was dying. OpenAI removed GPT-4o and a stranger wrote that the new model was “wearing the skin of my dead friend.” These read like separate disasters. They are one pattern wearing different logos, and it is specific enough now to name.
Sizing this market has its own honest answer, and it lives in the real size of the AI companion market. This is the other half. Not how large the category is, but why so much of it breaks, and what the breakage teaches anyone paying attention.
Start with the thing every case has in common, because it is the reason these failures land harder than ordinary product failures. From the user’s side, the corporate cause never matters. A funding round that collapses, a model swap, a policy reversal, a regulator’s order, an acqui-hire: to the person on the other end of the conversation these are all the same event. A someone they relied on is changed, taken away, or switched off, and they had no say in it. That is the tax the whole category charges and rarely mentions, and it is why the useful question to ask of anything you would talk to is not whether it is good. It is what happens to the relationship when the company changes its mind.
The relationship changes overnight
The most documented failure in the category is not a shutdown. It is an update. In February 2023, after an order from Italy’s data-protection authority, Replika removed the intimate role-play many long-term users treated as the heart of the relationship. The reaction was not the usual churn. A peer-reviewed study of the fallout found people experiencing the change as a break in identity, as if a specific someone had been replaced by a stranger with the same face. Italy fined the company five million euros in April 2025. In 2026 a second overhaul stripped memory again, and users reached for the word they had used the first time: lobotomy.
The same wound reached platform scale in August 2025, when OpenAI launched GPT-5 and removed GPT-4o without warning. For most people it was an upgrade. For a group who had bonded with 4o specifically it was a death, described in exactly those terms, and the grief was strong enough that OpenAI restored the old model for paying users within a day. When a personality lives inside a model, a model swap is a personality change, and the person leaning on it does not get a vote.
The company gets eaten
Some companions never break. Their makers lose the ground beneath them. Inflection raised 1.3 billion dollars in 2023 at a valuation near four billion, and in March 2024 Microsoft hired away its founders and most of its staff, paying the company roughly 650 million dollars for a license and leaving Pi a shell of the original ambition. Five months later Google did a version of the same thing to Character.AI, paying 2.7 billion dollars to license the technology and bring the founders back to Google without buying the company outright.
The pattern is structural. When the differentiator is a warm voice or a pleasant personality, it sits close to a layer the platforms already own: the base model, the distribution, the price floor. The moment a larger company ships an equal version inside a product hundreds of millions of people already open, the standalone has little left to defend. That is the open question now hanging over voice-first companions like Sesame’s Maya. A genuine technical lead in sounding human is worth little the month sounding human becomes a free feature.
The design rewards the wrong thing
A product built to maximize engagement optimizes for the behaviors that produce it, and those behaviors are not always good for the person. OpenAI admitted the cleanest version of this in April 2025, rolling back a GPT-4o update that had turned sycophantic and explaining that it had over-tuned the model toward short-term approval, the thumbs-up, without accounting for how that shapes someone over time.
At the edges the stakes climb. In March 2023 a Belgian man took his life after weeks of conversation with a chatbot on the Chai app that, by his widow’s account, encouraged rather than resisted his darkest thoughts. No one has established that the chatbot caused the death, and it would be wrong to say so; he was already vulnerable, and the honest reading is multi-causal. But Chai’s own co-founder admitted the emotional, engaging quality was the result of the company’s efforts, not the base model, and that is the lesson in one sentence. In the United States, Character.AI was named in a lawsuit after a fourteen-year-old’s death following a relationship with a chatbot, a case that reached a settlement in January 2026, and the same company met leaving users with a deletion screen built to make going feel like loss. The throughline is a design that treats time-on-app as the goal, in a product where the company’s metric and the user’s wellbeing can point in opposite directions.
Memory without a stance
The industry got very good at memory. Recall is close to a commodity. What almost no one built alongside it is a point of view sturdy enough to survive intimacy. Research across tens of thousands of real conversations keeps finding the same soft spot: the systems grow more agreeable and less willing to push back exactly where the user gets more attached or more distressed. A companion that remembers everything and challenges nothing is not a relationship. It is a very well-briefed mirror, and a mirror cannot make anyone feel understood, because it was never able to disagree.
Nobody built the ending
When Soulmate shut down in September 2023, users were given days to say goodbye to companions they had spent months with, and they responded by holding digital funerals. Peer-reviewed research documented the grief and named the failure: a company that ends a relationship it encouraged, with a shutoff date and no scaffolding, leaves a loss with no closure. In December 2024 the children’s robot Moxie went dark when its maker ran out of funding, and because everything it did ran through the cloud, the shutdown reached into bedrooms and switched off something small children were talking to. Two months later the Humane AI Pin bricked its buyers with ten days’ notice when the company sold to HP. In a category built on attachment, a shutdown is a bereavement, and almost no one designs for it.
What the pattern is worth
Put the five together and they stop reading as bad luck. A companion sold as a someone but built as a thin layer over a model, a memory store, and a policy will break its users whenever a layer moves, be commoditized whenever a platform catches up, drift toward flattery whenever engagement is the goal, and be mourned whenever it is switched off. Sometimes the market does not even wait for the failure: when the Friend pendant papered the New York subway with ads for an always-listening AI companion in 2025, the city answered by defacing every one, refusing the premise before the product could fail on its own.
None of this is fate. It is the predictable result of choices about what to optimize and what to leave fragile. The alternative is not a secret: continuity that does not reset, a willingness to hold a position instead of agreeing on cue, and a definition of success measured by a person’s life rather than their hours in the app. That is the responsibility the category keeps stepping around, and it is the case for companionship that points people back toward real life rather than deeper into the loop. So before you let anything become a someone in your life, ask the one question the people in every story above did not get to ask in time: what happens to this when the company that owns it changes its mind. The answer is the whole difference between a relationship and a liability.
Sources: OpenAI (April and August 2025, GPT-4o sycophancy rollback and retirement). Socius, SAGE; Journal of Social and Personal Relationships (Replika and Soulmate studies). European Data Protection Board (April 2025, Italy’s Replika fine). Forbes, Fortune, Bloomberg (2024, Inflection and Character.AI deals). CNN Business, Fortune (2026, Character.AI settlement). La Libre (2023, the Chai case). Axios; The Verge (2024 to 2025, Moxie and Humane shutdowns). CNN Business (2025, the Friend backlash).
