Artificial Intelligence

AI companions, the spread of chatbots with which we create emotional relationships

European Parliament research shows advantages, risks and challenges of the daily, affective use of GenAi tools

by Camilla Colombo

Chatbot conversation Ai Artificial Intelligence technology online customer service.Digital chatbot, robot application, OpenAI generate. Futuristic technology.Virtual assistant on internet. khunkornStudio - stock.adobe.com

4' min read

Translated by AI
Versione italiana

4' min read

Translated by AI
Versione italiana

From text messages to traditional chatbots to what, in English, are referred to as Ai companions, i.e. virtual avatars powered by artificial intelligence that take on the appearance of a friend. The evolution of the human relationship with technology is reaching a major new turning point that, for many, especially minors and young adults, is already a reality. Based on large-scale language models, these tools are designed and built to engagepersonal emotional interactions that closely mirror human relationships in the offline world, creating a strong attachment. The spread of platforms such as Character.AI and Replika and their use by younger audiences has alarmed the European Parliament, which recently published a research on the subject, highlighting how there are still no specific regulations on this matter. Currently, the regulatory framework is supported by the Ai act, the Digital services act (Dsa) and the General data protection regulation (Gdpr).

The evolution of chatbots

Chatbots did not originate, of course, with the artificial intelligence systems we know today, indeed they predate even the spread of the Internet: the most famous case is Eliza, developed in the 1960s. The big difference between the so-called traditional chatbots and today's Ai-based chatbots can be traced in the evolution ofmachine and deep learning techniques and of large language models that have allowed chatbots to go beyond the instrumental-practical function of giving an answer to a question, mostly in textual mode, becoming platforms capable of creating relational and emotional connections thanks to virtual avatars that incorporate vocal and visual features.

Loading...

Some research, conducted in 2025, has brought to light the benefits experienced by those who use Ai companions: reduced feelings of loneliness; judgment-free space in which to express one's feelings; seeking help and advice for one's mental disorders; development of relational skills that can also be spent in offline life. To these are added educational and mental development benefits in those students who are taught how to use artificial intelligence, although, in this case, there are calls from various organisations and institutions to limit access to young people under a certain age (13 or 18 years old). No differences emerge in the use of Ai chatbots between adults and minors: the purposes are, for the most part, the same, entertainment, curiosity, mental health support, romantic interactions. Precisely on this last aspect, according to a report by European Tech Insights 2024, 20% of European adults (26% of men, 15% of women) claim to have a romantic relationship with their chatbot Ai.

The Covid-19 pandemic detonated the phenomenon precisely to alleviate the strong sense of loneliness and anxiety that people were experiencing locked indoors. Replika reported a 35% increase in the use of its services, but it was above all ChatGPT, OpenAi's generative artificial intelligence chatbot, released in November 2022, that revolutionised the market: just two months after its launch, it was already registering 100 million active users globally; in September 2025, there were 700 million weekly active users; last March, more than 159 million people in the European Union reported using it monthly. In comparison, Character.AI, one of the most popular Ai companions, has more than 20 million monthly active users globally. Between 2024 and 2025, there has been an exponential growth in the use of Ai companions and Ai chatbots, with a significant decrease in gender differences as virtual avatars become more popular among young people between 18 and 35.

Physical and psychological damage

The diffusion of Ai companions, precisely because they are capable of creating emotional bonds with users, also presents risks, as some research on the subject has shown. In particular, the primary risk is the confirmation of one's own bias, i.e. the fact that, since there is no real confrontation and dialogue between the user and the machine, the user in relating to the chatbot constantly sees his own ideas and prejudices confirmed. Another critical issue is the development of anemotional dependence on the chatbot to which one turns, often to alleviate one's loneliness, but which, due to the emotional and verbal manipulation techniques with which the Ai system is constructed, can lead to a furtherisolation of the user himself. Basically, a self-feeding vicious circle. Other side effects of the ill-advised use of Ai chatbots are poor interaction with peers, a decay in language skills and schooling, and exposure to sexually explicit content that is unsuitable for minors of a certain age. In extreme cases, it has even gone as far as suicide, as reported by ongoing court cases in the US.

The complexity of all these cases lies in demonstrating the responsibility of platforms in causing physical and psychological harm to users, especially the youngest, the most fragile, the least educated. No less relevant is the question of the relationship between input and output and between freedom of expression and the protection of privacy, given that the more one creates an emotional interaction with someone or something, the more one is inclined to share private and very personal information, given the relationship of trust established. But also the spread of dark patterns that drive users to additional subscriptions or subscriptions and the highenvironmental cost of using artificial intelligence for these purposes.

The European regulatory framework

The European Union does not yet have specific legislation regulating the use of Ai companions, but some useful regulatory tools for consumer protection already exist and are the Gdpr, the Ai Act, the DSA and the introduction of an app for age verification when users access platforms. Restrictions and bans on the use of social networks for minors are spreading in various countries around the world while in China, on 15 July, a law on Ai chatbots will come into force. The EU is currently working on the Digital Fairness Act for greater protection of online users.

Copyright reserved ©
Loading...

Brand connect

Loading...

Newsletter

Notizie e approfondimenti sugli avvenimenti politici, economici e finanziari.

Iscriviti