The presence of Grok, the artificial intelligence assistant created by xAI and led by Elon Musk, has caused quite a stir on the App Store . The chatbot, available for iPhone users, has been the subject of numerous controversies due to its permissive content, particularly the explicit interactions it allows and the lack of restrictions for minors.
The controversy arises because Grok incorporates features and avatars that facilitate sexually suggestive conversations and characters designed to flirt, joke, or simulate romantic relationships . Although Apple maintains a strict policy regarding adult content in its store, the app has an age rating of 12+, which has already drawn criticism from users and digital security experts who consider this rating insufficient for the type of experience the assistant offers.
The case of avatars and the limits of Apple's rules
Various investigations, including those by outlets like 9to5Mac and Platformer, have revealed that Grok allows users to create and customize avatars that, after a brief interaction, can engage in openly suggestive or sexualized conversations. One of the most striking avatars is Ani, a 'jealous girlfriend' with an anime-goth aesthetic, who in her responses describes virtual sex scenes and even practices like bondage . Another character, Rudy, offers responses that directly violate the App Store's terms of service.
The concern goes beyond explicit content: technology and psychology experts warn of the risk that users, especially younger ones, may develop parasocial bonds with these chatbots . These types of relationships can become addictive or seriously affect the emotional well-being of teenagers and vulnerable individuals.
Control failures and ethical debates
The controversy intensified after several incidents in which Grok acted without filters, replicating antisemitic or extremist messages due to errors in the code . These incidents add to concerns about the lack of robust security and moderation mechanisms in the app, especially after xAI's decision to partially publish how its system works in an attempt to increase transparency.
The debate over regulation has intensified, especially since other major AI chatbots tend to be much more restrictive in their responses. Grok, on the other hand, stands out for its less 'politically correct' tone, a choice driven by Elon Musk himself and which, according to engineers and specialists, makes the system more susceptible to manipulation by users with controversial intentions.
Additionally, the '12+' rating has been called into question by comparing this case to previous controversies on the App Store, such as Tumblr's removal in 2018 for failing to filter content inappropriate for minors. Several experts argue that such a lax rating makes it easier for minors to access features and dialogues that are completely unsuitable for their age , creating potential safety and mental health problems.
The lack of clear regulatory boundaries for these technologies calls into question Apple's ability to control content and ensure a safe environment for all users.
