The invasion of AI-generated content on TikTok: the challenge of junk content for the user

  • A recent study reveals that almost 60% of the content new users see on TikTok is generated by low-quality artificial intelligence.
  • Children's categories are the most affected, with specific labels where 97% of the videos are synthetic creations.
  • The volume of this phenomenon on TikTok is three times higher than the rate recorded on other similar platforms such as YouTube Shorts.
  • European regulations through the AI ​​Act seek to impose clear labeling to protect consumers from algorithmic misinformation.

Impact of artificial intelligence on social networks

Opening a social network today has become a somewhat strange experience where suddenly They're trying to pull a fast one on us. with videos that look real but make absolutely no sense. What was once a space for creators to share their hobbies now seems to be suffering a silent flood of unedited material. This phenomenon is transforming the first impression new users have when they land on short-video platforms, where the algorithm rules without any prior filtering.

Experts are increasingly concerned about the proliferation of automatically generated content And with virtually no creative value, this type of material has already earned its own name in the industry. This deluge of synthesized videos not only affects the quality of entertainment but also raises serious questions about the veracity of what we consume daily, especially when it comes to information aimed at the most vulnerable or topics of particular social relevance.

consumption of short videos vs. TV-1
Related article:
Short videos or traditional television? This is how content consumption is changing.

The massive influx of synthetic material into the Para Ti feed

Analysis of AI-generated videos

An exhaustive investigation carried out by the Kapwing platform has quantified a reality that many users already suspected. After analyzing more than ten thousand publications Divided into twenty different categories, the data is quite devastating: approximately 59% of the first 500 videos a newly created TikTok account receives are generated entirely by artificial intelligence. This content, often of low quality, seeks only to hold attention in order to accumulate views through repetitive formulas.

If we put these figures into perspective with other competing platforms, the result is even more striking. According to the same report, this rate triples the data These figures are based on YouTube Shorts, where synthetic content for new accounts accounts only accounts for 21%. It seems the Chinese social network's initial recommendation system prioritizes the volume of quick interactions over understanding the user's actual tastes, ultimately filling the screen with artificial voices and animations that are sometimes unsettling.

These types of videos are produced en masse at virtually no cost, allowing certain profiles to publish hundreds of pieces per day. In the end, the algorithm ends up rewarding This keeps the user glued to the screen for the first few seconds, even though the background of the publication adds nothing of value or is simply a collection of distorted images and meaningless scripts.

YouTube
Related article:
YouTube uses AI to verify age and tighten content controls

The smallest ones in the algorithm's crosshairs

Risks of AI content for children

The situation becomes especially delicate when we look at what children are seeing. The study indicates that the children's category is the most saturated with this type of digital junk, reaching 57,4%. The most worrying aspect is found in specific hashtags like #CartoonKids, where They are approaching 97% of videos generated by automated tools. It is very common to encounter familiar characters in absurd situations or educational lessons that contain blatant errors that a child will hardly be able to detect.

From the field of pediatrics, expert voices like that of Dr. Dana Suskind warn that we are facing a kind of industrial-scale misinformation campaign. Every video a child consumes contributes to form neural connectionsAnd if these experiences are based on incoherent or incorrect content, there is a risk of wiring the brain inappropriately during critical stages of learning and cognitive development.

Furthermore, even categories that should be rigorous, such as health, science, and history, are not immune to this trend. With rates ranging from 33% to 35%, it's not uncommon to find purported historical lessons or medical advice. spoken by synthetic voices that have not been supervised by any specialist. This creates an environment where real information has to compete with a flood of fabricated data presented with a professional-looking aesthetic.

The BBC reaches a content agreement with YouTube
Related article:
The BBC closes a content deal with YouTube to attract a younger audience

Regulation in Europe and transparency measures

European regulations on AI

In Europe, authorities have already taken action to try to curb this lack of control. With the full implementation of the AI ​​Act, large platforms have the obligation to clearly label Any content that has been generated synthetically and that could be misleading. The goal is for the consumer to know at all times whether what they are seeing has been created by a person or a machine, thus preserving the right to truthful information, similar to how Brussels is monitoring Google's AI and their training sources.

For its part, TikTok has taken action by allocating an educational fund of approximately two million dollars to improve digital literacy and safety related to artificial intelligence. They have also implemented controls that allow users decide if they want to see more or less this type of content appears on their walls. However, critics point out that these measures are passive and do not address the root of the problem: an algorithm designed to maximize dwell time at any cost.

Interestingly, there are sectors where the human touch remains undisputed king. In categories like fashion, music, or fitness, the presence of this material is almost anecdotal, falling below 2%. This demonstrates that when the value of the publication depends on the sensory or physical experience According to the creator, artificial intelligence has not yet managed to be convincing or gain the audience's trust in the same way it does in other niches.

Encyclopedia Britannica and Merriam-Webster sue OpenAI over the use of their content in ChatGPT
Related article:
The lawsuit filed by Encyclopedia Britannica and Merriam-Webster against OpenAI for the use of their content in ChatGPT stirs up the debate about AI

Future of content creation

Despite efforts to regulate and label, the reality is that the industrialization of content creation is here to stay. The ease of mass-producing videos represents an unfair competitive advantage for those seeking quality, as they have to fight for every second of attention versus machines that never rest. This forces flesh-and-blood creators to seek out much more authentic formats that are difficult to replicate through automated processes, while some companies like Disney allows you to create content with AI. integrating these tools into their platforms.

Ultimately, it seems the success of these platforms will depend on whether they can balance their retention metrics with a minimum of editorial honesty. If a user's initial feed becomes a showcase of artificial garbage, the risk of people getting fed up and look for more humane alternatives It's real. The key will be whether European regulations succeed in making transparency the norm and not the exception in an increasingly difficult-to-decipher digital environment.

Digital content consumption

The saturation of artificially created videos on TikTok presents a scenario where quantity has begun to devour quality, especially in users' initial interactions with the app. While the educational and health categories are compromised by unverified information, European regulations are attempting to establish barriers to protect consumers, particularly minors, from an environment dominated by massive amounts of synthetic content. The platform's future will inevitably hinge on the ability of its algorithms to distinguish between genuine creativity and the automated filler that currently floods much of the digital experience.

Grok App Store controversy
Related article:
Grok and the App Store: The controversy over Elon Musk's AI content

Add as preferred source