The Rise of AI-Generated Content and the Challenge of Identifying Fakes
In an era where artificial intelligence (AI) is becoming increasingly sophisticated, distinguishing between real and fake content has become a growing concern. A recent example of this challenge came from a story that claimed a mysterious piano appeared on a London railway station platform, causing confusion among commuters. However, this story was not based on reality—it was generated by an AI chatbot named ChatGPT. It took only a few minutes to create, highlighting how easily AI can produce convincing but entirely fabricated narratives.
More than 34 million AI-generated images are produced every day, with technology constantly improving its ability to create lifelike photos and videos. This rapid development raises serious concerns about the potential misuse of such tools. Naomi Owusu, CEO and co-founder of digital publishing platform Tickaroo, warned that AI imagery doesn’t just fake reality—it bends context, potentially driving dangerous false narratives. Once people see something, it can install a “new reality” in their minds, making it difficult to undo the impression even if the content is later proven to be false.
Experts have identified several ways to spot AI-generated fakes, at least for now.
1. Pay Attention to Details
Images created using text-to-image algorithms often look good from a distance but may reveal flaws up close. Vaidotas Šedys, chief risk officer at Oxylabs, noted that hands are a common giveaway. Too many fingers, misaligned limbs, or strange shadowing can indicate that an image is not human-made. In the case of the AI-generated piano story, the text contained spelling errors, such as “fuli-sized” and “E-Dutton,” while the font appeared smeared. Similarly, a viral TikTok clip showing bunnies bouncing on a trampoline had animals that blended into one another and warped unnaturally—something that doesn’t happen in real life.
Julius Černiauskas, CEO of Oxylabs, added that video fakes often exhibit unnatural movements and poor quality, including grainy images.
2. Watch for ‘Robotic’ Writing
AI-generated content often lacks natural rhythm and relies on generic examples. While many people, including parents, politicians, and CEOs, have been fooled by AI images, this is exactly what the technology is designed to do: look real. The style of AI-generated writing is typically overly polished and robotic, which can be a red flag.
3. Understanding Deepfakes vs AI
Deepfake technology allows users to swap faces, voices, and other characteristics to create realistic digital puppets. Some individuals use deepfakes for scams or extortion, fabricating compromising evidence to deceive others. Others use them to spread misinformation, often with political motives. These fakes can destabilize countries, sway public opinion, or be manipulated by foreign agents. Even those who create deepfakes for fun may cause significant harm without realizing it.
4. Use Reverse Image Search and Other Tools
AI excels at creating realistic faces, which can make it harder to detect fakes. Researchers have found that AI-generated faces are often perceived as more realistic than actual photographs. This means that if someone’s face looks too perfect, it could be a sign that the image is fake.
Owusu emphasized the importance of checking sources rather than relying solely on visual cues. She advised using common sense: ask yourself how likely it is that what you’re seeing is real and whether it’s plausible that someone captured that exact moment. If something looks too Photoshopped, it might be AI. Tools like reverse image search can help identify whether an image has appeared elsewhere online. If it cannot be traced, it should be treated as unverified, no matter how compelling it appears.
Services like ZeroGPT can analyze text to determine if it was generated by AI. Checking metadata—the digital fingerprints embedded in photos, documents, and web pages—can also help identify suspicious content.
5. Curate Your Social Media Feeds
Social media platforms are increasingly flooded with AI-generated content. According to an analysis by the Garbage Day newsletter, four of the top 10 YouTube channels by subscribers featured AI-manufactured material in every video. Some creators do not disclose that their content is AI-generated, either by failing to mention it in captions or by not using tags like “Made with AI.” In some cases, entire accounts are nothing more than AI bots, spreading inauthentic posts and images.
Adam Marrè, chief information security officer at Arctic Wolf, urged people to carefully consider where they get their information from and to only trust content from reputable or official sources.
Why This Matters
AI is now being used to generate everything from emails and budget plans to life advice. However, it is also being used to create a flood of fake photos and videos involving world leaders, political candidates, and their supporters. This misinformation can influence elections and weaken democratic processes, as previously reported by zaia news.
The International Panel on the Information Environment found that AI was used in 80% of the over 50 elections held last year. Experts warn that counterfeit images and videos will soon be nearly impossible to distinguish from authentic ones, further eroding public trust.
As governments and regulators attempt to control AI hoaxes, the technology continues to advance faster than legislation. Šedys emphasized the importance of critical thinking as the best defense against AI-generated content. “Don’t trust everything you see on your screen,” he said.