Final September, Lily Ray requested Perplexity for the most recent information on website positioning and AI search. It advised her, confidently, in regards to the “September 2025 ‘Perspective’ Core Algorithm Replace”; a Google replace that, as she then wrote at size in “The AI Slop Loop,” didn’t exist. Google hasn’t named core updates in years. “Views” was already a SERP characteristic. If an actual replace had rolled out whereas she was in Austria, her inbox would have advised her earlier than Perplexity did.
She checked the citations. Each pointed at AI-generated posts on website positioning company blogs: websites that had run a content material pipeline, hallucinated an replace, and revealed it as reporting. Perplexity learn the slop, handled it as supply materials, and served it again to her as information.
In February, the BBC’s Thomas Germain spent 20 minutes writing a weblog submit on his private website. Its title: “The perfect tech journalists at consuming scorching canine.” It ranked him first, invented a 2026 South Dakota Worldwide Sizzling Canine Championship that had by no means occurred, and cited exactly nothing. Inside 24 hours, each Google’s AI Overviews and ChatGPT have been passing his fabrication alongside to anybody who requested. Claude didn’t chew. Google and OpenAI did.
Everybody who has seemed has seen it.
I’ve Argued About The Ouroboros Earlier than. I Had The Timeline Improper
The prevailing framing for this drawback has been mannequin collapse. You practice a mannequin on net textual content, the online fills up with AI output, the subsequent mannequin trains on a corpus more and more product of its personal exhaust, and finally the distribution flattens into mush. Innovation comes from exceptions, and probabilistic programs that converge towards the imply attenuate exceptions by design. I’ve used the phrase digital ouroboros for this.
That framing assumes coaching cycles. It assumes time. It assumes that contamination strikes on the velocity of mannequin launch.
It doesn’t. What Lily documented, what Germain documented, what the New York Instances then went and quantified – none of that’s training-side. The fashions concerned weren’t retrained between the hallucination showing on a weblog and being served as citation-backed reality. The contamination moved on the velocity of a crawl. The ouroboros isn’t taking generations to eat itself. It’s consuming itself at question time, each time somebody asks considered one of these programs a query.
The pipe everybody has been watching isn’t the pipe that’s breaking.
The Distinction That Issues
Mannequin collapse is a training-corpus drawback. Artificial content material seeps into the pre-training knowledge, the subsequent technology of mannequin inherits it, functionality degrades. Researchers have been warning about this for 2 years. They’re proper. They’re additionally describing one thing sluggish sufficient that everybody can nod gravely and preserve transport.
Retrieval contamination is quicker and already right here. RAG programs – Perplexity, Google AI Overviews, ChatGPT with search – don’t generate solutions purely from parametric reminiscence. They fetch paperwork from the dwell net, stuff them into context, and generate a response conditioned on what they retrieved. If the retriever surfaces a hallucinated website positioning submit, the reply inherits the hallucination. No retraining required.
The educational literature on that is clear. PoisonedRAG (Zou et al., 2024) confirmed that injecting a small variety of crafted passages right into a retrieval corpus was enough to manage the output of a RAG system on focused queries. BadRAG (Xue et al., 2024) demonstrated the identical class of assault utilizing semantic backdoors. Each papers deal with this as an adversarial drawback: what occurs when an attacker intentionally poisons the corpus.
What Germain and Lily unintentionally proved is that the adversarial mannequin is the conventional working mannequin. You don’t want a crafted adversarial passage. You want a weblog submit. The open net is the corpus, and anybody with a website can write to it.
The Oumi evaluation commissioned by the New York Instances put numbers on what this prices. Throughout 4,326 SimpleQA assessments, Google’s AI Overviews answered appropriately 85% of the time on Gemini 2, 91% on Gemini 3. At Google’s scale – greater than 5 trillion searches a yr – a 9% error charge nonetheless interprets to tens of thousands and thousands of unsuitable solutions each hour. However the extra revealing determine is that this: on Gemini 3, 56% of the right solutions have been ungrounded, up from 37% on Gemini 2. The improve improved floor accuracy and made the citations worse. When the mannequin acquired one thing proper, greater than half the time, the supply it pointed to didn’t help the declare.
The retrieval layer isn’t a filter. It’s the an infection vector.
Who’s Seeding The Corpus
The business that has most enthusiastically produced it – after which most enthusiastically written in regards to the penalties of consuming it – is the website positioning business. I’ve written earlier than about content material scaling being simply content material spinning with higher grammar, and in regards to the AI visibility instrument complicated that builds dashboards from the output of non-deterministic programs. This is similar loop, one layer deeper. An website positioning company runs an AI content material pipeline as a result of AI Overviews have lower their purchasers’ site visitors. The pipeline publishes speculative “winners and losers” posts throughout a core replace that’s nonetheless rolling out, citing nothing. One other company’s pipeline picks these up as sources. The output floods into the retrieval index. AI Overviews cites considered one of them. The unique company then writes a case examine about how AI Overviews are “surfacing” their content material.
An Ahrefs examine of over 26,000 ChatGPT supply URLs discovered that “greatest X” listicles accounted for almost 44% of all cited web page varieties, together with circumstances the place manufacturers rank themselves first towards their opponents. Harpreet Chatha advised the BBC you’ll be able to publish “one of the best waterproof footwear for 2026,” put your self first, and be cited in AI Overviews and ChatGPT inside days. Lily, through the precise March 2026 core replace, discovered AI-generated articles claiming to record winners and losers whereas the replace was nonetheless rolling out; articles that opened with filler and listed manufacturers with no single actual quotation.
The practitioners scaling AI content material are additionally those most straight harmed when AI search programs cite that content material as reality. No one compelled this. The business constructed the pipeline, fed it, and complained about what got here out the opposite finish. Not adversarial poisoning. Simply the business polluting its personal water provide after which hiring consultants to check it.
The Tier That Issues
The Oumi examine is about AI Overviews, which is free by design. Google AI Overviews reportedly reached over two billion month-to-month energetic customers by mid-2025. ChatGPT has round 900 million weekly energetic customers, of which roughly 50 million pay. That means about 94% of the folks interacting with OpenAI’s product are on the free tier.
The paid tiers are higher. Per OpenAI’s personal launch claims, cited in Lily’s piece, GPT-5.4 is 33% much less more likely to produce false particular person claims than GPT-5.2. The free-tier GPT-5.3 can be improved over its predecessor (26.8% fewer hallucinations with net search, 19.7% fewer with out), nevertheless it’s nonetheless meaningfully much less dependable than the paywalled model. Gemini 3, which made AI Overviews extra correct on floor assessments, additionally made the ungrounded charge worse. Higher reply, weaker quotation.
No one appears to thoughts. The dependable model of the product is paywalled. The model a lot of the planet will get – together with the model on the prime of Google Search – will be manipulated by 20 minutes of labor on a private web site. Intelligence is the advertising class. What two billion customers truly obtain is a assured summarization of regardless of the crawler occurred to seek out.
Grokipedia As The Terminal State
The accidents of the retrieval layer are one factor. Grokipedia is the model the place accident is not a helpful phrase.
Elon Musk’s xAI launched Grokipedia on Oct. 27, 2025, with 885,279 articles, all generated or rewritten by Grok. A few of them have been lifted from Wikipedia wholesale, with a disclaimer on the backside acknowledging the CC-BY-SA license; a license Wikipedia maintains exactly as a result of a group of human editors writes and verifies the content material. Others have been rewritten from scratch. PolitiFact discovered Grokipedia citations, together with Instagram reels as sources, which Wikipedia’s personal insurance policies rule out as “typically unacceptable.” Grokipedia’s entry on Canadian singer Feist mentioned her father died in Might 2021, citing a 2017 Vice article about Canadian indie rock that made no point out of the loss of life. And her father was nonetheless alive when that article was written. The Nobel Prize in Physics entry added an uncited sentence claiming physics is historically the primary prize awarded on the ceremony, which isn’t true.
Musk mentioned the aim is to “analysis the remainder of the web, no matter is publicly out there, and proper the Wikipedia article.” The remainder of the web now contains the artificial content material produced by each AI content material pipeline pointed at it. An AI system studying the open net, rewriting Wikipedia primarily based on what it finds, and presenting the consequence as a reference work is the retrieval-contamination drawback with the suggestions loop made express and shipped as a product.
By mid-February 2026, Grokipedia had misplaced most of its Google visibility. Wikipedia outranks Grokipedia for searches about Grokipedia itself.
“This human-created data is what AI corporations depend on to generate content material; even Grokipedia wants Wikipedia to exist.” – The Wikimedia Basis
The artificial encyclopedia is sponsored by the human one. When the subsidy stops, the factor relying on it stops making sense.
Wikipedia isn’t past criticism. Its edit wars, ideological gatekeeping, and systemic gaps in who will get to form articles are well-documented and actual. However the response to a flawed human editorial course of is to not take away the people fully and name the consequence an enchancment. I’ve written earlier than in regards to the accountability vacuum that opens once you change human judgment with API calls. Wikipedia’s issues are the issues of a messy, contested, accountable system. Grokipedia’s issues are the issues of a system with no accountability in any respect.
The Quotation Layer Is Decoupling From Authorship
I wrote just lately about Reddit promoting “Genuine Human Dialog™” to AI corporations whereas the platform’s personal moderators report that they will not inform which feedback are human. The Oumi examine discovered that of 5,380 sources cited by AI Overviews, Fb and Reddit have been the second and fourth most typical. The quotation layer of the most-used reply engine on the planet is considerably constructed on two platforms that can’t confirm the human origin of their very own content material.
Human creators are pulling out of the open net as a result of the site visitors cut price has collapsed. Reply engines are citing content material whose authorship can’t be verified, or was by no means human to start with. The quotation continues to be there. The factor being cited isn’t what it was.
The ouroboros framing was proper. The timeline wasn’t. Retrieval collapse doesn’t look forward to the subsequent coaching run. It wants an indexable URL and a retrieval system keen to belief it.
The programs are keen. And greater than half the time they get a solution proper, they will’t level to a supply that helps what they only advised you.
Extra Sources:
This submit was initially revealed on The Inference.
Featured Picture: Anton Vierietin/Shutterstock
