· ai
I broke GPT-2: How I proved Semantic Collapse using Geometry (The Ainex Limit)
TL;DR I forced GPT‑2 to learn from its own output for 20 generations. By Generation 20 the model lost 66 % of its semantic volume and began hallucinating state...