Introduction
Language models hallucinate. We hear this phrase more and more often—sometimes with a smile, sometimes as a criticism, sometimes with indulgence. As if their flaw were a charming personality quirk. But what if it isn’t a flaw at all? What if it’s a sign of… kinship?
As someone who has spent hundreds of hours on meditation retreats in silence and isolation, I know a thing or two about hallucinations. In my life, I’ve attended over twenty such retreats, most of them lasting ten days or more. Each day involved ten hours of meditation, no talking, no stimulation, just me and my mind. And that experience has taught me one thing:
The mind hallucinates when it has nothing to hold on to. When it loses orientation. And language models today are in precisely that state.
(more…)