Can AI Learn to Sleep?

What the brain’s memory replay teaches us about catastrophic forgetting I taught GPT-2 120 made-up facts, then 120 more, and it lost almost all of the first set: recall fell from 98% to 6%. Then I let it “sleep”, replaying its own dreams of the old facts while it learned the new ones. It kept 40%. Giving it a separate, frozen memory to dream from, like a hippocampus, kept 58%, the best result in every run. ...

November 20, 2026 · 10 min · 1945 words · Marya