The Art of Ignoring: Why Intelligence Is Not About Memory
There's a seductive lie we tell ourselves about intelligence is the smarter means knwoing more, remembering more and processing more and that AI systems should aspire to be omniscient databases.
This is catastrophically wrong.
Perfect memory is the enemy of intelligence, not its pinnacle.
Intelligence isn't about remembering everything, its about knowing what to take and what to ignore.
Borges understood this in 1942. His character funes could remember every leaf, every cloud and everysecond of his life. It destroyed him.
"to think is to forget differences, generalize and make abstractions"
Neuroscience confirms brain actively forgets to make better decisions. AI has learned the same lesson, transformers dont try to process everything equally, rather
They compute attention. what matters right now, for this specific task
The smartest systems whether biological or artificial, share one trait which is the discipline to delete.
forgetting some memories can be beneficial as this can lead to more flexible behaviour and better decision making.
Three questions define intelligence: What to look at. when to look at. what to ignore
The third is the hardest.
The bottleneck isn't storage. It is focus.