[...] One trains a neural network on specific, finite datasets. The ability to pattern-match more generally presupposes the existence of redundancy in the data and thus self-similarity. So, one could argue that the ability to discern redundancy in data is the ability to learn about how things imitate or repeat themselves (like the data-mining software that tells us which books we want to buy).