The Invariance Principle

How statistical invariances will help us build AI systems exhibiting human-like performance by following human-like strategies.

Current machine learning systems crumble when the distributions of training and testing examples differ in spurious correlations. This is a major roadblock toward the development of advanced machine intelligence, which demands not only human-like performance but the deployment of human-like strategies. The prevalent approach in AI, fixated on recklessly minimizing a...