Useful Offline, Harmful Online

A bounded mixture state predicted much of an oracle’s value offline, yet repeated learned control shifted its own inputs and failed until a limited, partial correction.

ai-research, bayesian-filtering, nonlinear-filtering, imitation-learning, distribution-shift