Spooky action at a distance in the loss landscape

This is an link post, originally posted at https://www.lesswrong.com/posts/2N7eEKDuL5sHQou3N/spooky-action-at-a-distance-in-the-loss-landscape.