I made a small animation to illustrate how I think about simple ReLU-based feedforward networks.