Further reading (fancier math): the perspective of derivatives as linear operators is sometimes called a Fréchet derivative and you can find lots of very abstract (what I'm calling "fancy") ...

Microsoft Research conducts fundamental science and technology research across a spectrum of research areas. With labs around the globe we pursue breakthroughs across the computing and AI stack to ...