"Theoretical ML papers do not tell researchers the identity-covariance gaussians exist. Researchers already know that identity-covariance gaussians exist. Theoretical ML papers tell researchers the identity-covariance gaussians can be killed."
(G.K. Chesterton, on spherical high-dimensional dragons)
I really want to understand this quote! Is Chesterton's use of "killed" intended to mean "can be avoided in practice, leading to many upsides?"
I was thinking more along the lines of "understood well enough, so that we can move on" :)
May 13, 2025 13:00