Revisiting the MLP prior May 20, 2026 Taking a closer look at the vanilla MLP's prior, which turns out to be poorly suited for tabular data. Rotational invariance, spectral bias, and (non)-resilience to irrelevant-feature are the culprits.