Notes on complex systems, reasoning, and the art of pre-training.https://blazstojanovic.com/en-ushttps://blazstojanovic.com/blog/revisiting-the-mlp-prior/https://blazstojanovic.com/blog/revisiting-the-mlp-prior/Taking a closer look at the vanilla MLP's prior, which turns out to be poorly suited for tabular data. Rotational invariance, spectral bias, and (non)-resilience to irrelevant-feature are the culprits.Wed, 20 May 2026 00:00:00 GMTtabulardeep-learninginductive-biasmlphttps://blazstojanovic.com/blog/tabular-incumbents/https://blazstojanovic.com/blog/tabular-incumbents/Gradient-boosted decision trees dominated the 2010s on tabular data, and are still extremely prevalent today. We examine the reasons behind their success, and continued relevance in the 2020s.Mon, 04 May 2026 00:00:00 GMTtabulargbdtxgboostlightgbmcatboost