The Parameters of Your Model Are Correlated. Now, What?

Image generated using the title as the prompt on Stable Diffusion

You just got yourself a nice set of data, for example, real estate prices with the characteristics of the homes. A question you could ask yourself is: How do I predict the price of a house based on its characteristics?

The first model that comes to mind would be a linear model taking the characteristics as inputs. Let’s say that we have access to the following…