Learn Before
Relation
Weak and Strong Priors
Priors can be considered weak or strong depending on how concentrated the probability density in the prior is.
• Weak prior: with high entropy and high freedom to change parameters and allows the data to move the parameters more or less freely. E.g., Gaussian distribution with large variance.
• Strong prior: has low entropy and low freedom to change parameters and plays a more active role in determining where the parameters end. E.g., Gaussian distribution with small variance
0
1
Updated 2021-07-01
Tags
Data Science