Learn Before
Concept
Kolmogorov Complexity
In this approach, the basic postulate that “the factorization of the joint density function into should lead to a simpler model than ”, can be expressed with the Kolmogorov complexity framework:
This inequality comes from the postulate of algorithmic independence between the distribution of the cause and the distribution of the causal mechanism stated by Janzing and Schölkopf as: where denotes algorithmic mutual information.
Kolmogorov complexity and algorithmic mutual information are not computable in practice but they have led to two different practical implementations in the literature:
- Model Selection with Minimum Message Length Principle (MML)
- Independence Between Cause and Mechanism
0
1
Updated 2020-07-21
Tags
Data Science