Learn Before
Concept
Normalizing OECs
OECs should typically be normalized by the randomization unit. For example in comparing variants, the control group and the treatment groups to see which one generated more revenue, it would be a mistake to look at total revenue. The better OEC would be revenue-per-user. This is because even if the allocated traffic was equal, by chance (or on purpose) there can be differences in the sample sizes of the two (or more) groups.
0
1
Updated 2020-06-14
Tags
Data Science