Relation

Example for the Variance of an Estimator

Let θ^m\hat{\theta}_m be an unbiased estimate the average value θ\theta of Bernoulli distribution XiX_i θ^m=1mi=1mXi\hat{\theta}_m = \frac{1}{m}\sum_{i=1}^{m}X_i θ=E(Xi)\theta = \mathbb{E}(X_i) Therefore the Variance of θ^m\hat{\theta}_m is as follows: Var(θ^m)=Var(1mi=1mXi)Var(\hat{\theta}_m) = Var(\frac{1}{m}\sum_{i=1}^{m}X_i) =1m2Var(i=1mXi) = \frac{1}{m^2}Var(\sum_{i=1}^{m}X_i) =1m2i=1mVar(Xi) = \frac{1}{m^2}\sum_{i=1}^{m}Var(X_i) =1mVar(Xi) = \frac{1}{m}Var(X_i) =1mθ(1θ) = \frac{1}{m}\theta(1 - \theta) Note that for this example as mm increases the variance of the estimator approaches zero in the limit, so long as the value for θ\theta is defined.

0

1

Updated 2021-05-24

References


Tags

Data Science