A point estimate is a single-value estimate of a population parameter.
We say that a statistic is an unbiased estimator if the mean of its distribution is equal to the population parameter.
- Otherwise, it is a biased estimator.
Ideally, we want estimates that are unbiased with small standard error.
- For example, a sample mean (unbiased) with a large sample size (results in smaller standard error).