The maximum likelihood method is a very rigorous statistical method of estimation. The word likelihood has the same meaning as the word probability. The method of maximum likelihood is not restricted to some specific type of analysis as the least square method; rather its application is universal provided the probability distribution of the population is known. By this method we are able to obtain an estimate of the parameter which is most likely to be true (i.e., it has maximum probability to be true). The method of determining maximum likelihood estimates is briefly stated in the following few steps.
- Formulate the likelihood function (). The likelihood function is the joint probability distribution of a sample of values of random variable.
- If the likelihood function () is in the exponential form, it will be much more convenient, if we write it down in the logarithmic form, i.e., find
- Maximize or with respect to the parameter whose estimate(s) is (are) desired using the technique of differential calculus.
Find the maximum likelihood estimate of the parameter in a normal population assuming known.
Let the random sample is drawn from a normal population, each of the will be normally distributed i.e.
The likelihood function will be the joint distribution (product) of all these density functions, therefore,
To simplify the process of maximization take the logarithm of both side, therefore
Now the necessary condition foe maximization is that the first derivative with respect to should be zero, therefore,
Hence (the sample mean) is an estimator of the population mean.