Home
Algebra
Math Formulas
Everyday Math
Calculus
FREE e-Books
Geometry
Basic Statistics
Contact
Exclusive Topics
Basic Mathematics
Basic Algebra
Algebra
Everyday Math
Geometry
Trigonometry
Calculus
Business Math
Basic Statistics
Linear Programming
 
Other Math Links
Math Results And Formulas
Free Math E Books
History Of Mathematics
 
Higher Mathematics
Real Analysis
Group Theory
General Topology
 
» Home » Basic Statistics »

Maximum Likelihood Estimation

The maximum likelihood estimation is a very rigorous statistical method of estimation. The word likelihood has the same meaning as the word probability. The method of maximum likelihood is not restricted to some specific type of analysis as the least square method; rather its application is universal provided the probability distribution of the population is known. By this method we are able to obtain an estimate of the parameter which is most likely to be true (i.e., it has maximum probability to be true). The method of determining maximum likelihood estimates is briefly stated in the following few steps.

  1. Formulate the likelihood function (L). The likelihood function is the joint probability distribution of a sample of n values of random variable.
  2.  If the likelihood function (L) is in the exponential form, it will be much more convenient, if we write it down in the logarithmic form, i.e., find LnL
  3. Maximize L or LnLwith respect to the parameter whose estimate(s) is (are) desired using the technique of differential calculus.

 


Example:
            Find the maximum likelihood estimate of the parameter in a normal population assuming  known.

Solution:
            Let the random sample  is drawn from a normal population, each of the  will be normally distributed i.e.
                                  

            The likelihood function will be the joint distribution (product) of all these density functions, therefore,
                                      

                              or

            To simplify the process of maximization take the logarithm of both side, therefore
                                   
            Now the necessary condition foe maximization is that the first derivative with respect to  should be zero, therefore,
                                  
            Therefore,
                                          
Hence (the sample mean) is an estimator of the population mean.  


Comments

Join Us on Facebook Follow Us on Twitter


© emathzone 2008-2012