Linear Regression

Regression:

The word regression was used by Frances Galton in 1985. It is defined as “The dependence of one variable upon other variable”. For example, a weight depends upon the heights. The yield of wheat depends upon the amount of fertilizer. In regression we can estimate the unknown values of one (dependent) variable from known values of the other (independent) variable.

Linear Regression:

When the dependence of the variable is represented by a straight line then it is called linear regression, otherwise it is said to be non linear or curvilinear regression.

For Example, if X is dependent variable and Y is dependent variable, then the relation Y = a + bX is linear regression.

Regression Line of Y on X:

Regression lines study the average relationship between two variables. In regression line Y on X, we estimate the average value of Y for a given value of X.

Y = a + bX

Where Y is dependent and X is independent variable. Alternate form of regression line Y on X is:
           

\begin{gathered} Y - \overline Y = b\left( {X - \overline X } \right) \\ Y - \overline Y = r\frac{{{S_Y}}}{{{S_X}}}\left( {X - \overline X } \right) \\ \end{gathered}

Regression Line of X on Y:

In regression line X on Y we estimate the average value of X for a given value of Y.

X = c + dY\,\,or\,\,X = a  + {b_{XY}}Y


.
 Where X is dependent and Y is independent variable. Alternate form of regression line X on Y is:

\begin{gathered} X - \overline X = d\left( {Y - \overline Y } \right) \\ X - \overline X = r\frac{{{S_X}}}{{{S_Y}}}\left( {Y - \overline Y } \right) \\ \end{gathered}