« CMA 1 exam - passed! | Main | What is a learning curve? »

Simple Linear Regression Equation Part 2

Previous Part

In the Part 1, we have received linear regression equation for the following problem:

The firm has decided to use linear regression by employing the equation y = a + bx for the annual sales. The prior years's data regarding sales and advertising expenditures are here.

Linear regression equation is

y = f(x) = 4.2 + 0.31x

Let y' is the mean of the observed data points, i.e.

y' = (y1 + y2 + y3 + y4 + y5)/5

1. The variance of the estimate S2 is equal:
variance_of_estimate.gif

where n = 5 is the number of observations, k = 1 is the number of independent variables in the linear regression. n-k-1 is calling the number of degrees of freedom.

Hence, S2 = 2.624

The standard error of estimate is equal square root of the variance of the estimate and is equal S. Hence, standard error of estimate S = 1.62

2. Variance of constant coefficient a is equal Sa2:

variance_of_a.gif

Sa2 = 6.216

Hence, Sa - standard error of a is equal square root of the variance of a and is equal Sa = 2.49

3. Similarly, variance of variable coefficient b is equal Sb2:

variance_of_b.gif

Sb2 = 0.002332

Hence, Sb - standard error of b is equal square root of the variance of b and is equal Sb = 0.0483

4. Coefficient of determination r2:
determination.gif

r2 = 0.9328

r - coefficient of correlation, r = 0.9658

The coefficient of determination r2 may be interpreted as the percent of variation in the depended variable "explained" by the variation in the independent variable. Hence, the variance in annual sales is 93.28% of the variance in advertising cost.

5. Confidence interval for b (similarly for other parameters):
interval.gif

If we want to receive 90% confidence interval for b, then we need the t-value from Student's t-table: t(5-1-1,(1-0.90)/2) = t(3 , 0.05) =2.35

Hence, management may be 90% confident that b will be in the range of:

(0.1965; 0.4235)

The two-third confidence level falls within one standard deviation (approximately) from the mean. So, if advertising expenditures will be $40 000 (40 thousands) management can be two-third confident that the annual sales will be in the range of:

( 4.2+0.31*40 – 1.62; 4.2+0.31*40 + 1.62)
or
(14.98; 18.22)
or
($14 980 000; $18 220 000).


Previous part

Posted by mazoo at March 21, 2005 9:25 PM

Related posts:

Covariance and Calculation of Portfolio Variance Aug 23, 2006
Quantity variance is the sum of mix and yield variances Dec 06, 2005
Simple Linear Regression Equation Part 1 Mar 03, 2005

Comments

thanks for excellent expression

Posted by: cuijf at February 22, 2008 8:33 AM