Standardized coefficient

In statistics, standardized [regression] coefficients, also called beta coefficients or beta weights, are the estimates resulting from a regression analysis that have been standardized so that the variances of dependent and independent variables are 1.[1] Therefore, standardized coefficients refer to how many standard deviations a dependent variable will change, per standard deviation increase in the predictor variable. For simple linear regression with orthogonal predictors, the standardized regression coefficient equals the correlation between the independent and dependent variables.

Not to be confused with Beta (finance).

Usage

Standardization of the coefficient is usually done to answer the question of which of the independent variables have a greater effect on the dependent variable in a multiple regression analysis, when the variables are measured in different units of measurement (for example, income measured in dollars and family size measured in number of individuals).

A regression carried out on original (unstandardized) variables produces unstandardized coefficients. A regression carried out on standardized variables produces standardized coefficients. Values for standardized and unstandardized coefficients can also be derived subsequent to either type of analysis.

Implementation

Before solving a multiple regression problem, all variables (independent and dependent) can be standardized. Each variable can be standardized by subtracting its mean from each of its values and then dividing these new values by the standard deviation of the variable. Standardizing all variables in a multiple regression yields standardized regression coefficients that show the change in the dependent variable measured in standard deviations.

Some statistical software packages like PSPP, SPSS and SYSTAT label the standardized regression coefficients as "Beta" while the unstandardized coefficients are labeled "B". Others, like DAP/SAS label them "Standardized Coefficient". Sometimes the unstandardized variables are also labeled as "b".

Advantages and disadvantages

Standard coefficients' advocates note that the coefficients ignore the independent variable's scale of units, which makes comparisons easy.

Critics voice concerns that such a standardization can be misleading. Since standardizing a variable removes the unit of measurement from its value, a standardized coefficient for a given relationship only represents its strength relative to the variation in the distributions. This invites bias due to sampling error when one standardizes variables using means and standard deviations based on small samples. Furthermore, a change of one standard deviation in one variable is only equivalent to a change of one standard deviation in another predictor insofar as the shapes of the two variables' distributions resemble one another. The meaning of a standard deviation may vary markedly between non-normal distributions (e.g., when skewed or otherwise asymmetrical). This underscores the importance of normality assumptions in parametric statistics, and poses an additional problem when interpreting standardized coefficient estimates that even nonparametric regression does not solve when dealing with non-normal distributions.

gollark: I think I'm up to ~600 tabs.
gollark: A few hundred.
gollark: It turns out that many of my bookmarks have succumbed to link rot, many of them are also just bad and not interesting, and so my archiving procedures are running slowly?
gollark: Go download JavaScript.
gollark: They're gollark instances η-17 to η-23.

See also

References
  1. http://www.theanalysisfactor.com/how-to-get-standardized-regression-coefficients/
  • Schroeder, Larry D.; Sjoquist, David L.; Stephan, Paula E. (1986). Understanding Regression Analysis. Sage Publications. pp. 31–32. ISBN 0-8039-2758-4.
  • Vittinghoff, Eric; Glidden, David V.; Shiboski, Stephen C.; McCulloch, Charles E. (2005). Regression Methods in Biostatistics: Linear, Logistic, Survival, and Repeated Measures Models. Springer. pp. 75–76. ISBN 0-387-20275-7.
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.