Partial regression plot

In applied statistics, a partial regression plot attempts to show the effect of adding another variable to a model that already has one or more independent variables. Partial regression plots are also referred to as added variable plots, adjusted variable plots, and individual coefficient plots.

When performing a linear regression with a single independent variable, a scatter plot of the response variable against the independent variable provides a good indication of the nature of the relationship. If there is more than one independent variable, things become more complicated. Although it can still be useful to generate scatter plots of the response variable against each of the independent variables, this does not take into account the effect of the other independent variables in the model.

Calculation

Partial regression plots are formed by:

  1. Computing the residuals of regressing the response variable against the independent variables but omitting Xi
  2. Computing the residuals from regressing Xi against the remaining independent variables
  3. Plotting the residuals from (1) against the residuals from (2).

Velleman and Welsch[1] express this mathematically as:

where

Y•[i] = residuals from regressing Y (the response variable) against all the independent variables except Xi
Xi•[i] = residuals from regressing Xi against the remaining independent variables.

Properties

Velleman and Welsch[1] list the following useful properties for this plot:

  1. The least squares linear fit to this plot has the slope and intercept zero.
  2. The residuals from the least squares linear fit to this plot are identical to the residuals from the least squares fit of the original model (Y against all the independent variables including Xi).
  3. The influences of individual data values on the estimation of a coefficient are easy to see in this plot.
  4. It is easy to see many kinds of failures of the model or violations of the underlying assumptions (nonlinearity, heteroscedasticity, unusual patterns). .

Partial regression plots are related to, but distinct from, partial residual plots. Partial regression plots are most commonly used to identify data points with high leverage and influential data points that might not have high leverage. Partial residual plots are most commonly used to identify the nature of the relationship between Y and Xi (given the effect of the other independent variables in the model). Note that since the simple correlation between the two sets of residuals plotted is equal to the partial correlation between the response variable and Xi, partial regression plots will show the correct strength of the linear relationship between the response variable and Xi. This is not true for partial residual plots. On the other hand, for the partial regression plot, the x-axis is not Xi. This limits its usefulness in determining the need for a transformation (which is the primary purpose of the partial residual plot).

gollark: Increasing the version number would imply that it's actually a significant change.
gollark: Not really, it's a minor UI reskin.
gollark: That would be more reliability, not more support.
gollark: Does Windows have much support beyond that for a random user? I don't know of any way to actually contact Microsoft and get responses.
gollark: It should really use cooler text generation neural networks or something rather than Markov chains.

See also

References
  1. Paul Velleman; Roy Welsch (November 1981). "Efficient Computing of Regression Diagnostics". The American Statistician. American Statistical Association. 35 (4): 234–242. doi:10.2307/2683296. JSTOR 2683296.

Further reading
  • Tom Ryan (1997). Modern Regression Methods. John Wiley.
  • Neter, Wasserman, and Kunter (1990). Applied Linear Statistical Models (3rd ed.). Irwin.CS1 maint: multiple names: authors list (link)
  • Draper, N.R.; Smith, H. (1998). Applied Regression Analysis (3rd ed.). John Wiley. ISBN 0-471-17082-8.
  • Cook and Weisberg (1982). Residuals and Influence in Regression. Chapman and Hall. ISBN 0-412-24280-X.
  • Belsley, Kuh, and Welsch (1980). Regression Diagnostics. John Wiley. ISBN 0-471-05856-4.CS1 maint: multiple names: authors list (link)

 This article incorporates public domain material from the National Institute of Standards and Technology website https://www.nist.gov.

This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.