Using the method of least squares, a regression analysis allows statisticians to estimate the response variable “Y” (the dependent variable or the one being manipulated) from a specified variable “X” (the independent variable or the one being studied).