For regression or other statistical analysis, I personally like to use software like Mini-tab. The reason is that is allows analysis beyond regression. e.g. Scatter plot, distribution of data analysis.... even hypothesis testing.
If it's jus simply simple regression, I guess Excel will do the trick. Hope that it's helpful.