I have a quick question / in need of some advice.
I am doing weighted and unweighted regressions, but the output is extremely different for both. And so I am trying to decide which one would be better to use in my final paper. Unfortuantely, I cannot share the output here directly from Stata because I do my analysis in a secured facility. However I do remember the numbers.
My dependent variable is vocabularyscore and my independent variable is child care participation.
WEIGHTED:
the coefficient on childcare while weighted is 2.21, with a p-value of 0.98
UNWEIGHTED
coefficient on childcare is -1.15, with a p-value of 0.58
Obviously, the coefficient on childcare in the weighted regression is more desirable as it shows that childcare positively influences the outcome of the vocabulary score.
However, with the unweighted coefficient, my covariants are almost all below p-value of 0.05.
If you were in my shoes, what would you use?
Is it better to have a lower p-value and less-desirable coefficient, or a higher p-value with a more desirable coefficient? I've spoken to other researchers who used my dataset and some of them published the unweighted numbers because, as they wrote :
some observations (children) have missing data for a subset of the explanatory variables so get dropped from the regression and it would require us to have either constructed a new modified weight or assume all incomplete data is completely at random to use an existing weight. The sample sizes also change across outcomes so this would require a great deal of belief in whatever your modelling choice was and make the study harder to replicate."
0 Response to Weighted VS Unweighted Advice + Help
Post a Comment