I need to respond to a reviewer's critique of my use of an adjusted Wald F Test (extension of McNemar test) to examine change in within-group proportions over time using weighted analyses (svy commands). The situation is this: We have a dichotomous health measure that we administered at two timepoints. Our goal was to compare the proportion who endorsed the condition at T1 to the proportion who endorsed the condition at T2 while applying survey weights (svy commands) and recognizing the within-group nature of the data (same people responded at both timepoints). Based on our reading of the literature, we elected to run a Wald F Test (extension of McNemar test), which compares proportions for the discordant pairs (i.e., it compares the % who who endorsed yes at T1 and no at T2 to the % who who endorsed no at T1 and yes at T2). A reviewer has said that this was the wrong approach because there could be a large discordance between endorsement at the two timepoints (i.e., there could be many people who endorsed yes at only one timepoint), which would erroneously result in a high Wald F-test. However, I'm not sure that this is actually the case. The reviewer gave the following example: Consider the hypothetical example, of a two-by-two table matching the % in Physical Health Status (at least one Physical Health Condition=Yes): T1=Yes/T2=Yes: n=78, T1=Yes/T2=No: n=454, T1=No/T2=No: n=0, T1=No/T2=Yes: n=468. The proportion at T1=Yes is 53.2% and T2=Yes is 54.6% which are not far apart, however, there is a large discordant (922 out of 1000), which will result in high Walt F-test (rejecting the null hypothesis). Can anyone provide any input on whether this reviewer is correct or not, and if they are correct, can you suggest another analytical strategy for this scenario? We originally planned to apply the McNemar test but couldn't figure out how to do that appropriately with the svy commands. Thanks in advance for any help!
Related Posts with Help Responding to Critique that Adjusted Wald F Test is not Appropriate for Weighted Examination of Change over Time in Proportions
Graph diff-in-diff coefficientHi, I am estimating Difference-in-difference model: Y= b1Treat+ b2 after + b3 (after*post) The effec…
Graphing two continuous interactions in case of quadratic moderatorDear, First of all, I really thank you everyone here sparing no efforts to help the person like me.…
Running Stata on a server with multiple cpus to increase computing capacityI have Stata MP 2-core running on a laptop with 2.20GHz dual core cpu. When I run 2 do files my cpu …
Presenting results of regression analysis with splinesDear all, I would like to do a linear regression analysis with splines in Stata 14. My goal is infe…
add beta coefficient in brackets under coefficients in regression tableI was trying to replace the p-value in the regression table with the beta coefficient. I want the fi…
Subscribe to:
Post Comments (Atom)
0 Response to Help Responding to Critique that Adjusted Wald F Test is not Appropriate for Weighted Examination of Change over Time in Proportions
Post a Comment