I need to respond to a reviewer's critique of my use of an adjusted Wald F Test (extension of McNemar test) to examine change in within-group proportions over time using weighted analyses (svy commands). The situation is this: We have a dichotomous health measure that we administered at two timepoints. Our goal was to compare the proportion who endorsed the condition at T1 to the proportion who endorsed the condition at T2 while applying survey weights (svy commands) and recognizing the within-group nature of the data (same people responded at both timepoints). Based on our reading of the literature, we elected to run a Wald F Test (extension of McNemar test), which compares proportions for the discordant pairs (i.e., it compares the % who who endorsed yes at T1 and no at T2 to the % who who endorsed no at T1 and yes at T2). A reviewer has said that this was the wrong approach because there could be a large discordance between endorsement at the two timepoints (i.e., there could be many people who endorsed yes at only one timepoint), which would erroneously result in a high Wald F-test. However, I'm not sure that this is actually the case. The reviewer gave the following example: Consider the hypothetical example, of a two-by-two table matching the % in Physical Health Status (at least one Physical Health Condition=Yes): T1=Yes/T2=Yes: n=78, T1=Yes/T2=No: n=454, T1=No/T2=No: n=0, T1=No/T2=Yes: n=468. The proportion at T1=Yes is 53.2% and T2=Yes is 54.6% which are not far apart, however, there is a large discordant (922 out of 1000), which will result in high Walt F-test (rejecting the null hypothesis). Can anyone provide any input on whether this reviewer is correct or not, and if they are correct, can you suggest another analytical strategy for this scenario? We originally planned to apply the McNemar test but couldn't figure out how to do that appropriately with the svy commands. Thanks in advance for any help!
Related Posts with Help Responding to Critique that Adjusted Wald F Test is not Appropriate for Weighted Examination of Change over Time in Proportions
Panel Data: Table with ranks of medians over groupsHi together, i use stata 16.0 and have a panel dataset with monthly average temperature (tavg) from…
Calculation of RCA (Revealed Comparative Advantage)Dear Statalist, I am trying to calculate RCA(Revealed Comparative Advantage) to use in my thesis. I…
Am I using the correct code for running the models separately for each industry?Hi all, I have an unbalanced panel data, 11 industries and 21 years. After doing the main regressi…
Dynamic ML model code syntax error for simulation of maximum likelihoodHello, could someone help me identify what is the problem with this code I tweaked to simulate maxim…
interpreting Modified ADFHi All, I have performed the modified ADF on my variable using the Code: dfgls At level I get this…
Subscribe to:
Post Comments (Atom)
0 Response to Help Responding to Critique that Adjusted Wald F Test is not Appropriate for Weighted Examination of Change over Time in Proportions
Post a Comment