Pilot with insignificant coefficients and Bayesian priors

This forum is for posts that specifically focus on Ngene.

Moderators: Andrew Collins, Michiel Bliemer, johnr

Pilot with insignificant coefficients and Bayesian priors

Postby claudiab » Wed Nov 30, 2016 3:43 am

Dear Ngene team,
I am in the process of designing a Bayesian efficient design. I just conducted my pilot study and estimated a MNL model. I obtained insignificant parameters (effects coded) and I wonder whether I should use these values as Bayesian priors in the Bayesian design.
Specifically, my main concern is that I do not know the sign of these attribute parameters. As such, following suggestions I found on this forum, instead of using the mean values of the insignificant coefficients as priors, I generated an efficient design using Bayesian priors with mean=0 with the standard errors obtained from the MNL estimates, e.g. (n,0,0.13), (n,0,0.06). In this way, I obtained a Bayesian design with S estimate = 25 which, I suppose, is good. Here is the code I used:

design
;alts = Alt1, Alt2, Alt3
;rows = 16
;eff = (mnl,d, mean)
;block = 2
;bdraws = gauss(3)
;model:
U(Alt1) = b1.effects[(n,0.54,0.09)|(n,-0.19,0.1)]*loc[2,1,0]
+ b2.effects[(n,0.28,0.12)|(n,0,0.13)|(n, 0,0.13)]*hops[3,2,1,0]
+ b3.effects[(n,0,0.06)]*org[1,0]
+ b4[(n,-0.16,0.02)]*price[7.99,9.99,10.99,12.99,16.99]/
U(Alt2) = b1*loc
+ b2*hops
+ b3*org
+ b4*price/
U(Alt3) = b0[(n,-2.78,0.28)]
$

I hope that this approach is correct and any further suggestions would be very appreciated.
I apologize in advance if this issue has already been discussed and thanks a lot for the support.
Claudia
claudiab
 
Posts: 19
Joined: Sun Jul 10, 2016 10:18 am

Re: Pilot with insignificant coefficients and Bayesian prior

Postby Michiel Bliemer » Wed Nov 30, 2016 4:25 pm

If the parameters are not statistically significant, you indeed want to be careful putting in the estimates as means, since if the priors are large, this could have an adverse effect on the efficiency of the design. So it is always good to be conservative, and putting in 0 is the most conservative choice.

You do not need to worry much about the sign since you are not checking for dominant alternatives (there is no * behind your alternatives in your ;alts command), so having -0.001 and +0.001 is essentially the same as 0.000. So if you feel that your means are not too large, then you could just use them directly as means in your Bayesian priors, or you may wish to be a bit more conservative and divide them by two.
Michiel Bliemer
 
Posts: 1705
Joined: Tue Mar 31, 2009 4:13 pm

Re: Pilot with insignificant coefficients and Bayesian prior

Postby claudiab » Thu Dec 01, 2016 3:06 am

Michiel,

thank you very much for your kind reply. Very helpful.

Claudia
claudiab
 
Posts: 19
Joined: Sun Jul 10, 2016 10:18 am


Return to Choice experiments - Ngene

Who is online

Users browsing this forum: No registered users and 9 guests