Using priors from pilot study

This forum is for posts that specifically focus on Ngene.

Moderators: Andrew Collins, Michiel Bliemer, johnr

Using priors from pilot study

Postby nastay » Fri Oct 06, 2023 9:20 pm

Dear all,

I designed a pilot choice experiment and used very conservatives priors based on expert opinion- for example 0.0001 for a level of attribute X.

I collected data and obtained priors from the pilot study. Should I feel comfortable using priors from the pilot in the main study?- for example, the coefficient for the same level of attribute X is estimated to be 1.2.

Thank you.
Nasrin
nastay
 
Posts: 16
Joined: Thu Nov 22, 2018 7:45 pm

Re: Using priors from pilot study

Postby Michiel Bliemer » Mon Oct 09, 2023 7:04 am

It depends on the standard errors or t-ratios of the parameter estimates. If the t-ratios indicate that all parameters are statistically significant, then the parameters are likely okay and you can use (n,estimate,standarderror) as Bayesian prior for each coefficient. If the t-ratios indicate that the parameters are quite unreliable, you may consider shrinking them a little towards zero, i.e. by dividing all parameters by a certain factor (i.e. 1.5).

Michiel
Michiel Bliemer
 
Posts: 1885
Joined: Tue Mar 31, 2009 4:13 pm

Re: Using priors from pilot study

Postby nastay » Wed Oct 18, 2023 11:55 pm

Hi Michiel,

Thank you for clarification. I have two more questions and would be pleased if you could answer :)

1- If a parameter has an unexpected sign, do you recommend using a uniform distribution as Baysian priors for that specific attribute?

2- When shrinking all parameters by a factor, do you also divide SD by that factor?

Thank you!
nastay
 
Posts: 16
Joined: Thu Nov 22, 2018 7:45 pm


Return to Choice experiments - Ngene

Who is online

Users browsing this forum: No registered users and 29 guests