Magnitude of parameters

This forum is for posts covering broader stated choice experimental design issues.

Moderators: Andrew Collins, Michiel Bliemer, johnr

Magnitude of parameters

Postby RJT » Thu Jul 25, 2024 10:47 pm

Hi,

I have a doubt on the effect that the magnitude of the parameters have in the designs.

Lets say that I have an RP-SP model from other study to use as a priors. This means that I have parameters with a normalise scale for RP and a scaled SP parameters. What is the practical or theoretical difference of using either set of parameters? I understand that the larger in absolute value of the parameter, the lower the influence of the error term in the choice.

Kind regards
RJT
 
Posts: 2
Joined: Fri Jun 23, 2023 5:16 pm

Re: Magnitude of parameters

Postby Michiel Bliemer » Fri Jul 26, 2024 8:16 am

Scale influences choice probabilities, and hence influences design efficiency.

For example, if scale=1 and choice probabilities are 0.45 and 0.55. If scale=2 then the choice model becomes more deterministic (less error variance) and the choice probabilities would become more pronounced, e.g. 0.2 and 0.8. In other words, larger scale parameters indicate more choice certainty. Each data set has its own scale parameter and is unknown. It is only possible to estimate relative scale between data sets by estimating a joint model such as SP-RP. Otherwise, the scale parameter is absorbed by the beta parameters.

Design efficiency, as expressed in D-error etc, relies on choice probabilities. So using a different scale parameter would change the choice probabilities and therefore would change the D-error. It is therefore important to use appropriate parameters with appropriate scale. If you conduct a pilot study in the same population as your main study then you expect the scale to be similar and therefore you can used the parameters estimated from the pilot study data directly to generate an efficient design for your main study. But note that it is also known that efficient designs create more challenging choice tasks to respondents than orthogonal designs, so the scale parameter based on data from an orthogonal design may be somewhat larger than the scale parameter in a data set using an efficient design. So if you are using an orthogonal design for your pilot study and estimate model parameters, then you may want to shrink the parameters somewhat to use as priors for an efficient design, e.g. by multiplying the parameter values with 0.8 or something.

Michiel
Michiel Bliemer
 
Posts: 1885
Joined: Tue Mar 31, 2009 4:13 pm


Return to Choice experiments - general

Who is online

Users browsing this forum: No registered users and 11 guests