Underrepresented number of blocks in data analysis

This forum is for posts that specifically focus on Ngene.

Moderators: Andrew Collins, Michiel Bliemer, johnr

Underrepresented number of blocks in data analysis

Postby Andrew » Fri Feb 07, 2020 7:59 pm

Hi,

in a CBC survey we applied different attributes with a different number of levels (6^1 x 4^1 x 3^2). The efficient design was created with 240 rows to cover many attribute-level-combinations, divided into 20 blocks. Each respondent was faced with 12 choice tasks each with 3 alternatives and no opt-out. Analyzing the data, we found out that some blocks have a much smaller number of respondents than other blocks. Thus, a few blocks are underrepresented within the data. One- and two-way frequencies across blocks, however, have a good level balance. So the question is: Does the over- or underrepresentation of blocks in the data have an effect on the overall efficiency of the design and, most important, on the analysis of choice data?

Regards,
Andrew
Andrew
 
Posts: 33
Joined: Mon Apr 15, 2013 5:23 pm
Location: Germany

Re: Underrepresented number of blocks in data analysis

Postby Michiel Bliemer » Tue Feb 11, 2020 1:07 pm

The fact that there is not perfect balance across blocks in the data may lead to some loss of efficiency, but it is not that important. You should use all your data for model estimation and not throw away any data in order to obtain equal representation of blocks.

Michiel
Michiel Bliemer
 
Posts: 918
Joined: Tue Mar 31, 2009 4:13 pm

Re: Underrepresented number of blocks in data analysis

Postby Andrew » Fri Feb 14, 2020 2:14 am

Michiel,

thank you very much!
Could you recommend any paper on the subject using blocking technique with efficient designs? Mainly based on experience, I think choice experiments using attributes with very different numbers of levels require a large number of blocks in order to cover as many level-combinations as possible. And individual respondents are then not overwhelmed by too many choice scenarios. However, it is hard finding a paper that covers this issue.
And no, I wouldn't throw away any data without a very good reason.
Thanks again!

Kind regards,
Andrew
Andrew
 
Posts: 33
Joined: Mon Apr 15, 2013 5:23 pm
Location: Germany

Re: Underrepresented number of blocks in data analysis

Postby Michiel Bliemer » Fri Feb 14, 2020 8:07 am

Blocking is typically associated with orthogonal arrays, blocking in efficient designs cannot be done perfectly and I am not aware of any literature that discusses this.

Note that many level-combinations are mainly needed when you are estimating a lot of interaction effects. For main effects, there is no need to include many different combinations.

Michiel
Michiel Bliemer
 
Posts: 918
Joined: Tue Mar 31, 2009 4:13 pm


Return to Choice experiments - Ngene

Who is online

Users browsing this forum: No registered users and 8 guests