Model based survey design using logits: estimating lost statistical power from random alternative sampling

Abstract

"McFadden's random alternative sampling conditional logit estimator permits researchers and survey designers to estimate a random utility choice model observing information about a subset of available alternatives. The authors quantify the extent to which a small sample size and a reduction in the number of sample alternatives lead to bias and loss of statistical power. The sample size must be small and choice probabilities must be weakly correlated with choice characteristics for there to be substantial bias and low power. Finally, they find that there is a sharply decreasing marginal gain from increasing the number of sampled alternatives. The authors provide an empirical example on the choice of health insurance plans that verifies our conclusions." (author's abstract)