It's always a good idea to try to design surveys that minimize survey respondent burden when you undertake a market research project. But it is also very important to make sure your survey questions are clear and address one concept at a time. Organizations may want to lump together multiple questions into a single measure to keep a questionnaire short, but this can sometimes confuse respondents and create unreliable results. Take the following "double barreled" survey question example found in many restaurant questionnaires and hotel surveys:
While this may seem like a reasonable question that provides an overall rating of customers' experiences and feelings, it asks them to rate two separate aspects of the business (cleanliness and service) with one answer. This approach to questionnaire design is definitely an online survey pitfall. Respondents may not be able to honestly answer this question; they might feel that the place is very clean and neatly organized, but that the service is poor (or vice versa). What answer can they choose that would accurately reflect such experiences/opinions?
By revising this double barreled question into two separate questions that each address a single concept, you can get a better sense of how customers feel about specific aspects of your business and services. You will also produce results that are more valid and reliable than those based upon unclear or poorly designed survey questions.
"How would you rate the cleanliness and service at establishment XYZ?"
Poor-Fair-Good-Excellent
While this may seem like a reasonable question that provides an overall rating of customers' experiences and feelings, it asks them to rate two separate aspects of the business (cleanliness and service) with one answer. This approach to questionnaire design is definitely an online survey pitfall. Respondents may not be able to honestly answer this question; they might feel that the place is very clean and neatly organized, but that the service is poor (or vice versa). What answer can they choose that would accurately reflect such experiences/opinions?
By revising this double barreled question into two separate questions that each address a single concept, you can get a better sense of how customers feel about specific aspects of your business and services. You will also produce results that are more valid and reliable than those based upon unclear or poorly designed survey questions.


J.D. Power and Associates' 