Create Online Survey

Just last week I shared how expensive conducting paper surveys can be, particularly if it's a survey project run every quarter for benchmarking or trending analysis. But cost isn't the only benefit online survey questionnaires can have over the old fashion mail questionnaire. Here are a few other things to consider next time you're debating between an instant survey online and it's paper-based equivalent:

• Speed: Creating surveys online offers instant distribution via web links posted on your website and email survey invitations. When you make surveys online, you can see the responses begin rolling in immediately - not trickle in a week or two after you first put them in the mail. Don't discount how much quicker you can analyze survey data either, since response are collected online, there's no manual data entry.

• Efficiency: This benefit goes right along with speed. It's more efficient to design a survey online and collect feedback using the internet. It's also easier to copy, or clone, your surveys for repeat deployment. 

• More Thorough Responses: By utilizing survey technologies like email survey invitations, and survey reminders for both non-respondents and partial respondents, you can collect more thorough responses and improve the accuracy and validity of your survey data.

• Randomization of Answers: We shared our thoughts on the benefits of randomizing answer earlier today. To get caught up, read this post on when you should randomize answers. But in summary, randomizing answers helps decrease certain types of survey bias and makes your survey results more reliable.

• Improved experience: Paper surveys limit you in providing a less than excellent survey respondent experience. Remember, every interaction with a customer impact the overall customer experience - this includes completing surveys! Designing surveys online gives you the ability to use survey question logic such as skip, branch, link logic or other types of  advanced logic that improves the overall experience. Instead of having to write survey questions like, If yes, when was the last time you purchased Agent ABC? Instead, that question only shows when the respondent indicates they have purchased Agent ABC. Couple these types of question logic with pipe logic that makes the survey even more engaging (remember, more relevant and engaging the survey is, the higher he response rate will be).

Unfortunately for the mail survey, they just don't have these types of functionality. Luckily for all online survey builders out there, you can simply select a survey designing software (like the Cvent Web Surveys application), and start improving your survey programs while cutting costs.

Last time we discussed in detail about the Graphical Survey Templates offered to Cvent Web Survey software users. Today, I wanted to share with you another marvelous feature available in Cvent’s online survey tool: Cvent Web Surveys Question Library. The question library is home to a list of customer service, demographics, event, HR/training, and marketing/sales survey questions you can utilize when creating surveys online.

Here’s a Sneak Preview:

Customer Service Survey Questions:
1. Did the representative answer your question adequately?
2. Did the representative respond to your phone call or email in a timely fashion?
3. How likely will you be to continue service with our company?

HR Survey Questions and Training Survey Questions:
1. Did this training meet your expectations?
2. Do you have all of the necessary resources available to you to perform your job?
3. Do you have any comments about what might improve your work experience at the company in the coming year?

Marketing Survey Questions and Sales Survey Questions:
1. How does this product's pricing compare to other similar products?
2. How likely are you to return to our site in the next 30 days?
3. How often do you use this product?

If you are new to the survey tool and need help with designing online surveys, I certainly recommend you to make use of these wonderful features. You can also call our award winning Client Services Team at 866-318-4357 for additional help.

With the emergence of widespread internet usage and powerful online survey software, the web has become the survey method of choice for many project managers and market research professionals.  Utilizing an online web survey design allows for levels of efficiency unheard of in traditional mail questionnaire projects, but it also poses new challenges for business survey researchers.  One of the questions that is asked often is, Is my customer feedback sample and/or survey data skewed because I used an online survey?

The answer could be either no, yes, or maybe, depending upon your specific research issues and target demographics.  The demographic that use the internet (and newer technologies in general) the most are younger people.  Those who are new to online technologies, or those who are not tech-savvy, might be intimidated or confused by a web survey form or an email survey invitation from an unknown sender, which can decrease your rates of nonresponse.  Also, you can run into the issue of coverage error for those who do not have internet access, which is more common among lower-income and less-educated individuals.

But overall, the reliability and validity of online survey results can be on par with or better than other modes, especially if you know your target audience well, including their rates of internet usage.  According to a September 2009 survey from the Pew Internet & American Life Project, 77% of all adults - and 93% of those ages 18-29 - use the internet “at least occasionally.”  Less than half of those aged 65 and older use the internet or send and receive email, however.

So while there are drawbacks to online questionnaire designs of which you should be mindful (as there are with any survey modes, such as interviewer bias, etc.), the efficiency and reduced costs are more than enough rationale for most to employ online data collection techniques, either exclusively or as part of a multi-mode survey design.  Knowing and understanding your target audience is the best way to be sure that your chosen mode will produce quality data.

Quota sampling is frequently used in survey designs, and especially in market research projects.  This technique is a form of "convenience sampling," where respondents are chosen not at random, but because they are available or easier to reach.  A probability-based sampling design is not employed, due to decisions made by the researcher based upon various reasons: the population frame cannot be known, contact information for respondents is unavailable, or even because the time, effort and costs are simply too high for the budget.

Quota sampling is a way that you can gather completed questionnaires, producing adequate amounts of data, from people with different demographic attributes.  Often, market researchers want to ensure they get roughly equal amounts of data from males and females, may be interested only in a specific age range (i.e., their target market/demographic), or would like to know if preferences differ by other characteristics such as ethnicity and income level.

So where does the “quota” come into play?  Well, just as in stratified sampling, the population is divided into mutually exclusive subgroubs, often based on demographic characteristics.  The researcher sets a quota for each subgroup (100 females and 100 males, for example), collects data until the quotas are met, then stops data collection and begins data analysis.  The reason that quota sampling is not a probability-based sampling technique, thereby limiting your ability to generalize, is because respondents are not selected at random.  Quota sampling does go a step further than simply selecting whomever is available without regard to any criteria, and that's why it is used so often.

In today’s competitive world, most of us find ourselves asking, What more do I get out of our online survey management software besides the obvious?

Well here’s one extraordinary feature you get along with the Cvent Web Surveys tool: A Robust Address Book. The Cvent Address Book is where you can store all you contacts; you can manually add new contacts if you need to update your records with just a handful of contacts or you can use our 4 Step Import Wizard to add bulk contacts in one go.

You can also export contacts out of the survey software if you need to update your personal database. For example, you want to be able to update contacts in your CRM system that attended your conference and completed your post-event survey so sales can follow up appropriately with attendees. Using the Cvent Address Book you can also merge duplicate contacts, create contact groups to help manage the Address Book more efficiently, or edit existing contacts to keep your records up to date.

Wait! There is more. In the Cvent Web Surveys application, you can not only run different reports to pull up information based on your address book, but also run reports to pull up information from your address book. Here is a list of some of our Address Book Reports:


If you are interested in knowing more about the benefits you can enjoy with Cvent Web Surveys, go ahead and sign up for a free trial account!

While designing a web surveys is fairly simple, make sure you are aware of common online survey pitfalls so you can avoid them:

• Plan the correct date and time to send survey invitation emails and consider your target audience. If your survey sample is office workers, it would be best to send it out during the work week when they will be at a computer most of each day. Do a little research on what the best day is – while it is widely known that Fridays, Saturdays and Sundays are not optimal, there is always new information on this topic. Don’t forget to consider the time zone of recipients too – if you are sending something that will land at 7 p.m. their time, it will likely be buried or forgotten by morning.

• Create your questions carefully. In an online web survey, the respondents are obviously on their own. You can’t clarify things for them. Make sure the questions are clear and easy to understand.

• Keep the open-ended questions to a minimum or you will be poring through the answers for hours. Respondents tend to be more forthcoming with electronic surveys, and this is a positive thing. But just because you can get all those open-ended responses, you may not really want them. Always be thinking ahead to how you will analyze survey data and present findings.

• Entice the respondents to take the survey. Many times online surveys fail to offer enough incentive. Even though online surveys are more convenient, the respondents are still volunteering their time and should be rewarded.

A few weeks ago, I did a series of posts about the effect colors can have on individuals and how you should keep them in mind when designing a web survey. Today, I came across a survey form that reminded me again of the importance of your survey template's color scheme. When you're designing surveys, make sure you pick colors that are easy to read.


Can you read this question from a sample customer questionnaire? Probably. Is it easy to read? Do you want to answer pages and pages of survey questions writen with this color scheme? Probably not. Because it's hard to read, you will probably see a high abandonment rate and then you'll have to deal with speculations about nonresponse bias. To avoid having this issue, make sure to ask people if they find the survey easy to read when they're testing it for you. Believe me, you don't want poor color selection to decrease your response rate.

You can read more about the effects different colors have in these posts:

One of the best descriptors attributed to good survey questions is the word specific.  A main goal in designing valid, reliable survey questions is doing everything in your power to make them clear, standardized and unambiguous.  A great way to follow through on that is to make sure your questions are as specific as possible.  The degree of specificity affects how people interpret and respond to your survey questions.  Several examples are listed below to help you analyze your survey questions regarding their level of specificity.

Be clear with demographic questions.  Your objective here should be to use words and categories that your respondents can clearly understand and identify with.  Will you use Census designations for Ethnicity?   Exactly what do you mean by “marital status?”

Define vague concepts, words and phrases.  Your respondents will likely widely differ with regard to their backgrounds, experiences and perceptions.  Words like “justice” and “equality” can mean very different things to people, so it is best to define exactly what you are asking about.

Objective or subjective?  Use verbs that trigger respondents.  Attitude survey questions are usually subjective (i.e., how do you feel about the war?), while behavioral questions are usually objective (i.e., what did you eat for supper last night?).

Always try to attach a time frame to behavioral and recall questions.

For market and product research, identify the actual brand name, and ask how they feel about specific items, not just groups or genres.  For example, don’t use the vague word “furniture” if you’re really interested in how they feel about a table or a chair.

Survey designing software can't look at your questions and tell you if your online survey form will give you the data you want. However, it does make it easier when you're designing a web survey because it takes out the added complications with writing your own code. So make sure next time you're working on an instant survey form, you think about the specificity of your survey questions.

When you plan your online market research study, you still need to remember the standard steps for any market research project, plus some online specific tasks:


The time frame for an online study is, as discussed previously, often shorter because of the immediacy of the results. Keep this in mind but be sure to give yourself enough time to analyze survey responses.

Every year it seems like the holidays get earlier and earlier. This year I noticed stores had holiday decorations out before Halloween costumes! While I can attest to retail stores being ready for the holiday shopping season, it makes me wonder, are you?

Online web surveys are just one more way you have the ability to engage with your consumer email lists. Customer surveys should be no brainers. But how can an online survey form apply to holiday marketing strategies? Well that depends, are you setting survey objectives that will impact your marketing strategies?

Here's what I mean: I receive countless retail marketing emails everyday. Most of which I opted in to, however, no one ever asks me about my shopping habits or preferences. These companies could easily put together a retail survey using an online survey application and find out more about who I am as a customer, what I prefer, how frequently I shop in their stores or how frequently I visit their website. From the responses they get back, they can then customize their marketing messages based on how I shop with them. If I only shop online, it may make sense to group these customers together and do a special online promotion. All the customers who only shop in the stores would receive a different promotional offer because they shop differently than I do.

This concept goes back to one I've shared previously: profiling customers to better understand your organization. The holidays are closing in quickly, but it's not too late to build an online survey and collect customer feedback instantly.

How have you designed online survey questionnaires in the past to impact your marketing strategies?

Surveys are an invaluable tool for researching the community attitudes, employee concerns, product needs, customer loyalty and priorities held by different groups or target audiences.  Designing a questionnaire and collecting survey responses from a sample allows us to draw a profile of the group as a whole, and perhaps perform some correlation analysis to understand the source of those feelings.  The online survey findings can then support fact-based organizational decisions or improvement projects to help continually improve the organization over time.

Survey research can be applied to many venues.  Here are just a few practical applications listed below:

An Internal Employee Survey could identify reasons for low employee retention and provide ideas for reducing those costs, such as a better designed benefit program, improved training opportunities, or problems in the way the organization functions.

A Training Survey can identify how a training program has improved the capabilities of some group and how the training program itself can be improved.  

A Product Satisfaction Survey can identify initial customer experiences with a product, providing data to address unforeseen problems and help the next product release.  

A Market Research Survey can identify customers needs when creating these new service and product offerings.  Surveys can be part of Design for Six Sigma activities.  

An Association Survey, which is similar to market research and customer surveys, can show the member benefits most of interest.

However, a survey program is only valuable if it is properly designed and executed.  While performing a survey project seems deceptively simple – it's just a bunch of questions, and survey software tools make electronic surveys quick and cheap – a small mistake in the survey questionnaire design or survey administration can skew or bias the data, leading to erroneous conclusions.  No organization should ever make critical business decisions based on unreliable or invalid data.

Bad data is worse than no data!

There is sufficient evidence from prior studies suggesting it is a good idea to keep respondents informed of their progress during internet surveys.  Respondents may suffer from fatigue or irritation, and may abandon web survey forms – even if they have only a few questions left to complete the questionnaire.  This may lead researchers and project managers to adjust their online questionnaire design by reordering questions to include “important” or sensitive items earlier, possibly causing more survey respondents to abandon mid-stream.

There are various survey design techniques that can be employed to keep respondents informed of their progress, especially within electronic surveys.  One way is to design web surveys so the entire survey web form can be viewed on a single page; but while this allows respondents to scroll down and see the total length of a questionnaire, this setup is less than ideal. 

Another method is to include words or symbols in headers and transitions that notify progress (such as section numbers, the words "next" and "finally," etc.)  By far however, the most popular and effective method of keeping respondents in the loop is to include a progress bar. 

A progress bar is a graphic or set of words that let respondents know how far along they are in the survey process.  Progress bars are especially useful for shorter, instant surveys, since answering only a few questions will show that they are through a significant portion of the questionnaire.

Cvent Web Surveys software makes it easy to include a progress bar as part of an effective online survey design.  You can even select among three options (percent complete, page x of y, or a bar graphic that fills as respondents move through the survey).

In yesterday's post we looked at how your survey question items, if worded improperly, may be biased, resulting in unusable or incorrect results. Now we know how survey questions shouldn't look, let's delve deeper into why those previous examples were poorly worded, and how with just a few small adjustments you can easily start to hone question items within your survey forms.

When you design internet surveys, how do you write objective questions that won't bias your results one way or the other?

Here are a few main points:


These first few points are a great starting place when you're designing a questionnaire. The final post in this series will look at a few final survey best practice tips for writing great survey questions and the benefits you'll gain from crafting quality items. In the meantime, questions previously stored in our question library already come properly worded and ready for use!

Marketing departments love client testimonials and customer quotes. They're great to share with the sales team when prospects need referrals, they're helpful to put in powerpoint presentations, and can be a critical piece of any marketing website. Getting those sound bites from clients can be a challenge, however. As you can imagine, the challenge only gets bigger if your organization sells consumer products. Admittedly, the growth of social media has made finding people who are saying good things about your product, services or organization has gotten a little bit easier. But, it could be easier still.

Imagine a world where you had a plethora of client sound bites and quotes to share with the outside world. A marketers dream. No more tracking down sales reps to talk to their clients and mangle their words. Everything is already done for you. Well, if you're conducting client satisfaction surveys or consumer surveys, you should be gathering those sound bites already. You can even consider using website polls and website usability surveys to get those sound bites. Depending on the online questionnaire design, you may still need to contact the customer to get permission to use their quote, but the hard part is still done. You have the quote.

Question remains, how do you pull these customer quotes out of your survey web form? You make sure to add an additional comment box. Customers who love you will typically share those sentiments in the additional comments area, particularly if there are not other open ended questions in the survey for them to share why they like an organization.

Still wondering why your marketing department needs sound bites? Opinions for others is one of the driving forces behind purchasing decisions. If you want to learn more about the importance of customer reviews, check out this past post. It's also worth mentioning, this same idea can work for employee surveys and your HR department for recruiting purposes.

In a recent post, I described the differences between nonprobability and probability sampling methods in online survey designs.  Probability methods are preferred if at all possible, because they allow you to make generalizations from your electronic survey results to a larger population or target audience.  One kind of probability-based sampling technique is called systematic random sampling. 

To employ a systematic random sampling design for your online web survey, you first select a case at random from your exhaustive population list, and then select further cases at identical intervals, determined by how many people you want to sample in total.  If you wanted to sample ten people from a population list of 150, you would then choose every fifteenth person after selecting someone in the first 15 cases (to ensure you will select 10 people in total).

This provides an easy way to obtain a random sample of your population list or sampling frame, because as long as your data is ordered randomly, you can begin simply by selecting any record or case and go from there.  This is an important caveat though: your records must be randomly ordered for a systematic sample to be effective. 

Take this example of survey sampling, let’s say you have a sampling frame (list) of people that is currently ordered alphabetically by last name, and you are interested in subgroup analyses by ethnicity.  It would be wise in this case to rearrange the records into a truly random order (i.e., not alphabetically), because last names from certain backgrounds may be more likely to begin with a particular letter.  While systematic sampling provides an easy way to generate a random sample for online surveys, you do need to be sure there is no hidden order within your population list or sampling frame.

Some people still believe in using paper surveys instead of designing online questionnaires, sending personalized email survey reminders and utilizing electronic survey methods. Sometimes I have to wonder, Why? Some of the reasons people claim they want to use paper questionnaires instead of web survey forms is because they think it's cheaper. That's not usually the case.

Consider this: Online survey response rates are typically hire than response rates on a direct mail survey. Online survey research designed well will yeild response rates from 20-40%. Let's be conservative and say the paper survey you plan to send out will get a 20% response rate as well. I looked up the cost of a ream of standard multipurpose paper (500 sheets) on Office Depot's website: $7.09. A black ink cartridge for a laser printer is $77.99 and will print on a maximum of 2,200 pages. Most printed surveys will be kept to three to five pages, longer than that your survey form looks over whelming from the very beginning and is going to lower your response rate. This is how that cost quickly adds up:


Keep in mind these costs don't include the staff time of stuffing envelopes to send out the direct mail survey, or the staff time of manually entering in all of the responses into some sort of data collection software, be it Excel or a survey software tool. You can figure it will take an intern a week to send out 5,000 survey responses and another week for them to do the data entry for the 1,000 responses. So that's an additional cost of $600 to $800 for one survey campaign. What if you want to do a quarterly customer satisfaction survey? You're looking at an annual cost of over $25,000.

For me, that would be enough reason alone to look into an online survey software application. With a web survey tool, you have the ability to not only send one invitation, but reminders survey emails as well. Sending reminders, as we've mentioned before, can drastically increase your survey response rate. My suggestion: don't fall for the myth that paper surveys are cheaper than online surveys. It's definitely the other way around.

There advantages and disadvantages to conducting web or electronic surveys as opposed to traditional survey modes such as personal interviewing, telephone and mail.  One of the advantages of an online survey design is a possible reduction of what is known as social desirability bias. 

Social desirability bias occurs when survey respondents offer responses that portray them in a positive or more favorable manner to others. 

When a face-to-face interviewer asks personal or sensitive questions respondents feel have a “good answer” and a “bad answer” (such as criminal behavior), they may underreport bad behavior and overreport good behavior, for example.  While this bias may be reduced in online surveys due to the absence of an interviewer, there are topics that may produce invalid or unreliable data, regardless of survey mode.  This is something to consider before finalizing your online questionnaire design or web survey forms.

Survey questions within the following content areas are especially subject to social desirability in a survey form (i.e., respondents believe particular responses are “better” than others). 

A key marker of a quality survey, whether that survey is an online form or another mode, is replicability of your results over trials. Replicability of your survey results lends credibility to your organization's research work.

One indication that your survey form may have results based on biased samples is nonreplicable results for the same instrument, fielded with the same survey design, from one time to the next.  If the same sample frame produces significantly different results for identical questions, that should perk up our noses to the scent of possibly unreliable results. We should start to look at the criteria used to select our survey sample, and take a fresh look at the questionnaire to see if it is still pertinent to our needs, or the needs of our clients.

This holds true for all modes of survey research, including online survey internet research. Receiving divergent findings in survey results being fielded again and again could lead to differing (and possibly harmful) business decisions.  No company should be left with uncertainty about answers and actions when decisions need to be made based upon the research. This is just one reason why replicability of your research findings is a key ingredient to sound data. When in doubt- replicate!

What is a survey design's ideal length? In the past we've told you the typical survey best practice says surveys, whether they're paper or web survey forms, shouldn't be longer than thirty questions. While thirty certainly isn't a huge number, if you tell me you have a thirty question survey you want me to complete, forget it. I'm never going to complete your feedback form. However, if you tell me it's only a 10 question survey, I'm more likely to be on board. That is, unless I start to give you the customer feedback you're looking for and feel like your online questionnaire is longer than 10 questions.

You probably didn't lie to me, at least not if you're read about the dangers of lying about survey length in your email survey messages. It's probably a case of side view mirror syndrome: objects are closer than they appear - or applied to web survey design, questionnaires appear longer than they are.

Not surprising, if your survey form is interesting, the survey respondent is going to perceive it's shorter than it really is. However, the reverse doesn't seem to be true. If your web survey feedback form is boring and on an uninteresting topic, respondents will perceive it's the same length (and too long) whether there are fifteen questions or thirty questions.

It's not just about the actual length of your form when designing a questionnaire online, it's also about the perceived length. Even though your survey is only ten questions long, it may feel a lot longer if your collecting feedback about an uninteresting topic. If your survey questionnaire feels long, you instantly increase your chance of survey respondents abandoning your feedback form.

There are many options available to market researchers when designing a web survey form. I covered this topic a bit last week when I discussed creating online surveys, and included some dos and don’ts.

Conducting a study for the Web offers several opportunities for market researchers that paper questionnaires do not. For example, you can create an instant survey and check on responses frequently for updates. You may even allow the respondents to view the current results when they complete the survey. This works best for one or two-question quick polls rather than longer studies. But knowing they will see the results immediately is frequently a tipping point for respondents who are on the fence about completing your feedback survey form.

This can be helpful in analyzing survey data as well. For example, suppose results for your online survey form vary wildly throughout one week. One day, 10% of respondents use your client’s brand of glass cleaner. The next day, it’s 65%, but then the following day it drops back down to 20%. This could mean something (possibly that you need to check your recipient list) and is good information to track for your client.

The instant results also allow you to add more questions and gain clarification on points you may not have considered prior to launching the survey form. There are dozens of survey web software tools available that can create instant survey results – it’s a method that is worth trying out, but as always, consider your client’s needs before committing to a particular survey method.