Marketing Surveys

There is a word in French I have always loved: mondialisation. Like many French words, there is no direct English translation for this term. To give you a rough idea though, mondialisation refers to the way that new communication technology has recently facilitated conversations between people on different continents. Companies headquartered in London are doing business deals with organizations and offices in Beijing, and American firms have clients in India. Cvent is no exception to this rule.

Since Cvent has clients literally all over the world, it makes sense that our clients want to conduct and design surveys in many languages other than English. I received an email from a web surveys client today who was wondering how she should best translate her survey into six different languages: English, French, Spanish, Arabic, Chinese, and Hindi. My response was quick: I told her that she should create six separate surveys, one which was translated into each of the languages she had mentioned.

I explained to this client she could simply translate her questions in Microsoft Word and then copy and paste the translated text into the Cvent Web Surveys Question Wizard. Yes, you can even paste Chinese characters! I also explained that it would be easy for her to collapse the data from all six global surveys into one report. This is why we have made it easy for you to export your survey reports into Microsoft Excel. If you simply run the Answer Details for All Respondents report for each survey and export the results into Excel, you can copy and paste to combine the data from all six surveys into one spreadsheet.

Another great thing about conducting multilingual surveys in Cvent's online survey platform is that you can utilize the display text feature! Remember that display text allows you to specify the question text that your survey respondents will see separately from the text that you will see from inside the survey application (where you create and design surveys) or in your reports. So, it is easy for you to translate your survey questions in the display text window and leave the question text in English. This way, you don’t even need to speak the language in order to correctly interpret the electronic survey results!

I wasn’t lying when I told my client today that Cvent is also a multilingual survey software solution and is ideal for setting up multilingual surveys. Anyone who knows their right hand from their left knows that the corporate world is confined to your immediate surroundings and the world truly is one global market, so use the Cvent Web Surveys software to survey employees or clients worldwide.

Market researchers are called upon to provide fresh, current information about a target market and/or product. For example, a study might be conducted to find out if people are planning to upgrade their cell phone in the next year, and what kind of phones they are looking to buy.

Naturally, you will decide on a data collection method and send out surveys or conduct focus groups. In this instance, a combination of online survey and in-person focus groups might be chosen. It is a good idea to supplement these methods with some external research.

This will add weight to whatever is discovered through the online survey and focus groups. For example, if 70% of online web survey respondents and 84% of focus group participants say they plan on upgrading to a smartphone like the iPhone or Blackberry, that makes a strong statement in favor of smartphones. You can supplement this finding with market information on smartphone sales. If the research shows steady increases in sales of smartphones, that strengthens the market research finding. However, if it shows declining sales, it provides additional insight. It might even indicate a need to broaden the target group for the survey – perhaps they are early adopters and very technology conscious.

If you do use external research to supplement or add insight into your findings, be sure to use reputable sources and cite them correctly.

I’ve previously emphasized how important it is to consider survey reporting not only after you’ve collected data, but at the beginning and throughout a survey project.  Another central tenet of good survey reporting is tailoring your report or presentation to your audience.

The formatting of your market research reports and presentations can vary dramatically depending upon who is going to receive them.  Even the content will differ based on the audience(s) who will read the report or view the presentation.  Here are two big questions to ask yourself about your audience, so you can tailor your reporting tasks accordingly:

1) Is this a lay or technical group of people? 
The more professional your audience is, the more technical you want to be when describing the results.  For example, if you are sending survey results back to respondents, you probably don’t need to go into statistical and methodological detail.  If you are presenting to market research colleagues, on the other hand, you would go into fairly deep detail regarding topics such as statistical significance, margin of error/confidence level, as well as include prior research citations and an abstract of your project.

2) Am I presenting this to senior officials and/or executive decision-makers?
Usually, the higher-up the ladder your audience is, the less time you spend on detail.  So if your answer to the above question is "yes," I like to use a five-minute rule: if someone had to make major business decisions based on your survey results, what could you present in five minutes that would help them make good strategic decisions?  What would be the “take-home” message (i.e., two or three data-driven recommendations based on your results)?

Although surveys are usually single point-in-time snapshots, it’s good to draw basic conclusions unless it would be inappropriate to do so... after all, you’ve likely spent considerable time and effort for the survey project to generate useful insights!

Sometimes we forget we can't be everything to everyone all the time. It's just not possible. It wouldn't make sense for a shoe designer to start creating hard hats just because a customer wrote on a comment card in response to a retail survey that she wished the designer also made hard hats because the her husband worked in construction. It seems obvious to most people, going into the hard hat market would be a bad call on the shoe designer's part. So why don't organizations have the same clarity when it comes to their business?

It can be hard to say no to customers, particularly when they have good ideas. But just because an idea is a good one, it doesn't necessarily mean it's right for your business model. Take the example many organizations have to face in their life time: where do they belong? Is it in the high end of the market, the mid-market or the bottom feeders? Most people when you ask them don't want to admit to being a bottom feeder, but there's a market need there that can be very profitable. The organization that can fulfill that need is very rarely, if ever, the same organization that can fill the need at the high end of the market. This just points out, again, that we can't ever be everything to everyone. I remember my marketing classes in college always told us you could only be two of the three things: good, fast or cheap. You can never be all three. Good and fast is expensive; fast and cheap is inferior; good and cheap is slow. It's because we can't be everything to everyone.

So how do you figure out what you should be? Your organization's mission should be a start, but missions can change and transform over time. One place you can start is to ask your employees, survey staff to see what they think the organization is and where they should be going. Employees have stellar ideas, but this may sound like a trick question so make sure to follow these tips for employee opinion surveys.

You should also ask for customer feedback. Your customers will help point you in the direction you should be heading. Sure you'll have the one off cases like with the shoe designer who's customer wants her to create hard hats for construction works, but chances are, no one else will respond that way on her customer questionnaire. And then, at the end of the day, you should be armed with the information you need to support your decision. As you're reading through survey comments, you'll notice that everyone doesn't want you to be everything.

Last time we discussed in detail about the Graphical Survey Templates offered to Cvent Web Survey software users. Today, I wanted to share with you another marvelous feature available in Cvent’s online survey tool: Cvent Web Surveys Question Library. The question library is home to a list of customer service, demographics, event, HR/training, and marketing/sales survey questions you can utilize when creating surveys online.

Here’s a Sneak Preview:

Customer Service Survey Questions:
1. Did the representative answer your question adequately?
2. Did the representative respond to your phone call or email in a timely fashion?
3. How likely will you be to continue service with our company?

HR Survey Questions and Training Survey Questions:
1. Did this training meet your expectations?
2. Do you have all of the necessary resources available to you to perform your job?
3. Do you have any comments about what might improve your work experience at the company in the coming year?

Marketing Survey Questions and Sales Survey Questions:
1. How does this product's pricing compare to other similar products?
2. How likely are you to return to our site in the next 30 days?
3. How often do you use this product?

If you are new to the survey tool and need help with designing online surveys, I certainly recommend you to make use of these wonderful features. You can also call our award winning Client Services Team at 866-318-4357 for additional help.

Conducting an online web survey should really be no different than any other kind of survey form, save for the medium. But all too often, normally restrained market research companies lose all sense of decorum when conducting an online survey. Suddenly it’s OK to plague potential respondents with multiple email survey reminders to take their electronic surveys.

It’s not. You must be mindful of how often you are communicating to potential respondents. I’ve even seen companies send out reminders to an entire respondent pool, some of whom have already taken the survey. If your survey is not getting enough respondents, there are probably issues that will not be fixed by several reminders. Perhaps you have fallen into some common traps not discussed previously – not explaining things clearly, no enticement, computer glitches or countless other things. The issue could also lie with the list you are sending it to and not the respondents themselves. If it is a list you have purchased, make sure the information is accurate. Always check out companies who sell lists thoroughly to ensure they are scrupulous.

It is important to check out all these potential avenues before sending out multiple reminders. Receiving unsolicited email reminders can irritate your potential respondent pool. All too often, I have seen this backfire when recipients unsubscribe from the email list. By sending out multiple email reminders for electronic surveys, you could be losing out on the ability to contact hundreds of potential respondents for future surveys. Once they have opted out, you can’t get them back.

With the emergence of widespread internet usage and powerful online survey software, the web has become the survey method of choice for many project managers and market research professionals.  Utilizing an online web survey design allows for levels of efficiency unheard of in traditional mail questionnaire projects, but it also poses new challenges for business survey researchers.  One of the questions that is asked often is, Is my customer feedback sample and/or survey data skewed because I used an online survey?

The answer could be either no, yes, or maybe, depending upon your specific research issues and target demographics.  The demographic that use the internet (and newer technologies in general) the most are younger people.  Those who are new to online technologies, or those who are not tech-savvy, might be intimidated or confused by a web survey form or an email survey invitation from an unknown sender, which can decrease your rates of nonresponse.  Also, you can run into the issue of coverage error for those who do not have internet access, which is more common among lower-income and less-educated individuals.

But overall, the reliability and validity of online survey results can be on par with or better than other modes, especially if you know your target audience well, including their rates of internet usage.  According to a September 2009 survey from the Pew Internet & American Life Project, 77% of all adults - and 93% of those ages 18-29 - use the internet “at least occasionally.”  Less than half of those aged 65 and older use the internet or send and receive email, however.

So while there are drawbacks to online questionnaire designs of which you should be mindful (as there are with any survey modes, such as interviewer bias, etc.), the efficiency and reduced costs are more than enough rationale for most to employ online data collection techniques, either exclusively or as part of a multi-mode survey design.  Knowing and understanding your target audience is the best way to be sure that your chosen mode will produce quality data.

Quota sampling is frequently used in survey designs, and especially in market research projects.  This technique is a form of "convenience sampling," where respondents are chosen not at random, but because they are available or easier to reach.  A probability-based sampling design is not employed, due to decisions made by the researcher based upon various reasons: the population frame cannot be known, contact information for respondents is unavailable, or even because the time, effort and costs are simply too high for the budget.

Quota sampling is a way that you can gather completed questionnaires, producing adequate amounts of data, from people with different demographic attributes.  Often, market researchers want to ensure they get roughly equal amounts of data from males and females, may be interested only in a specific age range (i.e., their target market/demographic), or would like to know if preferences differ by other characteristics such as ethnicity and income level.

So where does the “quota” come into play?  Well, just as in stratified sampling, the population is divided into mutually exclusive subgroubs, often based on demographic characteristics.  The researcher sets a quota for each subgroup (100 females and 100 males, for example), collects data until the quotas are met, then stops data collection and begins data analysis.  The reason that quota sampling is not a probability-based sampling technique, thereby limiting your ability to generalize, is because respondents are not selected at random.  Quota sampling does go a step further than simply selecting whomever is available without regard to any criteria, and that's why it is used so often.

While this entry is tailored to online survey best practices, these tips can also be applied to other market research methods.


For any survey type whether you're surveying customers, collecting employee feedback or conducting a product market research study, exercise caution and good sense in order to get results that are applicable and trustworthy.

When conducting market research, either through survey forms or another mode, the method of sending a survey pre-notification letter can be a tempting one.

For some time now survey methodologists have been conducting studies of pre-notification letters to determine if they have any affect, either positively or negatively, on survey response rates. An overall analysis of these various independent studies revealed an increase in response rate of approximately 8% when compared against studies where no pre-notification letter was sent.

No one can say for sure exactly why pre-notice survey letters seem to assist in increasing the number of survey responses, but perhaps they help to establish the legitimacy of a survey, contributing to a respondent's feeling of trust and the credibility of the organization conducting the research. Another possibility is that a pre-notice letter builds expectation of arriving mail (be it electronic, paper, or in-person). A third possibility is that a potential respondent is less likely to disregard the survey when it arrives if they are aware it is arriving shortly.

Although survey pre-notification letters are an excellent (but sometimes expensive) way to increase response rates, they are seldom used in marketing research surveys. Each researcher needs to weigh the additional cost of sending out a pre-notice to potential respondents against the probability of a lower response rate.

It's worthwhile to take your population's survey sample size into consideration when coming to this decision. When your sample sizes are small, each individual response affects your survey results even more. Increasing those responses through utilizing a pre-notice letter may counterbalance the increased cost of sending them out to your participants.

In the past, I've shared online survey best practice tips you should keep in mind when designing a questionnaire to ensure quality survey data. We like to always share survey best practices, and today is no exception. Here are six more notable online survey tips.

Keep your email survey invitations short: Email marketing best practices always tell us to keep emails short and simple, with one clear call to action. In the case of survey emails, your call to action is the link to access the online web survey form. Be sure to include these important points to help recipients make an informed decision about whether or not to complete the survey:
Send personalized email survey invitations: Emails with a personal salutation result in increased response rates. Send your education survey as "Dear Mr. Wright" or “Hi John,” rather than "Dear Valued Alumni." In addition, you can insert other contact fields like organization names, work cities, amount they last gave, etc. throughout the body of the email, in order to make it highly personalized for each recipient.

Include the survey link in the email: Be sure to use the appropriate link in your outgoing emails. The default link in the emails {[S-RSVP LINK]} takes your respondents to the first page of the survey and skips the Welcome page. However, you might want to change this link to {[S-HOMEPAGE LINK]} if you have added important information on the Welcome page.

Incorporate an opt out link in all emails: Cvent requires that each email contain an opt out clause for all external surveys. It is very important that all of customers maintain compliance with the CAN-SPAM Act.

Launch survey invitations automatically: After you have tested the email invitation and your survey, you are ready to send it out in bulk to all of your invitees. We recommend that you switch the How to Send option on the Edit Settings page to the Send By Date.

Remember: Timing is everything: In order to make sure your email invitations are opened and read, avoid certain days and times. Never send out an email over the weekend or on Monday morning. This is when people’s mailboxes are full, especially with dreaded spam. We recommend sending emails in the middle of the week and the middle of the day.

A survey conducted by research firm BIA/Kelsey found that 9% of small and midsize business use Twitter for marketing purposes. An earlier survey by online marketing resource, MarketingProfs, showed that 84% of small businesses expect they will increase their use of Twitter and other social media outlets in the future. That same report also takes a look at how large businesses - including Dell and Disney - are using Twitter to reach devoted fans and potential customers. Companies large and small have begun using Twitter. I find this list of companies, although old, to be quite impressive!

At Cvent Web Surveys, we often recommend the use of Twitter, Facebook, and other social media outlets to reach a wider audience for your web survey. We've often found it to be most useful in monitoring and acted fast to ensure customer satisfaction. Bad news travels fast these days, and you have to be ready to react. 

If you are distributing your electronic survey in multiple channels (social media, your public-facing website, and through Cvent's email survey software platform) it is important to track where people are coming from. By analyzing where your respondents are coming from, you can more efficiently distribute your surveys in the future or weight responses. This is especially important if you are paying to advertise your survey - perhaps on traditional banner display advertising, website pop-ups, or search ads such as Google AdWords.

Cvent Web Surveys software provides two ways of tracking and analyzing this data. First, we have our "Reference ID". Reference IDs are a short string of text added to the end of your survey URL – "twitter", "yelp", or "google" – for instance, to allow you to track what other website "referred" the survey respondent to complete your online survey. These strings of text will then allow you to use the Cvent's built-in survey reporting to see, analyze, and slice and dice the information to give a clear view of where the survey respondents are coming from. 

Second, Cvent was proud to announce in our last quarterly product enhancement, the addition of Google Analytics integration. Google Analytics is Google's free tool for tracking visitors to your websites. The integration with Cvent Web Surveys software is extremely simple to set up and is a fantastic addition for our clients who use and love Google Analytics.

Now while I heartily recommend using social media as a tool to get your survey in front of more people, there is one thing that is crucial to remember: many businesses block social media websites. Robert Half International, an IT recruiting firm, reported 54% of companies completely block access to sites such as Twitter, Facebook, and even business-oriented LinkedIn. This means, if you're trying to attract those of us who work, you may be facing a higher hurdle than you imagined.

One of the best descriptors attributed to good survey questions is the word specific.  A main goal in designing valid, reliable survey questions is doing everything in your power to make them clear, standardized and unambiguous.  A great way to follow through on that is to make sure your questions are as specific as possible.  The degree of specificity affects how people interpret and respond to your survey questions.  Several examples are listed below to help you analyze your survey questions regarding their level of specificity.

Be clear with demographic questions.  Your objective here should be to use words and categories that your respondents can clearly understand and identify with.  Will you use Census designations for Ethnicity?   Exactly what do you mean by “marital status?”

Define vague concepts, words and phrases.  Your respondents will likely widely differ with regard to their backgrounds, experiences and perceptions.  Words like “justice” and “equality” can mean very different things to people, so it is best to define exactly what you are asking about.

Objective or subjective?  Use verbs that trigger respondents.  Attitude survey questions are usually subjective (i.e., how do you feel about the war?), while behavioral questions are usually objective (i.e., what did you eat for supper last night?).

Always try to attach a time frame to behavioral and recall questions.

For market and product research, identify the actual brand name, and ask how they feel about specific items, not just groups or genres.  For example, don’t use the vague word “furniture” if you’re really interested in how they feel about a table or a chair.

Survey designing software can't look at your questions and tell you if your online survey form will give you the data you want. However, it does make it easier when you're designing a web survey because it takes out the added complications with writing your own code. So make sure next time you're working on an instant survey form, you think about the specificity of your survey questions.

When you plan your online market research study, you still need to remember the standard steps for any market research project, plus some online specific tasks:


The time frame for an online study is, as discussed previously, often shorter because of the immediacy of the results. Keep this in mind but be sure to give yourself enough time to analyze survey responses.

Every year it seems like the holidays get earlier and earlier. This year I noticed stores had holiday decorations out before Halloween costumes! While I can attest to retail stores being ready for the holiday shopping season, it makes me wonder, are you?

Online web surveys are just one more way you have the ability to engage with your consumer email lists. Customer surveys should be no brainers. But how can an online survey form apply to holiday marketing strategies? Well that depends, are you setting survey objectives that will impact your marketing strategies?

Here's what I mean: I receive countless retail marketing emails everyday. Most of which I opted in to, however, no one ever asks me about my shopping habits or preferences. These companies could easily put together a retail survey using an online survey application and find out more about who I am as a customer, what I prefer, how frequently I shop in their stores or how frequently I visit their website. From the responses they get back, they can then customize their marketing messages based on how I shop with them. If I only shop online, it may make sense to group these customers together and do a special online promotion. All the customers who only shop in the stores would receive a different promotional offer because they shop differently than I do.

This concept goes back to one I've shared previously: profiling customers to better understand your organization. The holidays are closing in quickly, but it's not too late to build an online survey and collect customer feedback instantly.

How have you designed online survey questionnaires in the past to impact your marketing strategies?

Surveys are an invaluable tool for researching the community attitudes, employee concerns, product needs, customer loyalty and priorities held by different groups or target audiences.  Designing a questionnaire and collecting survey responses from a sample allows us to draw a profile of the group as a whole, and perhaps perform some correlation analysis to understand the source of those feelings.  The online survey findings can then support fact-based organizational decisions or improvement projects to help continually improve the organization over time.

Survey research can be applied to many venues.  Here are just a few practical applications listed below:

An Internal Employee Survey could identify reasons for low employee retention and provide ideas for reducing those costs, such as a better designed benefit program, improved training opportunities, or problems in the way the organization functions.

A Training Survey can identify how a training program has improved the capabilities of some group and how the training program itself can be improved.  

A Product Satisfaction Survey can identify initial customer experiences with a product, providing data to address unforeseen problems and help the next product release.  

A Market Research Survey can identify customers needs when creating these new service and product offerings.  Surveys can be part of Design for Six Sigma activities.  

An Association Survey, which is similar to market research and customer surveys, can show the member benefits most of interest.

However, a survey program is only valuable if it is properly designed and executed.  While performing a survey project seems deceptively simple – it's just a bunch of questions, and survey software tools make electronic surveys quick and cheap – a small mistake in the survey questionnaire design or survey administration can skew or bias the data, leading to erroneous conclusions.  No organization should ever make critical business decisions based on unreliable or invalid data.

Bad data is worse than no data!

I realized it only after the emails had been sent.  It was a test survey that wasn’t intended for entry level employees and senior management.  It was an employee evaluation that had initially been slated to go out only to our newest batch of hires.  Only last minute did we discover we could use logic to create one interactive survey online for senior management to evaluate the progress of new hire training, and new hire survey questions for them to evaluate the training process.  The wording, the slang, everything was wrong!  What did I do…

Hopefully, this scenario has appeared solely in a nightmare (and yes, survey nightmares are very real and very terrifying).  But a similar, less daunting situation is common among many: You have an online web survey that will go out to two groups of respondents, the wording in the two would ideally be completely different, and you do not have the time to go into the two templates you’ve created and select the different audiences then manually send the emails.  Not to mention, this method would require using Cvent’s email survey tool's default templates and the Custom Messages.  What if I told you it was possible to create entirely separate email marketing campaigns, set the emails up to go out automatically AND keep the both default templates and custom messages for each group of respondents? 

The multiple email marketing campaigns feature allows you to do just this!  You can select the number of separate email blasts you intend on sending, you can add entirely different contact groups to each campaign, and you can set up your emails to go out automatically. 

1. This feature is perfect if you have a multilingual survey.  You can translate your message into as many languages as you like to ensure maximum comprehension. 

2. Multiple email campaigns is also great for newsletters that are tied to a generic instant survey.  Instead of copying your survey and creating a new email blast every month, you can add an email campaign for the October '09 Newsletter, November '09 Newsletter, December '09 Newsletter and so forth.  You can then get an aggregate view of the data collected across all months.

3. The nightmare scenario outlined above.  It is likely that emails sent to your senior management are not worded the same as emails sent to entry-level new hires.  The formality of the verbiage aside, your new hires might be a bit disconcerted to know that the bosses of the bosses are watching them and evaluating their decisions. 

We all know creating surveys and designing questionnaires can be a bit overwhelming.  Why put yourself through that again just so different people can receive the same questionnaire?

I’ve talked extensively in the past about using Facebook for market research. But there are other Web 2.0 sites that you can use effectively as well.

For example, Twitter is growing more and more. You can search on Twitter for keywords or competing products to see how often they are mentioned, and what people are saying. This is a quick and simple method of gathering background info.

There are many sites where people mark things they like or dislike, like digg and del.icio.us. Everything on digg is submitted by users and then ranked by users. After a story has enough “diggs” it is listed on the front page. You can search for your client and see what types of stories are making their way to the site and get an idea of what kind of buzz is surrounding them. Del.icio.us allows users to tag and bookmark their favorite pages, and then allows all users to access rankings. You can find out how many people have bookmarked your client and competitors.

Of course, both these groups are by their nature narrower than most studies require. Results for each page are primarily involving only regular users of the site. You should broaden your search to find other respondents so your data is more accurate.

Web 2.0 sites are great places to find information and do background research. They also tend to be good places to find electronic survey respondents, as users are web savvy and opinionated. But as I mentioned, be sure not to make your respondent range too narrow.

When it comes to marketing, understanding what information your audience wants to see is very important. In the Cvent survey management system, there is an option for Click Tracking. This part of the email marketing tool is great.

Here is how it works: When you create an eNewletter in Cvent, you can embed active links. These links can then be tracked through the Cvent Web Surveys reporting engine.  Unbelievable. Imagine being able to see what articles are important to your readers by running a simple report.  This gives you the insight needed to target specific groups more effectively.

Just because you find correlation in your data when analyzing survey results does not mean there is causation. I find this is a common mistake in lots of survey reports when someone is new to survey research or conducting data analysis. Take this example:


Some people see this connection as a causation. Customers are satisfied because you contact them frequently to make sure everything is going well. The problem is, it's not a causation. Causation are extremely hard to prove because you cannot control every factor. For example, you may split your territory by industry and your solution suits some industries better than others. Or clients who are really satisfied simply use the product more often so the customer success managers reach out to them more frequently, because they are more likely to have questions. While those who use the product less have less to be satisfied about and may feel they are wasting those budget dollars.

To be able to prove causation, you need to be able to rule out all other possible explanations for the connection. As you can imagine, that's almost impossible to do since we do not control outside factors influencing the survey respondent or even the greater survey sample. Instead, when situations like these occur, we're seeing a correlation between two things. In my customer survey question examples, there's a correlation between how satisfied customers and how often they are contacted.

This principle does not only apply to customer survey research, it also applies to analyzing employee feedback forms, product surveys, market research and any other type of data collection and analysis.