Client Survey

Want to be Everything to Everyone? Think again.

Friday, November 20, 2009 by Sherrie Mersdorf
Sometimes we forget we can't be everything to everyone all the time. It's just not possible. It wouldn't make sense for a shoe designer to start creating hard hats just because a customer wrote on a comment card in response to a retail survey that she wished the designer also made hard hats because the her husband worked in construction. It seems obvious to most people, going into the hard hat market would be a bad call on the shoe designer's part. So why don't organizations have the same clarity when it comes to their business?

It can be hard to say no to customers, particularly when they have good ideas. But just because an idea is a good one, it doesn't necessarily mean it's right for your business model. Take the example many organizations have to face in their life time: where do they belong? Is it in the high end of the market, the mid-market or the bottom feeders? Most people when you ask them don't want to admit to being a bottom feeder, but there's a market need there that can be very profitable. The organization that can fulfill that need is very rarely, if ever, the same organization that can fill the need at the high end of the market. This just points out, again, that we can't ever be everything to everyone. I remember my marketing classes in college always told us you could only be two of the three things: good, fast or cheap. You can never be all three. Good and fast is expensive; fast and cheap is inferior; good and cheap is slow. It's because we can't be everything to everyone.

So how do you figure out what you should be? Your organization's mission should be a start, but missions can change and transform over time. One place you can start is to ask your employees, survey staff to see what they think the organization is and where they should be going. Employees have stellar ideas, but this may sound like a trick question so make sure to follow these tips for employee opinion surveys.

You should also ask for customer feedback. Your customers will help point you in the direction you should be heading. Sure you'll have the one off cases like with the shoe designer who's customer wants her to create hard hats for construction works, but chances are, no one else will respond that way on her customer questionnaire. And then, at the end of the day, you should be armed with the information you need to support your decision. As you're reading through survey comments, you'll notice that everyone doesn't want you to be everything.

Reduce Survey Abandonment: Make Your Survey Easy to Read

Monday, November 16, 2009 by Sherrie Mersdorf
A few weeks ago, I did a series of posts about the effect colors can have on individuals and how you should keep them in mind when designing a web survey. Today, I came across a survey form that reminded me again of the importance of your survey template's color scheme. When you're designing surveys, make sure you pick colors that are easy to read.

Example Survey Question: How long have you been a customer?

Can you read this question from a sample customer questionnaire? Probably. Is it easy to read? Do you want to answer pages and pages of survey questions writen with this color scheme? Probably not. Because it's hard to read, you will probably see a high abandonment rate and then you'll have to deal with speculations about nonresponse bias. To avoid having this issue, make sure to ask people if they find the survey easy to read when they're testing it for you. Believe me, you don't want poor color selection to decrease your response rate.

You can read more about the effects different colors have in these posts:

The Holidays are Coming - Are you prepared with targeted campaigns?

Friday, November 13, 2009 by Sherrie Mersdorf
Holidays Coming Soon!Every year it seems like the holidays get earlier and earlier. This year I noticed stores had holiday decorations out before Halloween costumes! While I can attest to retail stores being ready for the holiday shopping season, it makes me wonder, are you?

Online web surveys are just one more way you have the ability to engage with your consumer email lists. Customer surveys should be no brainers. But how can an online survey form apply to holiday marketing strategies? Well that depends, are you setting survey objectives that will impact your marketing strategies?

Here's what I mean: I receive countless retail marketing emails everyday. Most of which I opted in to, however, no one ever asks me about my shopping habits or preferences. These companies could easily put together a retail survey using an online survey application and find out more about who I am as a customer, what I prefer, how frequently I shop in their stores or how frequently I visit their website. From the responses they get back, they can then customize their marketing messages based on how I shop with them. If I only shop online, it may make sense to group these customers together and do a special online promotion. All the customers who only shop in the stores would receive a different promotional offer because they shop differently than I do.

This concept goes back to one I've shared previously: profiling customers to better understand your organization. The holidays are closing in quickly, but it's not too late to build an online survey and collect customer feedback instantly.

How have you designed online survey questionnaires in the past to impact your marketing strategies?

Think before you survey!

Friday, November 13, 2009 by Drew Northcutt
Surveys are an invaluable tool for researching the community attitudes, employee concerns, product needs, customer loyalty and priorities held by different groups or target audiences.  Designing a questionnaire and collecting survey responses from a sample allows us to draw a profile of the group as a whole, and perhaps perform some correlation analysis to understand the source of those feelings.  The online survey findings can then support fact-based organizational decisions or improvement projects to help continually improve the organization over time.

Survey research can be applied to many venues.  Here are just a few practical applications listed below:

An Internal Employee Survey could identify reasons for low employee retention and provide ideas for reducing those costs, such as a better designed benefit program, improved training opportunities, or problems in the way the organization functions.

A Training Survey can identify how a training program has improved the capabilities of some group and how the training program itself can be improved.  

A Product Satisfaction Survey can identify initial customer experiences with a product, providing data to address unforeseen problems and help the next product release.  

A Market Research Survey can identify customers needs when creating these new service and product offerings.  Surveys can be part of Design for Six Sigma activities.  

An Association Survey, which is similar to market research and customer surveys, can show the member benefits most of interest.

However, a survey program is only valuable if it is properly designed and executed.  While performing a survey project seems deceptively simple – it's just a bunch of questions, and survey software tools make electronic surveys quick and cheap – a small mistake in the survey questionnaire design or survey administration can skew or bias the data, leading to erroneous conclusions.  No organization should ever make critical business decisions based on unreliable or invalid data.

Bad data is worse than no data!

Need Sound Bites?

Thursday, November 12, 2009 by Sherrie Mersdorf
Client quotes are a marketer's treasure!Marketing departments love client testimonials and customer quotes. They're great to share with the sales team when prospects need referrals, they're helpful to put in powerpoint presentations, and can be a critical piece of any marketing website. Getting those sound bites from clients can be a challenge, however. As you can imagine, the challenge only gets bigger if your organization sells consumer products. Admittedly, the growth of social media has made finding people who are saying good things about your product, services or organization has gotten a little bit easier. But, it could be easier still.

Imagine a world where you had a plethora of client sound bites and quotes to share with the outside world. A marketers dream. No more tracking down sales reps to talk to their clients and mangle their words. Everything is already done for you. Well, if you're conducting client satisfaction surveys or consumer surveys, you should be gathering those sound bites already. You can even consider using website polls and website usability surveys to get those sound bites. Depending on the online questionnaire design, you may still need to contact the customer to get permission to use their quote, but the hard part is still done. You have the quote.

Question remains, how do you pull these customer quotes out of your survey web form? You make sure to add an additional comment box. Customers who love you will typically share those sentiments in the additional comments area, particularly if there are not other open ended questions in the survey for them to share why they like an organization.

Still wondering why your marketing department needs sound bites? Opinions for others is one of the driving forces behind purchasing decisions. If you want to learn more about the importance of customer reviews, check out this past post. It's also worth mentioning, this same idea can work for employee surveys and your HR department for recruiting purposes.

Manners in a Modern World: The "Thank You" Note

Friday, November 6, 2009 by Ariel Finno
Within the survey research process, a "Thank You" note is something that is sent a few days to a week after a questionnaire is sent out to your clients. This mailing expresses appreciation for responding and indicates that, if the client survey has not yet been completed, it is hoped it will be soon.

The postcard or email survey "thank you" note is not written in order to overcome respondent doubts or fears about taking the survey, rather, it is meant to jog memories and help re-arrange priorities, bringing your potentially forgotten survey back to the top of potential respondent's "To-Do" pile.

If timely and appropriately worded, the postcard "Thank you" note can arrive just in time to make an appeal that engenders a sense of importance about survey participation, without crossing the line into sounding impatient.

When possible, attempt to have your "Thank you" note be as different as possible from your original survey invitation request for participation letter. The goal is to create a stand-out piece of paper or electronic mail that contrasts with others, creating new stimuli for your potential respondent.

Utilizing these survey tips in conjunction with adding a "Thank You" note to your survey project outline are just some of the ways you can ensure your products are recognized as standing out from the crowd, especially in this all-too-hectic world.

Cvent Online Survey Best Practices: The Recipe for Perfect Surveys

Thursday, November 5, 2009 by Andrew Upadhyaya
Cvent provides you simple survey tips as best practices that you can follow while working on your electronic survey project to ensure that the project is flawless. Mentioned below are some survey form best practice tips that will help you achieve this.

Anonymous Survey: If you are creating an anonymous survey, please carefully consider the fact that you will not be able to link the responses that you collect to any of the respondents on your targeted list. As soon as a respondent clicks on a link in your online survey email, that person is removed from your targeted list and all of his or her contact information is removed as well. When you run survey reports for an anonymous survey form, the respondents will be identified by unique response numbers that are not linked to any respondent contact information. Respondent contact information is removed from the response for a particular anonymous survey, however it remains in your Cvent address book.

Removing Identity Confirmation Page: You can also create a collect respondent contact information survey and hide the identity confirmation page from your respondents so that the survey appears anonymous to your online survey respondents. However, for this functionality to work in your electronic survey, respondents must access the survey via a link in an email survey invitation. If the respondents are coming through the generic website link, they must go through the identity confirmation page, as there is no way to know who is responding.

Brand your company: As a valued Cvent Customer, we have activated the custom header feature in your account for a custom online survey design. Please take advantage of your ability to customize the headers on your welcome page and survey body pages to include your own images, banners and logos.

Be clear about privacy protections: People are more comfortable sharing information on the internet if they know how it will be used. The welcome page or the first page of the survey is the place to include information about how you will be using people's survey responses. Are they anonymous? Confidential? Shared with others? A university human subjects statement, if needed, would go here.

Use Page Breaks: We recommend putting a maximum of 5-6 questions on each survey page in order to keep the page lengths short. Not only does keeping each page short help reduce the likelihood that a respondent will time out, but adding page breaks helps you to collect partial responses. Anytime a respondent clicks on a "Next" button, the responses entered previous to that button are saved. This ensures that any respondents who exit the online web survey before hitting the "Finish" button will be able to go back in and answer the remainder of the questions to complete the survey.

Progress Indicator Bar: Use a progress indicator bar to allow your respondents to see where they are in the survey and to inform them when they have completed the survey.

Survey Logic: Where possible, drill down for more information. The logic in the Cvent Web Surveys system makes this very easy to do. If someone selects a negative answer choice, add a sub question to probe them for details. Use branch logic to create paths within your survey that are only applicable to one group of respondents. Pipe logic allows you to personalize your survey by pulling an answer from a previous question into the question text of a follow-up question. Lastly, advanced survey question logic can be used to make a question visible to a respondent when specific criteria are met. These criteria can be based on respondent contact information, custom contact fields, or questions in the survey. When you are applying advanced logic, you can also turn on link logic, so that respondents only see certain answer options for one question, depending on how they responded to a previous question in the survey.

Have your respondents market your survey: Activate the survey invitation forwarding feature to allow your online survey respondents send an email invitation to friends or colleagues at the completion of the survey. The contact information collected will be automatically added to your address book for future surveys.

From Name in the emails: Always use a recognizable From Name in your emails as this drives your respondents to open the email. This is very important because without opening the email, your respondents will not be able to take the survey.

Use Multiple Email Campaigns: Send targeted email marketing messages to your audience in order to help increase survey response rates. Within one survey, you can send out different messages to different groups of people by segmenting your invitee list. This functionality allows you to specify the From Name, From Email Address, Subject Line of the email, and body of the email. Take advantage of this functionality and manipulate these variables in order to increase the open rate of your survey emails and your response rates.

We often get asked, "What is a good survey design?" All of these survey best practice tips are components to keep in mind when designing a questionnaire to ensure quality survey data. Watch out for more tips coming soon...

3 Steps to Filtering your Survey Views

Tuesday, November 3, 2009 by Caitlin Rawles
One of the great things about Cvent Web Surveys software application is that it is constantly getting “better.” I, for one, am not aware of another survey software company that can state with confidence that 80% of all product enhancements come directly from the requests of current clients. Cvent, however, has certain processes in place so that every time a client expresses interest in seeing a new feature added to the online survey application, this request is quickly relayed to our technical team.

For those of you who were clients before our most recent product release in August 2009, you definitely noticed at least one big change in your account the first time you logged in after the release. As soon as you logged into your Cvent Web Surveys account, you saw that your surveys were no longer organized into folders on the Survey Selection page. Instead, they are now displayed in “views.”

Now, you may wonder why I chose to write my blog post this week on the transition from folders to survey views. It may seem like a pretty dry topic. I wanted to write on this particular survey subject because I get so many calls from clients asking how to create a new survey view that pull the appropriate surveys into view. If you have a lot of surveys created in your account, then this is a pretty important thing to know how to do, so that you don’t have to sort through all of your company’s surveys just to find the few that you are personally working on!

When you are ready to create a new survey view and filter the appropriate surveys into this view, you need to remember 3 simple steps:

1) Create a survey custom field. You can create survey custom fields under the Administration tab, on the same page that you create contact custom fields. Survey custom fields are primarily used to classify the surveys in your account and pull them into the appropriate views on the Survey Selection page. So, for example, if your marketing department and human resources department are running surveys, you may want to create 2 separate survey views, one for each department. The first step to do this would be to create a survey custom field for department.

Create Survey Views 2) Create a new view on the Survey Selection page. You can create a new survey view by choosing “add new view” from the Display drop-down menu. When you add the new view, you will need to name it and also specify certain options (i.e. whether you would like the view to be private or public). Finally, at the bottom of the page, you should apply an advanced filter based on the survey custom field you just created for department. For example, if you are adding the survey view for “Marketing Surveys,” you should choose “department” as the field, “equals” as the operator, and “marketing” as the value.

Survey View Filters

3) Now that you have created the survey custom field and added the new view, all you need to do is pull the appropriate surveys into the view you just created! When you added the new view for “Marketing Surveys,” you should have gotten a message, “no surveys match your criteria.” This is because you have not yet applied the survey custom field at the survey-level! To do this, simply go into an individual marketing survey, and click on  Settings on the top navigation bar. On the General Information page, you should click on the Custom Survey Fields tab. Here you can apply the “marketing” label to the individual survey, so that it will show up in the “Marketing Surveys” view.

Survey View Results

Hopefully this post will be helpful to those of you who are struggling with the transition from folders to survey views. Believe me, survey views are completely customizable and will help you organize online surveys in your Cvent Web Surveys software account.

Survey Design: Do Colors Matter? Part I

Monday, November 2, 2009 by Sherrie Mersdorf
I found an interesting poll today about colors preferred by men and women, and it provoked some questions about what are the best colors to use when you create polls or design survey questionnaires. Here's the breakdown from the poll shared in a Lyris Whitepaper:

Favorite Color Poll

Why does it matter? Because colors are also a form of non-verbal communication. So whether you're creating an online questionnaire to collect feedback or using an email survey tool to craft email marketing messages for survey invitations, you should care how colors affect those reading your email or completing your customer survey forms.

Colors can cause physical reactions. For example, too much red has been show to increase blood pressure. As you design survey templates, keep in mind how color meanings can affect survey respondents.

Cool colors: Cool colors typically have a calming effect. Keep in mind that cool colors can appear smaller than warm colors and visually recede on the page.

Blue Blue - As you might have guessed, blue is calming. Almost everyone likes some shade of blue, whether it's a strong and steadfast blue or a light, friendly blue. In fact, in 2008 Pantone selected Blue Iris as the color of the year. As a result of the calming effect blue has, it can make time seem to pass more quickly and help you sleep. However, too much blue can cause the calming effect to go to the extreme and cause you to have the blues. Beyond just being calming, blue can convey richness and sometimes superiority (deep royal blue) or it can convey trust and truthfulness (combining light and dark blue). See how using blues could improve your response rate if it helps people trust you?
Green
Green - Like blue, green has some calming effects and can make time seem like it's moving quicker, but it also signifies growth, renewal, health and the environment. Like with blue, green has it's own extreme as well, green can mean jealousy or envy and inexperience. With a hint of warmth and coolness, green can create balance, harmony and stability.
Purple
Purple - Over the ages, purple has come to be synonymous with royalty. Since purple comes from red (warm) and blue (cool) it has intriguing qualities of both. Typically deep and bright purples suggest riches, while lighter purples are more romantic and delicate. Keep in mind though, while purple can be noble and spiritual, too much purple can cause moodiness - the same as with too much blue.
Turquoise
Turquoise - As a blend of blue and green, turquoise can have a soft, feminine qualities or a more sophisticated feel with the darker teals.
Look for parts two and three later this week for warm and neutral color meanings.

Comparisons in Market Research

Monday, November 2, 2009 by Kelli Kelley
Burger One Market Research Study for New Sandwich ProductWhen performing a market research study for clients in certain marketplaces, it is important to remember the competition. If, for example, you were doing a customer market research survey for a fast-food restaurant, Burger One, you would want to gauge survey respondents’ feelings about the competition as well as your client.

You might ask restaurant customer satisfaction questions like:

1. How frequently do you purchase food from Burger One?
2. Do you purchase food from similar restaurants?
3. How frequently do you purchase food from similar restaurants?
4. Name the other similar restaurants you purchase food from.

If respondents frequent Burger One and four other fast-food restaurants, that gives you insight into the survey data provided. If respondents only frequent Burger One, that is helpful to know as well. Take this example of how survey results can be applied to the restaurant's over all marketing strategy:

Burger One is considering launching a new sandwich that was similar to a competitors’ offering. However, most of the restaurant customer survey respondents said they frequented the competitor. As a result, Burger One is going to make changes to their new sandwich to differentiate it and pull those consumers away from the competition.

On the other side of this equation is what Burger One's loyal customer base thinks. If customers who only eat fast-food at Burger One express no interest in the new sandwich, it may not be the best possible sandwich to launch. However, if respondents who frequent competitors more often than Burger One express high levels of interest in the new sandwich, it could spell an opportunity for Burger One to gain new business.

It’s best to analyze market research from all angles when launching a new product – there are multiple factors at play.

Eliminate Survivor Bias from your Customer and Client Surveys

Friday, October 30, 2009 by Sherrie Mersdorf
Does your customer survey have "survivor bias"? I'm betting it does. Why? Because when most survey designers create business questionnaires or client satisfaction surveys we only collect feedback from individuals who are still customers. What about lost business? Why aren't those customers who left asked to complete your client feedback form? You better believe they have feedback.

In her post at the Dimensional Research blog, Customer Satisfaction Surveys: Avoid "Survivor Bias", Diane Hagglund defines "Survivor Bias" as drawing conclusions only from data that is available or convenient and thus systematically biasing your results. AKA biasing your survey sample by only asking "happy" customers. They may not be over the moon about your product, but they're at least happy enough with your offering if they're still paying you.

I agree with Diane on this one, it's pretty ridiculous to allow this bias to creep into your customer market research. It's easily avoided considering you should have all the customer data you need to send them the same client survey template. Make sure you're measuring client satisfaction among customers who left you for a competitor as well as those who simply decided not to renew the service (and didn't go with anyone else).

When you begin writing customer survey questions to create client questionnaires or update your annual template for a client satisfaction survey make sure you think about your former customers. If you don't know who they are, this is a good time to find out. Thank goodness for internet research software and customer insight solutions to make the act of surveying clients a little easier.

Conducting a Telephone Survey

Friday, October 30, 2009 by Kelli Kelley
As market researchers, we are all aware of the many ways data can be gathered for a study. There is the online survey, telephone survey, in-person interview, direct mail questionnaire, email survey, focus groups and more.

Telephone surveys often yield decent response rates but can be difficult to conduct. A lot of people simply don’t want to be bothered on the phone and spend time answering poll questions. But phone surveys are great because you can ask all the questions and get clarification on any answers that don’t quite have the information you are looking for. The opportunity for that is of course not present in an online, email or direct mail survey.

A telephone survey is not going to work for every study, however. There are some products that won’t match up well. For example, a survey about a medical product is likely not one that anyone will want to discuss over the phone with a stranger.

For a consumer survey with a lot of feedback answers using numbered responses, an email questionnaire might be best as it could grow tedious and leave too much margin for error.

If it works, you can also combine survey methods and gather data both ways. When creating the surveys be sure to incorporate the differences into the call script and email. If it is necessary to have pre-screening questions for the phone interview, make them as concise as possible. Combining data collection methods is helpful and can achieve a more well-rounded result, but be careful about choosing the best method for your purposes.

Using Client Surveys to Increase Customer Retention

Thursday, October 29, 2009 by Kelli Kelley
When working with a client who has already built a strong customer base, market researchers are often called upon to create surveys to aid with customer retention programs.

Customer retention surveys are a bit different than a new product or service launch survey because the survey respondent sample must consist of product users. There are several things you need to ask this group so your client can formulate the best customer retention strategies, including:

1. How many times have you used this product?
2. How often do you purchase this product?
3. Would you recommend this product to someone else?

The recommendation sample customer questionnaire question is important. Often, this can be a company’s bread-and-butter when it comes to retaining customers and gaining new ones. If a good amount of current customers would recommend the product to a friend, that speaks volumes about the quality.

It is also wise to include some open-ended questions. Find out why people use the product, and would continue to do so. If they wouldn’t recommend the product, or use it again, it is important to know why. Your client can use the information to persuade customers on the fence, and keep current customers coming back.

Before creating a poll online for your client survey, sit down and gauge initial opinions and move forward from there. If there were original product launch studies done, it may be helpful to revisit those results as well, just for comparison purposes. Approach the questionnaire research with care and the resulting data analysis will provide information to create customer retention techniques and marketing strategies.

10 Tips to Increase Survey Response Rates

Wednesday, October 28, 2009 by Sherrie Mersdorf
Increase Response RatesIncreasing survey response rates is a major goal of most survey builders and market researchers. There's an art and a science to increasing campaign response rates whether it's an email marketing campaign or an online market research study. I wanted to share some of my tips for how to increase survey response rates:

Make the email survey invitation from names easy to recognize. You can do this by including an individual's name within the organization that's well known (such as the CEO or if it's a client survey, the name of their sales rep). You can also use the organization's name, or both. For example, I'm subscribed to a few MarketingProf's newsletters. When they send out emails they include the same person's name and their organizations name so it looks like this: Anne, MarketingProfs. I recognize it everytime, and since I enjoy their newsletter, I made sure to open the email.

Keep subject line's compelling, but short. The subject line and the From Name are the two most critical pieces to get your email opened. Try to keep your subject lines to 35 characters or less. You don't need to put the entire email in the subject line, but you do need to include enough information to make the recipients open the survey email.

Create an attractive survey invitation. Studies have shown that well done HTML email messages get better response rates than plain text emails. With HTML you have the opportunity to include images, change font sizes, bold text, etc. Take advantage of this chance. It's one more way to get people to click through to your survey!

Send personalized survey invitations. Personalizing your emails, even something as simple as including the recipient's name in the greeting, will return a higher response than a generic message. It creates a personal touch, and makes the recipient feel like someone took the time to send them a personal message (even though your email survey tool did it for you).

Introduce the survey. Let the participants know why they should participate in your survey. If they don't understand why their opinion is important to your survey findings, why would they want to take the time to fill it out?

How long will the survey take? Not setting expectations in the beginning for survey length leads to low response rates and high abandonment rates. Not what you want to see. If you don't let people know how long it will take to fill out your online survey, they're going to assume you're hiding something about how long it is. Tell them it will take X minutes or the survey is only Y questions long. Definitely be honest, if you lie here, you're going to hurt your future chances of getting those respondents to complete your next online survey questionnaire.

Remind your survey sample that their responses will be kept confidential. This is particularly important for surveys about uncomfortable topics. For example, you created a poll for a public opinion survey to see how your population feels about an emotional topic such as abortion. If you don't keep the information confidential, you probably will not get honest feedback. Same thing goes with employee questionnaires, they should always be kept confidential and anonymous. Not keeping responses confidential will definitely hurt your response rate, as well as the validity of the data.

Offer an incentive. Offering incentives is a proven method for increasing survey response rates. But this method doesn't work if you don't let people know about it up front. Put it in your email, put it on the welcome page of the survey, then make sure to follow up. Again, if you drop the ball here, the chances of that survey respondent completing your online survey form in the future is drastically reduced.

Always say Thank You! Remember when your mom always made you write thank you notes when you got presents or cards from people for holidays and birthdays? It was because people like to feel their effort is noticed and appreciated. Same idea here, it's nice to just get a short note thanking them for their time. After all, survey respondents are doing you a favor.

Don't over email your contact list. This is very important. You shouldn't be inviting the same people to complete your online surveys every month. It's important to segment your list using whichever survey sampling method that works best for your surveys to avoid email list fatigue. Make sure that you're coordinating with other campaigns as well. Just because you know they're different initiatives you're emailing about, your contact's wont necessarily see it that way. If you begin sending emails too frequently, contacts are going to just delete your email and never open it, opt out or report you as a spammer.

Have a tip that I missed? I'd love to hear it!

Asking Open-ended Survey Questions

Wednesday, October 28, 2009 by Kelli Kelley
A good survey includes both qualitative and quantitative data, but when gathering qualitative data it is important to gather the right kind of answers. Go too open-ended with your question, and you may end up with answers that do not help you with your study at all.

Consumer insights into a new product or service are important to a market research study, and open-ended questions are the way to get them. When conducting consumer surveys, there are several online survey tips you can follow to get the right mix of closed and open-ended question:

1. Determine if it is a question that you cannot ask in any other way. For example, if you were asking consumers how often they purchased a product, it would be difficult to analyze data if that question were left open-ended. Group responses into categories like once a month, twice a month, more than three times a month.

2. If the question must be open-ended, make it narrow. Sounds contradictory, but if you ask too much, you’ll get too much. Don’t ask if they like your product and if they share it with friends in one breath. Ask simple questions like: Why do you purchase the product?

3. Allow expansion on closed-ended questions. If you are unsure about something, leave room for comments on close-ended questions. This is a good compromise that can help you get the responses you need.

These are just a few best practices for survey writing, but it goes without saying that when creating a survey, you need to put as much, if not more, effort into writing the questions as you will analyzing the data.

Consumer Satisfaction Surveys: Same People Always On Top

Tuesday, October 27, 2009 by Sherrie Mersdorf
I got an email today from Smarter Travel announcing the winners of their 2009 Readers' Choice Awards. Notice anything interesting?

Smarter Travel Readers' Choice Awards 2009 Results

Hopefully you saw what I saw, Southwest really took the Readers' Choice Awards by storm. Almost every category Southwest won - and the ones they didn't? Well, those aren't categories you wanted to win: Dirtiest Airline Cabins and Least-Favorite Domestic Airline.

I think this consumer survey example brings up a point we've made in the past: often when you're the best at one thing that improves customer experiences, you're good at a bunch of them. Think about last bank survey or retail survey results you saw, were the same people at the top?

Bank surveys often put USAA and Wachovia at the top, do you think it's a coincidence they're at the top everytime? It doesn't matter if the survey is measuring customer service satisfaction or overall satisfaction or satisfaction with online bill pay. Organizations that take customer insights to heart and are truly customer-centric do very well in these types of awards. Customers are satisfied!

Just to prove that it's not just a fluke Southwest is on top, Jetblue came in second on all the categories too. Jake wrote a post about a week ago talking about a consumer survey conducted about airline customer satisfaction. If you recall, Southwest was the star in that article as well. It's because they take what customers say about topics such as baggage fees to heart. From the looks of it, paying attention to consumer insights and customer opinions seems to be serving them well.

So here's a question, if a consumer satisfaction survey was conducted across your industry, would you win the Readers' Choice Awards?

Survey Sampling Demystified: Stratified Sampling

Tuesday, October 27, 2009 by Tyson Gingery
I’ve written in the past that it’s best to use probability-based sampling techniques for your employee, market research or consumer survey samples whenever possible.  One of these techniques is called stratified sampling.  It is used when you expect that your population is heterogeneous (different) and that the survey results could vary greatly based upon certain subgroup characteristics.  If you are particularly interested in subgroup analysis within your survey sample, using a stratified sample can increase the accuracy of your results and reduce error estimates.  Here’s how it works:

Let’s say you are interested the television watching habits of American citizens, and you know (from anecdotal evidence or previous theory) that television watching varies widely by gender.  Since you know that males and females have disparate television watching habits, you want to select a sample whose results will accurately reflect the habits and responses for males and females independently.

What you do is first divide the population into mutually exclusive subgroups (or “strata”), and then take a random sample from each of the subgroups.  Using our gender example, you would divide the population into two groups (male and female), then take a random sample from your male and female subgroups, respectively.  You will be able to be more confident in what you say about your results than if you used a simple random sample from the overall population.

Online Survey Best Practices for Event Surveys (Part I)

Monday, October 19, 2009 by Sherrie Mersdorf
A recent article in Meetings & Conventions Magazine caught my attention this month: Survey Science, How to Craft more Effective Attendee Evaluations. Meeting planners are usually not survey experts, their expertise lay in planning and executing events, not crafting flawless survey research questionnaires. However, in the last year the value of meetings and events have been called into question after bad press surrounding some organizations' meeting practices. With meeting and event planners having to increasingly prove the values of meetings and measuring meeting results, being able to create event surveys to gather attendee feedback has become even more important.

While we've discussed several of these survey best practices in the past in reference to sample staff survey questions or customer feedback forms it never hurts to review them again. Here are the first five online survey tips from the article:

1. Set survey goals first. This shouldn't be a big surprise. On Friday I wrote about how to create a customer survey, and setting customer satisfaction survey objectives was the first step there too. If you don't figure out what your objectives are in the beginning, writing meaningful survey questions will be a lot harder later on. For example, if the survey objective is to figure out how to improve the event next year, only ask questions about things you can change for future events. It doesn't make sense to evaluate the location if you've already booked the same venue for next year; if you haven't booked next year's location, asking about the venue makes sense.

2. Write survey questions that are clear and ask what you really want to ask. Articulating a question to really collect the feedback you're looking for can be quite a challenge. Take these sample conference survey questions, if the planner wants to identify which sessions would be best to add to next year's lineup (assuming attendees must pay to attend the sessions):

Which of the following sessions would you attend?
Which additions would you like to see at next year's conference?
For which of the following sessions would you be willing to pay?

 
If you've been paying attention to survey best practices, you'll know the third one is the wording you want. Why? Because it's the only one that explains the attendees will have to pay for the sessions. It's not a matter of which sessions sound interesting, it's a matter of which sessions present enough value to be worth the cost.

3. Find out why they're dissatisfied. It's not enough to know that an attendee was dissatisfied with the registration process. Planners should provide attendees with the chance to explain why they are dissatisfied - maybe it was a technical problem or there wasn't enough event staff to mitigate issues.

4. Keep it short. General survey best practices suggest keeping your online survey as short as possible. The best methods for making sure you're keeping it short is to only ask questions that have a direct link to your seminar survey objectives. The second method is to make sure you're using survey question logic, such as branch and skip logic. This allows you to keep the survey relevant to the respondent and only ask questions that make sense. We hinted at this in a recent post where we talked about using one survey to gather event feedback for all the sessions at your event.

5. Think about the survey's organization. When designing questionnaires it's important to keep the flow of the survey in mind. Start with general questions and work your way to the more specific questions. The survey should only focus on one topic at a time. In the example of multiple event sessions, it doesn't make sense to mix up the session questions. Instead, ask all the questions you have about one session, then move on to the next session.

In the next few days, I'll share the other 10 survey tips from the Meetings & Conventions article. As a meeting or event planner, how have you found pre- and post-event surveys helpful in planning events?

Have a Question? Chat with a Cvent Expert!

Monday, October 19, 2009 by Sherrie Mersdorf
Have a question? We're here to help! Here at Cvent we're always trying to help people improve their survey projects. Whether you're trying to write new employee feedback survey questions, create a customer service performance reviews or simply get a better understanding of how our online survey research software and enterprise feedback management solution works, we're happy to answer your questions!

To make it easy to get all your survey questions answered, we've added a chat to our blog. Someone will be happy to answer your questions during normal business hours (9am - 6pm ET). So go ahead, click to chat and ask our experts your questions about employee feedback software, data collection methods, customer survey questions, or any other survey questionnaire related question!

Difference Between Causation vs. Correlation in Survey Data

Friday, September 25, 2009 by Sherrie Mersdorf
Just because you find correlation in your data when analyzing survey results does not mean there is causation. I find this is a common mistake in lots of survey reports when someone is new to survey research or conducting data analysis. Take this example:

Your organization sells products and services in the business-to-business space. As part of your model, each organization has a customer success manager who is responsible for reaching out to clients and ensuring they're using the product appropriately and ensure they're satisfied customers so they continue to be customers. As a result, it's really important to continually measure customer satisfaction. To do this, you've purchased customer feedback software to conduct customer surveys.

You follow all the survey best practices and keep your survey short. Two survey questions that are always asked, for example, are:
 
How satisfied are you with our products?
How often does your customer success manager reach out to you?

When conducting the survey analysis of the survey responses, you find almost all clients who are contacted every few weeks are very satisfied, but clients who are rarely or never contacted are very dissatisfied.

Some people see this connection as a causation. Customers are satisfied because you contact them frequently to make sure everything is going well. The problem is, it's not a causation. Causation are extremely hard to prove because you cannot control every factor. For example, you may split your territory by industry and your solution suits some industries better than others. Or clients who are really satisfied simply use the product more often so the customer success managers reach out to them more frequently, because they are more likely to have questions. While those who use the product less have less to be satisfied about and may feel they are wasting those budget dollars.

To be able to prove causation, you need to be able to rule out all other possible explanations for the connection. As you can imagine, that's almost impossible to do since we do not control outside factors influencing the survey respondent or even the greater survey sample. Instead, when situations like these occur, we're seeing a correlation between two things. In my customer survey question examples, there's a correlation between how satisfied customers and how often they are contacted.

This principle does not only apply to customer survey research, it also applies to analyzing employee feedback forms, product surveys, market research and any other type of data collection and analysis.