Customer Survey Questions

While this entry is tailored to online survey best practices, these tips can also be applied to other market research methods.


For any survey type whether you're surveying customers, collecting employee feedback or conducting a product market research study, exercise caution and good sense in order to get results that are applicable and trustworthy.

Every year it seems like the holidays get earlier and earlier. This year I noticed stores had holiday decorations out before Halloween costumes! While I can attest to retail stores being ready for the holiday shopping season, it makes me wonder, are you?

Online web surveys are just one more way you have the ability to engage with your consumer email lists. Customer surveys should be no brainers. But how can an online survey form apply to holiday marketing strategies? Well that depends, are you setting survey objectives that will impact your marketing strategies?

Here's what I mean: I receive countless retail marketing emails everyday. Most of which I opted in to, however, no one ever asks me about my shopping habits or preferences. These companies could easily put together a retail survey using an online survey application and find out more about who I am as a customer, what I prefer, how frequently I shop in their stores or how frequently I visit their website. From the responses they get back, they can then customize their marketing messages based on how I shop with them. If I only shop online, it may make sense to group these customers together and do a special online promotion. All the customers who only shop in the stores would receive a different promotional offer because they shop differently than I do.

This concept goes back to one I've shared previously: profiling customers to better understand your organization. The holidays are closing in quickly, but it's not too late to build an online survey and collect customer feedback instantly.

How have you designed online survey questionnaires in the past to impact your marketing strategies?

Too often companies make the common mistake of surveying customers after it’s too late. Many will use customer satisfaction surveys to gauge how they did last month or last quarter. In truly proactive, customer-focused organizations customer feedback is used on a daily basis to increase revenue and improve customer satisfaction and loyalty when the timing is critical for the customer.

Most customer feedback collected is of immediate importance to them and requires immediate attention. Waiting until a survey closes to attend to customer needs is a recipe for disaster. This could include missing out on hot leads for new business, up-sell and cross-sell opportunities, or worse not reaching out to identify the dissatisfaction from an irate customer.


Your customer is seeing how much you really care about their business. Why should they waste their time taking a web survey form to help you improve, if there is clearly no actions being taken to apply the feedback you’ve received? Why is a customer going to work with a firm that they feel is wasting their time? Now the customer is not only feeling as if you aren’t concerned about their needs and opinions, you’ve pushed them to look at your competitors. The goal is to take this opportunity to show the customer how much you truly care about their needs.

Having a system in place to streamline and automate your produce with real time alerts will allow you to serve you customers in a more timely fashion, keeping them happy and better yet loyal.

Surveys are an invaluable tool for researching the community attitudes, employee concerns, product needs, customer loyalty and priorities held by different groups or target audiences.  Designing a questionnaire and collecting survey responses from a sample allows us to draw a profile of the group as a whole, and perhaps perform some correlation analysis to understand the source of those feelings.  The online survey findings can then support fact-based organizational decisions or improvement projects to help continually improve the organization over time.

Survey research can be applied to many venues.  Here are just a few practical applications listed below:

An Internal Employee Survey could identify reasons for low employee retention and provide ideas for reducing those costs, such as a better designed benefit program, improved training opportunities, or problems in the way the organization functions.

A Training Survey can identify how a training program has improved the capabilities of some group and how the training program itself can be improved.  

A Product Satisfaction Survey can identify initial customer experiences with a product, providing data to address unforeseen problems and help the next product release.  

A Market Research Survey can identify customers needs when creating these new service and product offerings.  Surveys can be part of Design for Six Sigma activities.  

An Association Survey, which is similar to market research and customer surveys, can show the member benefits most of interest.

However, a survey program is only valuable if it is properly designed and executed.  While performing a survey project seems deceptively simple – it's just a bunch of questions, and survey software tools make electronic surveys quick and cheap – a small mistake in the survey questionnaire design or survey administration can skew or bias the data, leading to erroneous conclusions.  No organization should ever make critical business decisions based on unreliable or invalid data.

Bad data is worse than no data!

One of the great things about Cvent Web Surveys software application is that it is constantly getting “better.” I, for one, am not aware of another survey software company that can state with confidence that 80% of all product enhancements come directly from the requests of current clients. Cvent, however, has certain processes in place so that every time a client expresses interest in seeing a new feature added to the online survey application, this request is quickly relayed to our technical team.

For those of you who were clients before our most recent product release in August 2009, you definitely noticed at least one big change in your account the first time you logged in after the release. As soon as you logged into your Cvent Web Surveys account, you saw that your surveys were no longer organized into folders on the Survey Selection page. Instead, they are now displayed in “views.”

Now, you may wonder why I chose to write my blog post this week on the transition from folders to survey views. It may seem like a pretty dry topic. I wanted to write on this particular survey subject because I get so many calls from clients asking how to create a new survey view that pull the appropriate surveys into view. If you have a lot of surveys created in your account, then this is a pretty important thing to know how to do, so that you don’t have to sort through all of your company’s surveys just to find the few that you are personally working on!

When you are ready to create a new survey view and filter the appropriate surveys into this view, you need to remember 3 simple steps:

1) Create a survey custom field. You can create survey custom fields under the Administration tab, on the same page that you create contact custom fields. Survey custom fields are primarily used to classify the surveys in your account and pull them into the appropriate views on the Survey Selection page. So, for example, if your marketing department and human resources department are running surveys, you may want to create 2 separate survey views, one for each department. The first step to do this would be to create a survey custom field for department.

2) Create a new view on the Survey Selection page. You can create a new survey view by choosing “add new view” from the Display drop-down menu. When you add the new view, you will need to name it and also specify certain options (i.e. whether you would like the view to be private or public). Finally, at the bottom of the page, you should apply an advanced filter based on the survey custom field you just created for department. For example, if you are adding the survey view for “Marketing Surveys,” you should choose “department” as the field, “equals” as the operator, and “marketing” as the value.


3) Now that you have created the survey custom field and added the new view, all you need to do is pull the appropriate surveys into the view you just created! When you added the new view for “Marketing Surveys,” you should have gotten a message, “no surveys match your criteria.” This is because you have not yet applied the survey custom field at the survey-level! To do this, simply go into an individual marketing survey, and click on  Settings on the top navigation bar. On the General Information page, you should click on the Custom Survey Fields tab. Here you can apply the “marketing” label to the individual survey, so that it will show up in the “Marketing Surveys” view.


Hopefully this post will be helpful to those of you who are struggling with the transition from folders to survey views. Believe me, survey views are completely customizable and will help you organize online surveys in your Cvent Web Surveys software account.

I found an interesting poll today about colors preferred by men and women, and it provoked some questions about what are the best colors to use when you create polls or design survey questionnaires. Here's the breakdown from the poll shared in a Lyris Whitepaper:


Why does it matter? Because colors are also a form of non-verbal communication. So whether you're creating an online questionnaire to collect feedback or using an email survey tool to craft email marketing messages for survey invitations, you should care how colors affect those reading your email or completing your customer survey forms.

Colors can cause physical reactions. For example, too much red has been show to increase blood pressure. As you design survey templates, keep in mind how color meanings can affect survey respondents.

Cool colors: Cool colors typically have a calming effect. Keep in mind that cool colors can appear smaller than warm colors and visually recede on the page.

	Blue - As you might have guessed, blue is calming. Almost everyone likes some shade of blue, whether it's a strong and steadfast blue or a light, friendly blue. In fact, in 2008 Pantone selected Blue Iris as the color of the year. As a result of the calming effect blue has, it can make time seem to pass more quickly and help you sleep. However, too much blue can cause the calming effect to go to the extreme and cause you to have the blues. Beyond just being calming, blue can convey richness and sometimes superiority (deep royal blue) or it can convey trust and truthfulness (combining light and dark blue). See how using blues could improve your response rate if it helps people trust you?
	Green - Like blue, green has some calming effects and can make time seem like it's moving quicker, but it also signifies growth, renewal, health and the environment. Like with blue, green has it's own extreme as well, green can mean jealousy or envy and inexperience. With a hint of warmth and coolness, green can create balance, harmony and stability.
	Purple - Over the ages, purple has come to be synonymous with royalty. Since purple comes from red (warm) and blue (cool) it has intriguing qualities of both. Typically deep and bright purples suggest riches, while lighter purples are more romantic and delicate. Keep in mind though, while purple can be noble and spiritual, too much purple can cause moodiness - the same as with too much blue.
	Turquoise - As a blend of blue and green, turquoise can have a soft, feminine qualities or a more sophisticated feel with the darker teals.

Look for parts two and three later this week for warm and neutral color meanings.

When performing a market research study for clients in certain marketplaces, it is important to remember the competition. If, for example, you were doing a customer market research survey for a fast-food restaurant, Burger One, you would want to gauge survey respondents’ feelings about the competition as well as your client.

You might ask restaurant customer satisfaction questions like:


If respondents frequent Burger One and four other fast-food restaurants, that gives you insight into the survey data provided. If respondents only frequent Burger One, that is helpful to know as well. Take this example of how survey results can be applied to the restaurant's over all marketing strategy:


On the other side of this equation is what Burger One's loyal customer base thinks. If customers who only eat fast-food at Burger One express no interest in the new sandwich, it may not be the best possible sandwich to launch. However, if respondents who frequent competitors more often than Burger One express high levels of interest in the new sandwich, it could spell an opportunity for Burger One to gain new business.

It’s best to analyze market research from all angles when launching a new product – there are multiple factors at play.

Does your customer survey have "survivor bias"? I'm betting it does. Why? Because when most survey designers create business questionnaires or client satisfaction surveys we only collect feedback from individuals who are still customers. What about lost business? Why aren't those customers who left asked to complete your client feedback form? You better believe they have feedback.

In her post at the Dimensional Research blog, Customer Satisfaction Surveys: Avoid "Survivor Bias", Diane Hagglund defines "Survivor Bias" as drawing conclusions only from data that is available or convenient and thus systematically biasing your results. AKA biasing your survey sample by only asking "happy" customers. They may not be over the moon about your product, but they're at least happy enough with your offering if they're still paying you.

I agree with Diane on this one, it's pretty ridiculous to allow this bias to creep into your customer market research. It's easily avoided considering you should have all the customer data you need to send them the same client survey template. Make sure you're measuring client satisfaction among customers who left you for a competitor as well as those who simply decided not to renew the service (and didn't go with anyone else).

When you begin writing customer survey questions to create client questionnaires or update your annual template for a client satisfaction survey make sure you think about your former customers. If you don't know who they are, this is a good time to find out. Thank goodness for internet research software and customer insight solutions to make the act of surveying clients a little easier.

A recent article in Meetings & Conventions Magazine caught my attention this month: Survey Science, How to Craft more Effective Attendee Evaluations. Meeting planners are usually not survey experts, their expertise lay in planning and executing events, not crafting flawless survey research questionnaires. However, in the last year the value of meetings and events have been called into question after bad press surrounding some organizations' meeting practices. With meeting and event planners having to increasingly prove the values of meetings and measuring meeting results, being able to create event surveys to gather attendee feedback has become even more important.

While we've discussed several of these survey best practices in the past in reference to sample staff survey questions or customer feedback forms it never hurts to review them again. Here are the first five online survey tips from the article:

1. Set survey goals first. This shouldn't be a big surprise. On Friday I wrote about how to create a customer survey, and setting customer satisfaction survey objectives was the first step there too. If you don't figure out what your objectives are in the beginning, writing meaningful survey questions will be a lot harder later on. For example, if the survey objective is to figure out how to improve the event next year, only ask questions about things you can change for future events. It doesn't make sense to evaluate the location if you've already booked the same venue for next year; if you haven't booked next year's location, asking about the venue makes sense.

2. Write survey questions that are clear and ask what you really want to ask. Articulating a question to really collect the feedback you're looking for can be quite a challenge. Take these sample conference survey questions, if the planner wants to identify which sessions would be best to add to next year's lineup (assuming attendees must pay to attend the sessions):

If you've been paying attention to survey best practices, you'll know the third one is the wording you want. Why? Because it's the only one that explains the attendees will have to pay for the sessions. It's not a matter of which sessions sound interesting, it's a matter of which sessions present enough value to be worth the cost.

3. Find out why they're dissatisfied. It's not enough to know that an attendee was dissatisfied with the registration process. Planners should provide attendees with the chance to explain why they are dissatisfied - maybe it was a technical problem or there wasn't enough event staff to mitigate issues.

4. Keep it short. General survey best practices suggest keeping your online survey as short as possible. The best methods for making sure you're keeping it short is to only ask questions that have a direct link to your seminar survey objectives. The second method is to make sure you're using survey question logic, such as branch and skip logic. This allows you to keep the survey relevant to the respondent and only ask questions that make sense. We hinted at this in a recent post where we talked about using one survey to gather event feedback for all the sessions at your event.

5. Think about the survey's organization. When designing questionnaires it's important to keep the flow of the survey in mind. Start with general questions and work your way to the more specific questions. The survey should only focus on one topic at a time. In the example of multiple event sessions, it doesn't make sense to mix up the session questions. Instead, ask all the questions you have about one session, then move on to the next session.

In the next few days, I'll share the other 10 survey tips from the Meetings & Conventions article. As a meeting or event planner, how have you found pre- and post-event surveys helpful in planning events?

Have a question? We're here to help! Here at Cvent we're always trying to help people improve their survey projects. Whether you're trying to write new employee feedback survey questions, create a customer service performance reviews or simply get a better understanding of how our online survey research software and enterprise feedback management solution works, we're happy to answer your questions!

To make it easy to get all your survey questions answered, we've added a chat to our blog. Someone will be happy to answer your questions during normal business hours (9am - 6pm ET). So go ahead, click to chat and ask our experts your questions about employee feedback software, data collection methods, customer survey questions, or any other survey questionnaire related question!

Online surveys offer many advantages over traditional quantitative research methods (such as phone and mail surveys), like cost efficiency, user-friendly survey design software, and getting results in electronic format.  One concern with using an online survey mode is that it can sometimes produce lower response rates than other modes. With some planning and careful consideration, however, you can get response rates equal to (or higher than) traditional methods.  One of the main ways you can raise response rates is by increasing your survey’s legitimacy to your audience.  Make respondents feel like they should complete your survey because it is important in some regard.  To do this, implement the following guidelines:

Be professional throughout the entire communication process.  Choose your survey sample wisely, and make sure the survey is relevant to them.  Let them know why you’re asking for their time, and that you really appreciate their opinions.  Tell them what the results will be used for, and that you can send a summary if they wish to see one.  Use appropriate language, and avoid wording things too casually unless the sample’s demographics call for it.  Send them thank you notes.

Personalize the survey for each respondent.  This includes sending personalized email survey invitation, such as referring to them by name instead of "Dear Valued Customer," if you have access to that information.  If you already have demographic data about your respondents elsewhere, do not ask them for it in the survey (link to it later on).

Use a custom survey banner.  Survey respondents like to know who the survey is from, what it concerns, and that it is from a legitimate organization for a legitimate reason.  Adding your logo or letterhead to the survey template design makes it easy to remind them who you are.  This is also basically a free form of branding.

Anything you can do to keep your survey in the research and scientific realms will help increase legitimacy.  Respondents are more likely to complete a survey offered in this manner than when paired with a sales pitch.  If possible, partner with another organization, such as a local research office, college or nonprofit organization.

Many people ask the question How do I create a customer survey? The basic steps are the same no matter what type of client survey you're writing: customer satisfaction, global market research, product development surveys, etc.

Step 1: Sit down and figure out what the goal of the survey is. Are you trying to identify upsell opportunities? Want to discover features missing from your current product? Figuring out if it's a good idea to take your marketing overseas and attack a global market? In the very beginning of the survey planning process, you should know what it is you want to get out of the consumer survey. If you don't have a firm customer satisfaction survey objectives in the beginning, while you go through the other steps such as writing survey questions or selecting the best survey software, you're going to stray from the path. If you stray from the path, you may find the final survey results are not as helpful as you had hoped.

Step 2: Decide on a research methodology. Your goals should help you on this step as well. You need to first decide if you're planning to do qualitative or quantitative research. From there narrow the scope further, if you want to do qualitative research are you interested in focus groups, advisory boards, one-on-one interviews? With quantitative research you may decide on comment cards, feedback forms and surveys. Is your survey method going to be online, telephone-based or paper questionnaires?

Step 3: Survey Design. I'm making the assumption since you're reading a survey blog about how to create customer surveys, you're not interested in the other market research methods right now so I'm going to focus on the process of building customer surveys. Once you've gotten through the first two steps, you're ready to start writing survey questions (Finally! I bet you thought this would be the first step!). Customer satisfaction survey design can be the biggest challenge. Luckily, there is survey designing software to help you step through this. Survey software tools often have templates and question libraries to help you write good survey questions.

Step 4: Data collection. Okay, you've picked your customer survey methodology, created a client survey and you're ready to field your survey (or use the data collection tool in your survey application to collect responses). Exactly what you do in this step will depend on what type of survey you decided to collected: telephone, paper, online. One way to get survey responses is to use email marketing tools to send personalized email surveys. You can also share the link on your website, social media sites, invoices, etc.

Step 5: Analyze customer feedback. Analyzing survey data is one of people's least favorite parts of the surveying process. We have some tips for how to analyze survey data here. Don't be afraid of this step. You need to conduct the survey customer analysis to achieve your goal. It's what you set out to do, so keep your chin up. You're only a step away from the final product (and once you choose survey analysis methods you should be almost finished).

Step 6: Share the survey findings. This is what you set out to do. Get answers to your customer questions. Take the customer feedback analysis you completed in the last step and format it. You're creating a survey report you can share within your organization (and maybe with others outside of your organization). If you need tips for creating survey reports or an example survey report, you can read more about them here.

Step 6.1: Take action. This is still part of step 6, but it's important enough it should be broken out. In your customer analysis survey report, you should have shared your recommendations for moving forward. Make sure you make recommendations and there is an agreement about moving forward based on the customer survey findings. If you don't plan to take action in Step 1, then you should save yourself the time of conducting the customer research in the first place.

Any other survey research design tips? How have you used these steps to create a customer survey that improved processes in your organization?

“Knowledge is power.” Again, a statement that I frequently heard from my parents and teachers growing up. When I was 10, I was probably told this because I was complaining about doing my fifth grade homework. These days, I still say this silently to myself from time to time. This is because knowledge is power not only to the fifth grader who is trying to get A’s in school, but also to anyone trying to make a profit in the business world.

There is no way around it; Cvent Web Surveys software provides you with business knowledge. By surveying your client pool, you will learn about their likes and dislikes, and you can thus enhance your products or services to meet the needs of those who matter. The web survey application also provides you with another kind of knowledge though, through the recent addition of click tracking reports.

Whereas the actual act of surveying customers allows you to learn more about them “from the horse’s mouth”, click tracking reports give you insight into which links people are clicking on in your survey emails, which can be extremely beneficial as well. For example, if you send your monthly e-newsletters out through the Cvent online survey platform (as many of our clients do), then you can run click tracking reports to view which links to outside websites your recipients are clicking on. Who is clicking on which links? Which URLs are the most popular?

Cvent email marketing click tracking reports include graphs that are easy to read and interpret. You can export them into Microsoft Word, Excel, or PDF. Most importantly, however, click tracking reports teach you how to place information and links in your emails. If you use emails to market your organization at all, then click tracking reports will help you leverage your ability to format those emails in order to generate the maximum possible business (and money!) for you.

Although question order effects are believed to be stronger for interviews than for online research surveys, it is still important to take a look at your market survey format and how the questions are ordered throughout your survey questionnaire.  By following the general guidelines listed below, you can reduce possible order effects and response bias from your customer survey samples.

Start broad, then get more specific.  Ask your customers or respondents general questions about your organization and the concepts you are interested in first, then get down to the more detailed questions you want them to answer (such as those about individual products, specific preferences and how to improve customer service).

Ideally, you’d like to find out if the order of your questions can induce biases before you send it to your entire survey population.  Use online survey software that allows you to randomize parts of your online survey, and compare the results with those from predefined orders.  This is an excellent way to pretest your survey questionnaire for possible order effects.

Devote some time and effort to making your survey “flow.”  You want the overall survey instrument to be cohesive, not disjointed or seemingly all over the place.  A big part of allowing for a logical flow throughout a survey comes from writing smooth transitions.  Let your respondents know that you want them to change gears.

Ask demographic questions at the end of your survey.

If you are asking sensitive questions (about topics like income, personal behaviors, etc.) try to place these toward the latter parts of your survey as well.  That way you get at least partial completions in the event that respondents change their mind and exit your survey before full completion.

Sabre, a travel-reservations-technology company, recently conducted a survey of 90 global airlines and a whopping 86% said that efforts aimed at maintaining and growing customer loyalty had the most positive impact on their business. The survey also found that 58% of airlines are increasing fees on checked bags and peak travel times, among others, to help their bottom line.

See the disconnect? No? Well, JD Power reported in June that customer satisfaction with airlines has dropped - for the third straight year. JD Power cites increased fees and decreased services as a prime reason for the drop and also notes that the low-cost carriers - Southwest, JetBlue, and Virgin America - have significantly higher satisfaction. They also tend to have far fewer fees.

Everyone knows that airlines are struggling right now, but I bet your business has seen better times as well. Would you ever simultaneously think that customer satisfaction is the most important driver for your business... and then do exactly the thing that depresses that satisfaction the most? The industry has conducted some great research, but the belief that they can somehow do the opposite of what that satisfaction research suggests and still satisfaction in the long term seems tenuous.

But not all airlines are chasing short term revenues as the expense of long term customer loyalty and profits. The New York Times is reporting that some are urging regulation to stop airlines from charging "holiday surcharges" that do not appear as part of the fare, but are added to the price of your ticket later in the purchase process. Who is urging this regulation? Not consumer groups (well, they probably are as well!), but none other than Virgin Group founder and Chairman Richard Branson. Branson says the "fees are not a good idea" and is worried that airlines risk alienating travelers if they add to many after-fare fees. 

It is good to see that not everyone in the industry is blind to the data - and my personal customer experiences say that Branson is right on the money. I know that I am now far, far less likely to even consider flying on the legacy carriers these days. Why fly United if I'm going to be nickled-and-dimed when I can fly Southwest, JetBlue, or Branson's Virgin America? 

Surveying customers and your target market is only worthwhile if you actually listen to the results and act on them. As the former CEO of Southwest Airlines (a Cvent Web Surveys client!), Herb Kelleher said: "We have a strategic plan. It's called doing things". Survey your market, your customers, and your employees and use the date to enact change. Don't ignore it and hope for the best!

Every organization should ask themselves What is good customer service? and create their own definition for good customer service based on the answer they come up with. Giving customers the opportunity to provide feedback on their customer experience is one way to improve customer service quality, but only if the customer feedback gets back to the employees. Lots of organizations use customer service surveys to measure customer experiences and customer loyalty. What separates the organizations with mediocre customer service from the organizations with excellent customer service is sharing the feedback from the customer loyalty surveys with the employees. Seems pretty straight forward, right?

I suggest you take it a step further, however. While sharing the aggregate results of customer feedback surveys with front-line employees is important, you can use these customer surveys as assessments of employee performance or staff evaluations. If you're not already using customer surveys to support this type of employee performance feedback, here are some steps from the CRMBuyer to make this type of process possible:

• Move from random survey sampling to an attempted census. Random survey samples are great when you're just trying to get an overall sense of customer satisfaction rates. However, if you're trying to collect feedback to figure out how to improve employee performance, a random sample is unlikely to provide enough data for each employee. Like with all other types of surveys, not everyone you send personalized survey invitations to will participate, but you will likely get enough responses to support the employee assessments.

• Develop new employee reports. To improve workforce performance, organizations can't continue to provide infrequent high-level survey reports. Instead, employees should get to see weekly reports. Using standardized reports that compare the employee to the overall average and to their colleagues as a group have the most impact.

• Develop new management reports. Like with how employees see the customer feedback reports needs to change with this strategy, management reports do too. Managers should be able to see responses by employees so they can take appropriate action. Managers will have different opinions on how much information should be shared with their staff; some will want to share every customer comment from the employee performance evaluation form, others wont want to share individual survey results.

• Develop HR guidelines for the use of these employee reports. The HR department should be deeply involved in the creation of these HR employee appraisal forms and employee survey reports. If an employee constantly receives negative customer feedback, the organization may choose to terminate their employment so it helps to keep HR in the loop. However, that shouldn't be the goal of this type of customer survey program. The survey feedback should be used to improve employee job performance and mentor them. With the help of customer service assessment surveys and employee performance review forms organizations can figure out how to improve customer service quality.

Generating new customers is much more difficult than retaining current customers. Businesses can stay afloat in a time of recession by leaning on those current customers - the downfall: they must do everything in their power to keep them as customers. One of the most effective ways businesses have successfully had good customer retention programs is by surveying customers.

By using the net promoter score (NPS) question type, a company can survey customers using a 0-10 point scale with 0 indicating the extreme negative and 10 extreme positive. There are three categories: promoters, passives and detractors. Promoters are those who rate a 9 or 10. Passives are those who rate a 7 or 8. Detractors are those who rate the organization a 6 and below. The total NPS score is determined by subtracting percent of detractors from percent of promoters- with 50 and above considered a good score. The NPS survey question asked is: How likely is it that you would recommend this product to a friend or colleague?

With promoters, there are two main types: high-profit and low-profit.

High-profit promoters are those individuals who buy the most, most loyal, and essentially make up the company’s revenue stream.   But low- profit promoters are loyal customers who are restricted from purchasing as much as they like (typically due to budget). In the end, high-promoters are essential to company’s profit because if you believe the 80-20 rule (80% of your profits come from 20% of your customers), then you certainly want to survey to find out who those high-promoters are in order to keep them happy.

Like with promoters, there are the high-profit and low-profit detractors.

Customers who are high-profit detractors are still very important, because they are still high dollar clients. Companies must give them a lot of attention as these are the people who your competition will want to steal. Low- profit detractors are those you cannot please within reason. However, while you may lose these as customers, it’s important to maintain professional relationships as well a good company image. You don't want to give your detractors any additional reasons to say anything negative to other potential customers. 

Something to keep in mind: dissatisfied customers will eventually tell 9 other people about their problem with satisfied customers will tell 5-6 others about their positive experience. Having customers that are willing to promote you are the biggest indication of a high customer satisfaction.

The first part of this two-part series outlined how to write survey questions that are relevant to your audience in order to design good surveys.  This post will provide the rationale for asking questions to a competent survey sample, and how doing so reduces error and increases the validity of your survey results.

In general, when employees, customers and other types of respondents receive online consumer research or opinion surveys, they believe it is for a logical reason.  They are usually selected because they are employees with insight about a certain company, have previously used particular products and services, provided contact information to you (such as an e-mail address), or are believed to possess other information and/or opinions that are valued by researchers and organizations at large. 

Because of this, respondents naturally feel they should "know the answers" to your market research questions (i.e. they are competent regarding the concepts covered in the survey).  In fact, if your survey respondents come across a question that confuses them, or one that they do not know the answer to, many will select a response regardless of whether it accurately reflects their behaviors or opinions.  To design surveys that can reduce this possible source of error, you should attempt to include questions about which your survey sample is knowledgeable and able to answer. 

You know your customers and survey population best; asking them client survey questions for which they are unqualified to answer can not only confuse respondents, but may cause you to end up with bad data.  Design survey questions that are appropriate for your target market - this means your questions are both relevant to your audience, and that your audience is adequately informed about the concepts addressed in your feedback form.

There are many ways to design survey questions that allow you to collect more actionable data.  Forced choice survey questions makes survey respondents choose a response option that indicates a definitive opinion.  These questions eliminate Don’t Know and Neutral response options, because they are designed to force respondents to express an opinion or attitude.  Forced choice survey questions are usually written in the form of agree/disagree statements with survey scales, or consist of statements where respondents select the one that describes their opinions closest to their true feelings.

Survey research studies generally indicate that excluding Don’t Know and Neutral options doesn’t necessarily change the proportion of responses leaning toward certain sides of a likert response scale.  So these questions can add value, especially when you want to make business decisions based on customer preferences.  Just be sure to take into account the two suggestions below if you’re considering forced choice questions during the questionnaire design stage.

1) Make sure that your customer survey sample is familiar with the concepts and products you are asking about, and that there isn’t a significant number of them who might honestly hold ambiguous opinions.   If you think a don’t know/neutral option is necessary for your target market, it’s probably best to include one.

2) It is still usually a good idea to include a Not Applicable response choice if there are segments of your survey sample to which the question does not apply (i.e., your e-mail list consists of people other than past customers, respondents haven’t used the type of product or service you’re asking about before, etc.).  Your data collection goal may be to force customers to “take a side,” but not at the expense of producing valid, reliable survey data.

Just because you find correlation in your data when analyzing survey results does not mean there is causation. I find this is a common mistake in lots of survey reports when someone is new to survey research or conducting data analysis. Take this example:


Some people see this connection as a causation. Customers are satisfied because you contact them frequently to make sure everything is going well. The problem is, it's not a causation. Causation are extremely hard to prove because you cannot control every factor. For example, you may split your territory by industry and your solution suits some industries better than others. Or clients who are really satisfied simply use the product more often so the customer success managers reach out to them more frequently, because they are more likely to have questions. While those who use the product less have less to be satisfied about and may feel they are wasting those budget dollars.

To be able to prove causation, you need to be able to rule out all other possible explanations for the connection. As you can imagine, that's almost impossible to do since we do not control outside factors influencing the survey respondent or even the greater survey sample. Instead, when situations like these occur, we're seeing a correlation between two things. In my customer survey question examples, there's a correlation between how satisfied customers and how often they are contacted.

This principle does not only apply to customer survey research, it also applies to analyzing employee feedback forms, product surveys, market research and any other type of data collection and analysis.