Feedback Form

12 Step Online Survey Checklist

Friday, November 20, 2009 by Sherrie Mersdorf
We all have that momentary feeling in the pit of our stomachs when we launch a survey form online that there could be a mistake we missed somewhere. It never seems to go away no matter how many campaigns I launch. Fortunately, I found this 12 question survey checklist to help ease that dreaded feeling a little bit.

• Is the purpose of the survey crystal clear?
• Are all the questions relevant and focused?
• Are all the questions easy to understand?
• Have you avoided ambiguity?
• Are all the question balanced?
• Is the list of options for each question exhaustive?
• Is the list of options for each question mutually exclusive?
• Have you used the same survey scale throughout the feedback form?
• Is there a combination of closed and open-ended questions?
• Are the questions ordered logically?
• Does the survey question logic work correctly?
• Have other reviewed the online web survey?

If you say No to any of these questions, you need to go back and look at the survey created for this project again. once you can answer Yes to all twelve questions, your survey campaign should be in pretty good shape. Still feeling a little uneasy? Here are some more tips for what to look for in Test Mode as one final check.

Want to be Everything to Everyone? Think again.

Friday, November 20, 2009 by Sherrie Mersdorf
Sometimes we forget we can't be everything to everyone all the time. It's just not possible. It wouldn't make sense for a shoe designer to start creating hard hats just because a customer wrote on a comment card in response to a retail survey that she wished the designer also made hard hats because the her husband worked in construction. It seems obvious to most people, going into the hard hat market would be a bad call on the shoe designer's part. So why don't organizations have the same clarity when it comes to their business?

It can be hard to say no to customers, particularly when they have good ideas. But just because an idea is a good one, it doesn't necessarily mean it's right for your business model. Take the example many organizations have to face in their life time: where do they belong? Is it in the high end of the market, the mid-market or the bottom feeders? Most people when you ask them don't want to admit to being a bottom feeder, but there's a market need there that can be very profitable. The organization that can fulfill that need is very rarely, if ever, the same organization that can fill the need at the high end of the market. This just points out, again, that we can't ever be everything to everyone. I remember my marketing classes in college always told us you could only be two of the three things: good, fast or cheap. You can never be all three. Good and fast is expensive; fast and cheap is inferior; good and cheap is slow. It's because we can't be everything to everyone.

So how do you figure out what you should be? Your organization's mission should be a start, but missions can change and transform over time. One place you can start is to ask your employees, survey staff to see what they think the organization is and where they should be going. Employees have stellar ideas, but this may sound like a trick question so make sure to follow these tips for employee opinion surveys.

You should also ask for customer feedback. Your customers will help point you in the direction you should be heading. Sure you'll have the one off cases like with the shoe designer who's customer wants her to create hard hats for construction works, but chances are, no one else will respond that way on her customer questionnaire. And then, at the end of the day, you should be armed with the information you need to support your decision. As you're reading through survey comments, you'll notice that everyone doesn't want you to be everything.

Vote for your favorite Pot Luck Dish with Ease

Tuesday, November 17, 2009 by Sherrie Mersdorf
Holida Pot Luck: Surveys Ease the Planning NighmareWe all know the holidays are getting closer, which means office pot lucks are about to become all the rage. What will you be bringing? How is your office going to make sure that not everyone plans to bring the same thing? How do you determine the winner of this year's Tastiest Dish Awards?

Competitions involving food are definitely a favorite around this time of year. However, if you have a big office, it can be a pain to collect everyone's votes. As I mentioned at Halloween, building polls to quickly identify the winner of your office Halloween Costume contest can be applied to the Best Dish Award too. Simply log into your web site voting poll software, make a poll to gather employee opinions on who should win this year's Best Dish Awards. Have different categories, such as best presentation, tastiest appetizer, most unique recipe? Add in images of the dishes to help jog people's memories and create one web poll using your poll maker.

Don't think that an online poll survey software tool can only play it's part at the end of the pot luck event, you can send a pre-event survey to find out who plans to bring what. If too many people are planning to bring dessert, a typical favorite, the online poll generator can easily run a survey report to identify categories with too many volunteers. You can easily create a survey contact group to email those volunteers and ask them if they can bring something else.

Holidays are a time to celebrate with family and friends, and eat delicious food. Unfortunately, we often make such office traditions a little more painful than they need to be by forgetting we can use a polling system or survey software tool we already have. Since Cvent Web Surveys doesn't limit the number of responses you can have, it wouldn't make sense to suffer through paper ballots when it can be done for you! Ready to create a poll for your next staff opinion survey? Get started with a free trial.

What are your other sample employee opinion survey examples?

How Long Do Respondents Perceive Your Online Survey Is?

Tuesday, November 10, 2009 by Sherrie Mersdorf
Objects in mirror are closer than they appearWhat is a survey design's ideal length? In the past we've told you the typical survey best practice says surveys, whether they're paper or web survey forms, shouldn't be longer than thirty questions. While thirty certainly isn't a huge number, if you tell me you have a thirty question survey you want me to complete, forget it. I'm never going to complete your feedback form. However, if you tell me it's only a 10 question survey, I'm more likely to be on board. That is, unless I start to give you the customer feedback you're looking for and feel like your online questionnaire is longer than 10 questions.

You probably didn't lie to me, at least not if you're read about the dangers of lying about survey length in your email survey messages. It's probably a case of side view mirror syndrome: objects are closer than they appear - or applied to web survey design, questionnaires appear longer than they are.

Not surprising, if your survey form is interesting, the survey respondent is going to perceive it's shorter than it really is. However, the reverse doesn't seem to be true. If your web survey feedback form is boring and on an uninteresting topic, respondents will perceive it's the same length (and too long) whether there are fifteen questions or thirty questions.

It's not just about the actual length of your form when designing a questionnaire online, it's also about the perceived length. Even though your survey is only ten questions long, it may feel a lot longer if your collecting feedback about an uninteresting topic. If your survey questionnaire feels long, you instantly increase your chance of survey respondents abandoning your feedback form.

Benefits of Instant Surveys

Tuesday, November 10, 2009 by Kelli Kelley
There are many options available to market researchers when designing a web survey form. I covered this topic a bit last week when I discussed creating online surveys, and included some dos and don’ts.

Conducting a study for the Web offers several opportunities for market researchers that paper questionnaires do not. For example, you can create an instant survey and check on responses frequently for updates. You may even allow the respondents to view the current results when they complete the survey. This works best for one or two-question quick polls rather than longer studies. But knowing they will see the results immediately is frequently a tipping point for respondents who are on the fence about completing your feedback survey form.

This can be helpful in analyzing survey data as well. For example, suppose results for your online survey form vary wildly throughout one week. One day, 10% of respondents use your client’s brand of glass cleaner. The next day, it’s 65%, but then the following day it drops back down to 20%. This could mean something (possibly that you need to check your recipient list) and is good information to track for your client.

The instant results also allow you to add more questions and gain clarification on points you may not have considered prior to launching the survey form. There are dozens of survey web software tools available that can create instant survey results – it’s a method that is worth trying out, but as always, consider your client’s needs before committing to a particular survey method.

Survey Research Definitions: Habituation and Acquiescence

Friday, November 6, 2009 by Tyson Gingery
It is tempting to include many similar question types with similar response options in your online survey design.  Matrix questions, for example, provide an efficient questionnaire design method to help you gather lots of data in a neat, brief survey form.  It is wise, however, to resist the urge to use too many uniform survey questions and response lists, namely because of two sources of bias that stem from doing so: habituation and acquiescence.

Habituation occurs when respondents begin providing the same answers to survey questions with the same response options.  They start to get in a habit and select the identical response choice for every question.

Acquiescence is related to habituation, and occurs when respondents passively agree with an interviewer or survey questions.  Agree-disagree scales are the most often-used response options in opinion surveys; it is important that you take steps to avoid the chance that respondents will passively agree with your statements in order to quickly complete the questionnaire or provide what they think may be the “right” answers.

To avoid these response biases, you can use online survey software that allows question randomization, break up your matrix questions with other types of questions and scales, and phrase some questions in a manner that makes respondents switch their thinking.  An example of the latter would be to ask a series of positive questions in your survey questionnaire, and then throw in a couple questions worded differently so as not to allow habituation or acquiescence.  Use care up-front in your online questionnaire design to be sure that you'll reduce error and bias in your results.

New to Survey Design? Use Pre-Created Survey Templates

Thursday, November 5, 2009 by Lisa Boruah
Cvent offers a variety of Pre-Designed Survey Templates you can choose from for your first online web survey. These internet survey templates contain default questions, email, welcome and thank you text which you can utilize when designing a questionnaire. You can also choose from over 50 different graphical templates to suit the look and feel of your survey forms. Here’s a list of the different pre-created survey templates that you can use to build the base of your survey:

Advertisement Evaluation
Association Member Survey
Blank Survey
Buying Experience Survey
Company Evaluation
Customer Satisfaction Questionnaire
Customer Service Satisfaction Survey
Demographic Survey
Employee Benefits Survey
Employee Exit Interview
Employee Satisfaction Questionnaire
Internet Behavior Survey
Post-Event Survey
Pre-Event Survey
Product Feedback Survey
Senior Management Evaluation
Training Evaluation

Besides this vast list of pre-designed questionnaires and graphical survey templates, Cvent also offers you a Question Library, which is filled with Customer Service, Demographics, Event, HR/Training, Marketing/Sales questions that you can utilize in your survey.

So! Go ahead and Sign up for an online web survey free trial account now and enjoy these á-la-carte features absolutely free.

Does Placement of Factual Questions Affect Survey Responses? You Bet It Does!

Monday, November 2, 2009 by Ariel Finno
Sometimes we get so excited about creating a survey we want to jump right in and ask the really interesting questions. Those typically consist of finding out about who our clients are, where they're located, etc. (factual questions). In other words, our demographic questions.

But if we don’t take the time to think about placement of these really important factual items within our surveys, we may be inadvertently affecting the results we see. By placing your demographic survey questions (name, gender, race/ethnicity, age, etc.) close to the end of the survey feedback form as opposed to right at the beginning, you are increasing the chances that respondents will fill out these items, leading to richer data collection and more useful results. Respondents are more likely to feel invested in your survey, and will understand why you are asking those personal questions if those sensitive items are placed after survey questions that address the purpose of your survey.

Check out these blog posts to get started with your demographic survey questions.

Survey Sampling Demystified: Margin of Error and Confidence Level

Monday, November 2, 2009 by Tyson Gingery
If you’ve ever looked at results from a public opinion survey or political poll, you’ve no doubt seen the margin or error noted alongside the findings.  Usually the note will read something like margin of error = plus or minus x%, CL 95%.

So what the heck does that mean?

Well, the first part basically tells you how close the results from your selected sample are compared to what you'd find if you surveyed the entire population.  The expression of “plus or minus x%” tells you that the percentages of given responses might be a bit higher or lower “in reality” (i.e., if you surveyed absolutely everyone).

Generalizability to the larger population is also described by an associated measure called a confidence level (CL). This term describes how confident you can be that your results are not due to chance alone.  A confidence level is normally set at either 90%, 95% or 99% (95% has become standard).

Let’s use an example to understand how these two concepts work:

A random sample of Americans were asked whether they preferred cake or ice cream for dessert.  The results showed that 60% preferred ice cream over cake, and 40% preferred cake over ice cream.  This question had a margin of error of +/- 3% at a 95% confidence level. What this means is that you can be 95% confident that the percentage of all Americans who prefer ice cream would fall between 57% and 63% (60 plus or minus 3).  Another way to put it would be as follows: if you conducted 100 surveys of the entire population, at least 95 times you would find that the percentage who preferred cake ranged from 37% to 43%.

Eliminate Survivor Bias from your Customer and Client Surveys

Friday, October 30, 2009 by Sherrie Mersdorf
Does your customer survey have "survivor bias"? I'm betting it does. Why? Because when most survey designers create business questionnaires or client satisfaction surveys we only collect feedback from individuals who are still customers. What about lost business? Why aren't those customers who left asked to complete your client feedback form? You better believe they have feedback.

In her post at the Dimensional Research blog, Customer Satisfaction Surveys: Avoid "Survivor Bias", Diane Hagglund defines "Survivor Bias" as drawing conclusions only from data that is available or convenient and thus systematically biasing your results. AKA biasing your survey sample by only asking "happy" customers. They may not be over the moon about your product, but they're at least happy enough with your offering if they're still paying you.

I agree with Diane on this one, it's pretty ridiculous to allow this bias to creep into your customer market research. It's easily avoided considering you should have all the customer data you need to send them the same client survey template. Make sure you're measuring client satisfaction among customers who left you for a competitor as well as those who simply decided not to renew the service (and didn't go with anyone else).

When you begin writing customer survey questions to create client questionnaires or update your annual template for a client satisfaction survey make sure you think about your former customers. If you don't know who they are, this is a good time to find out. Thank goodness for internet research software and customer insight solutions to make the act of surveying clients a little easier.

10 Tips to Increase Survey Response Rates

Wednesday, October 28, 2009 by Sherrie Mersdorf
Increase Response RatesIncreasing survey response rates is a major goal of most survey builders and market researchers. There's an art and a science to increasing campaign response rates whether it's an email marketing campaign or an online market research study. I wanted to share some of my tips for how to increase survey response rates:

Make the email survey invitation from names easy to recognize. You can do this by including an individual's name within the organization that's well known (such as the CEO or if it's a client survey, the name of their sales rep). You can also use the organization's name, or both. For example, I'm subscribed to a few MarketingProf's newsletters. When they send out emails they include the same person's name and their organizations name so it looks like this: Anne, MarketingProfs. I recognize it everytime, and since I enjoy their newsletter, I made sure to open the email.

Keep subject line's compelling, but short. The subject line and the From Name are the two most critical pieces to get your email opened. Try to keep your subject lines to 35 characters or less. You don't need to put the entire email in the subject line, but you do need to include enough information to make the recipients open the survey email.

Create an attractive survey invitation. Studies have shown that well done HTML email messages get better response rates than plain text emails. With HTML you have the opportunity to include images, change font sizes, bold text, etc. Take advantage of this chance. It's one more way to get people to click through to your survey!

Send personalized survey invitations. Personalizing your emails, even something as simple as including the recipient's name in the greeting, will return a higher response than a generic message. It creates a personal touch, and makes the recipient feel like someone took the time to send them a personal message (even though your email survey tool did it for you).

Introduce the survey. Let the participants know why they should participate in your survey. If they don't understand why their opinion is important to your survey findings, why would they want to take the time to fill it out?

How long will the survey take? Not setting expectations in the beginning for survey length leads to low response rates and high abandonment rates. Not what you want to see. If you don't let people know how long it will take to fill out your online survey, they're going to assume you're hiding something about how long it is. Tell them it will take X minutes or the survey is only Y questions long. Definitely be honest, if you lie here, you're going to hurt your future chances of getting those respondents to complete your next online survey questionnaire.

Remind your survey sample that their responses will be kept confidential. This is particularly important for surveys about uncomfortable topics. For example, you created a poll for a public opinion survey to see how your population feels about an emotional topic such as abortion. If you don't keep the information confidential, you probably will not get honest feedback. Same thing goes with employee questionnaires, they should always be kept confidential and anonymous. Not keeping responses confidential will definitely hurt your response rate, as well as the validity of the data.

Offer an incentive. Offering incentives is a proven method for increasing survey response rates. But this method doesn't work if you don't let people know about it up front. Put it in your email, put it on the welcome page of the survey, then make sure to follow up. Again, if you drop the ball here, the chances of that survey respondent completing your online survey form in the future is drastically reduced.

Always say Thank You! Remember when your mom always made you write thank you notes when you got presents or cards from people for holidays and birthdays? It was because people like to feel their effort is noticed and appreciated. Same idea here, it's nice to just get a short note thanking them for their time. After all, survey respondents are doing you a favor.

Don't over email your contact list. This is very important. You shouldn't be inviting the same people to complete your online surveys every month. It's important to segment your list using whichever survey sampling method that works best for your surveys to avoid email list fatigue. Make sure that you're coordinating with other campaigns as well. Just because you know they're different initiatives you're emailing about, your contact's wont necessarily see it that way. If you begin sending emails too frequently, contacts are going to just delete your email and never open it, opt out or report you as a spammer.

Have a tip that I missed? I'd love to hear it!

Are You Trying to Solve a Non-Problem?

Monday, October 26, 2009 by Sherrie Mersdorf
I was asked to complete a product market research survey today. The product survey asked me a series of questions about possible products related to improving my beer drinking experience. One of the many things I didn't like about this survey was they never asked me if I thought there was a problem.

For example, one of the possible products was for a different method of carrying beer. Unfortunately, I'm perfectly happy with my current method: keeping the beer in the package it comes in. The suggested product would make me move the bottles from their packaging to take them somewhere. I'm not interested in that extra step. Did they ask me why I wouldn't by the product? Nope. They only asked if I would.

Maybe for their survey research goals, that's all they cared about: Would I buy the product, Yes or No? Kelli mentioned in a post earlier today that it's important to gather product feedback on a smaller scale before launching a bigger market research study. The goal of this market research questionnaire easily could have been to identify which product ideas should be considered for further qualitative and quantitative research. Only products where more than 20% of survey respondents indicated they would be interested in purchasing will have more research around it.

On the other hand, I like to make sure my position is clear when completing attitude surveys. This is probably a respondent bias I bring to the table because I spend so much time sharing online survey best practices. I know that often survey questions are written in a way that doesn't always collect the data the survey creator wants. They just don't always write the right questions. So avoid being "mis-quoted" so to speak, I like to be able to answer a series of question about why I feel one way or another.

Believe me, there were a lot of poorly written survey questions in the feedback form, as well as other issues with their data collection method. I've found that where there is one serious problem with a survey template, there are others hidden as well. If you're worried your survey questionnaire may have problems, go ahead and ask our online survey Professional Services Group to take a look. We're always happy to help.

Looking for sample market research survey questions? Here are a few sample product survey questions you can use in your next product research survey:

Sample Product Survey Question: How likely would you be to purchase this new product?
Sample Product Survey Question: How uniques would you say this product is compared to other products currently available?
Sample Product Survey Question: How believable are the claims made by this new product?
Sample Product Survey Question: Overall, how much do you like this new product?

How Do You Sse 360 Feedback Surveys?

Monday, October 26, 2009 by Sherrie Mersdorf
How do you use 360 feedback surveys? Many people don't believe in doing 360 surveys, others will hang their hats on them. No matter how you slice it, there are some risks associated with conducting annonymouse 360 degree feedback surveys: Hurt feelings, burnt bridges, career retibution, etc. I think these are all fair. Even though giving and receiving feedback is important (and essential!), it's hard to not take comments personal. Many of us fail to really see the value of feedback and lack the introspective skills to apply this valuable perspective to our personal development.

So the real question is, how have you conducted 360 surveys in the past? Have they been successful? How did you use the data collected?

I think it's important to keep in mind that 360 degree feedback surveys are best used to begin the conversation. If it's not well managed, it can quickly take a turn for the worst and just become lots of negative rants. This isn't what you want. These feedback surveys should be used for development purposes, not to trash talk coworkers. Using these surveys to get the conversation started helps make the topics that society tells us are "no-nos" okay to talk about.

I'd love to hear your experiences with 360 degree surveys.

Response Rate Boosters: Sending Reminders

Wednesday, October 21, 2009 by Tyson Gingery
I recommend taking advantage of the technological power within good online survey software programs.  A great way to increase your survey response rates is to send reminder email survey invitations to your customers if they have haven't completed your questionnaire after receiving notification of selection for your surveys.

People are busy; email inboxes are bombarded with messages, alerts and spam.  Customers may delete your survey invitation email if they are in a hurry, trying to clean up their inboxes, or do not feel the feedback survey is relevant or interesting to them.  Often, people will receive a survey invitation and look through it, but not follow-through in clicking though to the survey questionnaire to complete the actual online survey poll.  They may even have made a mental note to complete the survey later, but then it gets lost in the shuffle.

You can take steps to reduce both these nonresponse problems by sending personalized email survey reminders.  If a respondent or customer contact does not respond to your online questionnaire within a given time frame (that you specify), you can program your online survey software to automatically resend survey invitations (multiple times!).  You set up the invitations, so you can choose to resend the original invitation or tweak it with a different message to remind them they have yet to complete the survey.

In your reminders, let respondents know that they previously received an invitation from you because their opinions are valuable, and they were selected as part of your survey sample for a good reason.  Restate the incentive if you're offering one. 

As we all know, however, there is a delicate line between reminding and nagging.  If you drift toward the latter, chances are your respondents will become annoyed and reactively delete emails from you (surveys or otherwise).  In general, send a maximum of three or four survey emails to your respondents after they’ve received the original invitation and survey poll link.  If they've deleted or lost your previous emails, they may respond to one of the reminders, and who knows… even if they’re ambivalent toward completing your internet survey, you might catch them at a better time and get a completion.

Online Survey Best Practices for Event Surveys (Part I)

Monday, October 19, 2009 by Sherrie Mersdorf
A recent article in Meetings & Conventions Magazine caught my attention this month: Survey Science, How to Craft more Effective Attendee Evaluations. Meeting planners are usually not survey experts, their expertise lay in planning and executing events, not crafting flawless survey research questionnaires. However, in the last year the value of meetings and events have been called into question after bad press surrounding some organizations' meeting practices. With meeting and event planners having to increasingly prove the values of meetings and measuring meeting results, being able to create event surveys to gather attendee feedback has become even more important.

While we've discussed several of these survey best practices in the past in reference to sample staff survey questions or customer feedback forms it never hurts to review them again. Here are the first five online survey tips from the article:

1. Set survey goals first. This shouldn't be a big surprise. On Friday I wrote about how to create a customer survey, and setting customer satisfaction survey objectives was the first step there too. If you don't figure out what your objectives are in the beginning, writing meaningful survey questions will be a lot harder later on. For example, if the survey objective is to figure out how to improve the event next year, only ask questions about things you can change for future events. It doesn't make sense to evaluate the location if you've already booked the same venue for next year; if you haven't booked next year's location, asking about the venue makes sense.

2. Write survey questions that are clear and ask what you really want to ask. Articulating a question to really collect the feedback you're looking for can be quite a challenge. Take these sample conference survey questions, if the planner wants to identify which sessions would be best to add to next year's lineup (assuming attendees must pay to attend the sessions):

Which of the following sessions would you attend?
Which additions would you like to see at next year's conference?
For which of the following sessions would you be willing to pay?

 
If you've been paying attention to survey best practices, you'll know the third one is the wording you want. Why? Because it's the only one that explains the attendees will have to pay for the sessions. It's not a matter of which sessions sound interesting, it's a matter of which sessions present enough value to be worth the cost.

3. Find out why they're dissatisfied. It's not enough to know that an attendee was dissatisfied with the registration process. Planners should provide attendees with the chance to explain why they are dissatisfied - maybe it was a technical problem or there wasn't enough event staff to mitigate issues.

4. Keep it short. General survey best practices suggest keeping your online survey as short as possible. The best methods for making sure you're keeping it short is to only ask questions that have a direct link to your seminar survey objectives. The second method is to make sure you're using survey question logic, such as branch and skip logic. This allows you to keep the survey relevant to the respondent and only ask questions that make sense. We hinted at this in a recent post where we talked about using one survey to gather event feedback for all the sessions at your event.

5. Think about the survey's organization. When designing questionnaires it's important to keep the flow of the survey in mind. Start with general questions and work your way to the more specific questions. The survey should only focus on one topic at a time. In the example of multiple event sessions, it doesn't make sense to mix up the session questions. Instead, ask all the questions you have about one session, then move on to the next session.

In the next few days, I'll share the other 10 survey tips from the Meetings & Conventions article. As a meeting or event planner, how have you found pre- and post-event surveys helpful in planning events?

Have a Question? Chat with a Cvent Expert!

Monday, October 19, 2009 by Sherrie Mersdorf
Have a question? We're here to help! Here at Cvent we're always trying to help people improve their survey projects. Whether you're trying to write new employee feedback survey questions, create a customer service performance reviews or simply get a better understanding of how our online survey research software and enterprise feedback management solution works, we're happy to answer your questions!

To make it easy to get all your survey questions answered, we've added a chat to our blog. Someone will be happy to answer your questions during normal business hours (9am - 6pm ET). So go ahead, click to chat and ask our experts your questions about employee feedback software, data collection methods, customer survey questions, or any other survey questionnaire related question!

6 Easy Steps on How to Create Customer Surveys

Friday, October 16, 2009 by Sherrie Mersdorf
Many people ask the question How do I create a customer survey? The basic steps are the same no matter what type of client survey you're writing: customer satisfaction, global market research, product development surveys, etc.

Step 1: Sit down and figure out what the goal of the survey is. Are you trying to identify upsell opportunities? Want to discover features missing from your current product? Figuring out if it's a good idea to take your marketing overseas and attack a global market? In the very beginning of the survey planning process, you should know what it is you want to get out of the consumer survey. If you don't have a firm customer satisfaction survey objectives in the beginning, while you go through the other steps such as writing survey questions or selecting the best survey software, you're going to stray from the path. If you stray from the path, you may find the final survey results are not as helpful as you had hoped.

Step 2: Decide on a research methodology. Your goals should help you on this step as well. You need to first decide if you're planning to do qualitative or quantitative research. From there narrow the scope further, if you want to do qualitative research are you interested in focus groups, advisory boards, one-on-one interviews? With quantitative research you may decide on comment cards, feedback forms and surveys. Is your survey method going to be online, telephone-based or paper questionnaires?

Step 3: Survey Design. I'm making the assumption since you're reading a survey blog about how to create customer surveys, you're not interested in the other market research methods right now so I'm going to focus on the process of building customer surveys. Once you've gotten through the first two steps, you're ready to start writing survey questions (Finally! I bet you thought this would be the first step!). Customer satisfaction survey design can be the biggest challenge. Luckily, there is survey designing software to help you step through this. Survey software tools often have templates and question libraries to help you write good survey questions.

Step 4: Data collection. Okay, you've picked your customer survey methodology, created a client survey and you're ready to field your survey (or use the data collection tool in your survey application to collect responses). Exactly what you do in this step will depend on what type of survey you decided to collected: telephone, paper, online. One way to get survey responses is to use email marketing tools to send personalized email surveys. You can also share the link on your website, social media sites, invoices, etc.

Step 5: Analyze customer feedback. Analyzing survey data is one of people's least favorite parts of the surveying process. We have some tips for how to analyze survey data here. Don't be afraid of this step. You need to conduct the survey customer analysis to achieve your goal. It's what you set out to do, so keep your chin up. You're only a step away from the final product (and once you choose survey analysis methods you should be almost finished).

Step 6: Share the survey findings. This is what you set out to do. Get answers to your customer questions. Take the customer feedback analysis you completed in the last step and format it. You're creating a survey report you can share within your organization (and maybe with others outside of your organization). If you need tips for creating survey reports or an example survey report, you can read more about them here.

Step 6.1: Take action. This is still part of step 6, but it's important enough it should be broken out. In your customer analysis survey report, you should have shared your recommendations for moving forward. Make sure you make recommendations and there is an agreement about moving forward based on the customer survey findings. If you don't plan to take action in Step 1, then you should save yourself the time of conducting the customer research in the first place.

Any other survey research design tips? How have you used these steps to create a customer survey that improved processes in your organization?

Use Customer Service Feedback for Employee Assessments

Thursday, October 15, 2009 by Sherrie Mersdorf
Every organization should ask themselves What is good customer service? and create their own definition for good customer service based on the answer they come up with. Giving customers the opportunity to provide feedback on their customer experience is one way to improve customer service quality, but only if the customer feedback gets back to the employees. Lots of organizations use customer service surveys to measure customer experiences and customer loyalty. What separates the organizations with mediocre customer service from the organizations with excellent customer service is sharing the feedback from the customer loyalty surveys with the employees. Seems pretty straight forward, right?

I suggest you take it a step further, however. While sharing the aggregate results of customer feedback surveys with front-line employees is important, you can use these customer surveys as assessments of employee performance or staff evaluations. If you're not already using customer surveys to support this type of employee performance feedback, here are some steps from the CRMBuyer to make this type of process possible:

Move from random survey sampling to an attempted census. Random survey samples are great when you're just trying to get an overall sense of customer satisfaction rates. However, if you're trying to collect feedback to figure out how to improve employee performance, a random sample is unlikely to provide enough data for each employee. Like with all other types of surveys, not everyone you send personalized survey invitations to will participate, but you will likely get enough responses to support the employee assessments.

Develop new employee reports. To improve workforce performance, organizations can't continue to provide infrequent high-level survey reports. Instead, employees should get to see weekly reports. Using standardized reports that compare the employee to the overall average and to their colleagues as a group have the most impact.

Develop new management reports. Like with how employees see the customer feedback reports needs to change with this strategy, management reports do too. Managers should be able to see responses by employees so they can take appropriate action. Managers will have different opinions on how much information should be shared with their staff; some will want to share every customer comment from the employee performance evaluation form, others wont want to share individual survey results.

Develop HR guidelines for the use of these employee reports. The HR department should be deeply involved in the creation of these HR employee appraisal forms and employee survey reports. If an employee constantly receives negative customer feedback, the organization may choose to terminate their employment so it helps to keep HR in the loop. However, that shouldn't be the goal of this type of customer survey program. The survey feedback should be used to improve employee job performance and mentor them. With the help of customer service assessment surveys and employee performance review forms organizations can figure out how to improve customer service quality.

Survey Research Definitions: Reliability

Thursday, October 15, 2009 by Tyson Gingery
Consistent Bullseyes are Valid and ReliableAs is the case with validity, there are multiple aspects of reliability in survey research.  In general though, while validity refers to accuracy in question design, reliability refers to the consistency of your results (i.e. the probability of producing the same results after repeated measurements). 

One way to easily conceptualize reliability is to consider it as another word for precision.  Let’s use archery as an example: if you shoot ten arrows at the target and they all hit the same area, your shots can be said to be reliable or precise. 

You can test for and estimate the reliability of your survey questions in a variety of ways.  You could use a test-retest design, where you use the same questionnaire more than once to see if the results remain consistent.  You could also send your feedback form to different survey samples (consisting of similar respondents) and then compare your results for any fluctuations.  Also, if you create a set of customer service questions designed to provide you with a composite scale, you would want the individual questions to produce similar results if they are intended to measure a single concept (an overall customer service scale, for example). 

It is also important to understand the relationship between reliability and validity; results can be reliable without being valid.  If we use our archery example, the shots are reliable, but if they aren’t near the bullseye (an undesirable outcome!) they cannot be said to be valid.  Reliability is necessary for validity, but it is not sufficient alone.  You want to accomplish both objectives: shots that land near the bullseye consistently.  By creating reliable, valid questions for attitude surveys, online market research, employee reviews or public opinion polls, you can be confident that your results are not due to chance.

Difference Between Causation vs. Correlation in Survey Data

Friday, September 25, 2009 by Sherrie Mersdorf
Just because you find correlation in your data when analyzing survey results does not mean there is causation. I find this is a common mistake in lots of survey reports when someone is new to survey research or conducting data analysis. Take this example:

Your organization sells products and services in the business-to-business space. As part of your model, each organization has a customer success manager who is responsible for reaching out to clients and ensuring they're using the product appropriately and ensure they're satisfied customers so they continue to be customers. As a result, it's really important to continually measure customer satisfaction. To do this, you've purchased customer feedback software to conduct customer surveys.

You follow all the survey best practices and keep your survey short. Two survey questions that are always asked, for example, are:
 
How satisfied are you with our products?
How often does your customer success manager reach out to you?

When conducting the survey analysis of the survey responses, you find almost all clients who are contacted every few weeks are very satisfied, but clients who are rarely or never contacted are very dissatisfied.

Some people see this connection as a causation. Customers are satisfied because you contact them frequently to make sure everything is going well. The problem is, it's not a causation. Causation are extremely hard to prove because you cannot control every factor. For example, you may split your territory by industry and your solution suits some industries better than others. Or clients who are really satisfied simply use the product more often so the customer success managers reach out to them more frequently, because they are more likely to have questions. While those who use the product less have less to be satisfied about and may feel they are wasting those budget dollars.

To be able to prove causation, you need to be able to rule out all other possible explanations for the connection. As you can imagine, that's almost impossible to do since we do not control outside factors influencing the survey respondent or even the greater survey sample. Instead, when situations like these occur, we're seeing a correlation between two things. In my customer survey question examples, there's a correlation between how satisfied customers and how often they are contacted.

This principle does not only apply to customer survey research, it also applies to analyzing employee feedback forms, product surveys, market research and any other type of data collection and analysis.