Feedback Form

It is tempting to include many similar question types with similar response options in your online survey design.  Matrix questions, for example, provide an efficient questionnaire design method to help you gather lots of data in a neat, brief survey form.  It is wise, however, to resist the urge to use too many uniform survey questions and response lists, namely because of two sources of bias that stem from doing so: habituation and acquiescence.

Habituation occurs when respondents begin providing the same answers to survey questions with the same response options.  They start to get in a habit and select the identical response choice for every question.

Acquiescence is related to habituation, and occurs when respondents passively agree with an interviewer or survey questions.  Agree-disagree scales are the most often-used response options in opinion surveys; it is important that you take steps to avoid the chance that respondents will passively agree with your statements in order to quickly complete the questionnaire or provide what they think may be the “right” answers.

To avoid these response biases, you can use online survey software that allows question randomization, break up your matrix questions with other types of questions and scales, and phrase some questions in a manner that makes respondents switch their thinking.  An example of the latter would be to ask a series of positive questions in your survey questionnaire, and then throw in a couple questions worded differently so as not to allow habituation or acquiescence.  Use care up-front in your online questionnaire design to be sure that you'll reduce error and bias in your results.

Cvent offers a variety of Pre-Designed Survey Templates you can choose from for your first online web survey. These internet survey templates contain default questions, email, welcome and thank you text which you can utilize when designing a questionnaire. You can also choose from over 50 different graphical templates to suit the look and feel of your survey forms. Here’s a list of the different pre-created survey templates that you can use to build the base of your survey:


Besides this vast list of pre-designed questionnaires and graphical survey templates, Cvent also offers you a Question Library, which is filled with Customer Service, Demographics, Event, HR/Training, Marketing/Sales questions that you can utilize in your survey.

So! Go ahead and Sign up for an online web survey free trial account now and enjoy these á-la-carte features absolutely free.

Sometimes we get so excited about creating a survey we want to jump right in and ask the really interesting questions. Those typically consist of finding out about who our clients are, where they're located, etc. (factual questions). In other words, our demographic questions.

But if we don’t take the time to think about placement of these really important factual items within our surveys, we may be inadvertently affecting the results we see. By placing your demographic survey questions (name, gender, race/ethnicity, age, etc.) close to the end of the survey feedback form as opposed to right at the beginning, you are increasing the chances that respondents will fill out these items, leading to richer data collection and more useful results. Respondents are more likely to feel invested in your survey, and will understand why you are asking those personal questions if those sensitive items are placed after survey questions that address the purpose of your survey.

Check out these blog posts to get started with your demographic survey questions.

If you’ve ever looked at results from a public opinion survey or political poll, you’ve no doubt seen the margin or error noted alongside the findings.  Usually the note will read something like margin of error = plus or minus x%, CL 95%.

So what the heck does that mean?

Well, the first part basically tells you how close the results from your selected sample are compared to what you'd find if you surveyed the entire population.  The expression of “plus or minus x%” tells you that the percentages of given responses might be a bit higher or lower “in reality” (i.e., if you surveyed absolutely everyone).

Generalizability to the larger population is also described by an associated measure called a confidence level (CL). This term describes how confident you can be that your results are not due to chance alone.  A confidence level is normally set at either 90%, 95% or 99% (95% has become standard).

Let’s use an example to understand how these two concepts work:

A random sample of Americans were asked whether they preferred cake or ice cream for dessert.  The results showed that 60% preferred ice cream over cake, and 40% preferred cake over ice cream.  This question had a margin of error of +/- 3% at a 95% confidence level. What this means is that you can be 95% confident that the percentage of all Americans who prefer ice cream would fall between 57% and 63% (60 plus or minus 3).  Another way to put it would be as follows: if you conducted 100 surveys of the entire population, at least 95 times you would find that the percentage who preferred cake ranged from 37% to 43%.

Does your customer survey have "survivor bias"? I'm betting it does. Why? Because when most survey designers create business questionnaires or client satisfaction surveys we only collect feedback from individuals who are still customers. What about lost business? Why aren't those customers who left asked to complete your client feedback form? You better believe they have feedback.

In her post at the Dimensional Research blog, Customer Satisfaction Surveys: Avoid "Survivor Bias", Diane Hagglund defines "Survivor Bias" as drawing conclusions only from data that is available or convenient and thus systematically biasing your results. AKA biasing your survey sample by only asking "happy" customers. They may not be over the moon about your product, but they're at least happy enough with your offering if they're still paying you.

I agree with Diane on this one, it's pretty ridiculous to allow this bias to creep into your customer market research. It's easily avoided considering you should have all the customer data you need to send them the same client survey template. Make sure you're measuring client satisfaction among customers who left you for a competitor as well as those who simply decided not to renew the service (and didn't go with anyone else).

When you begin writing customer survey questions to create client questionnaires or update your annual template for a client satisfaction survey make sure you think about your former customers. If you don't know who they are, this is a good time to find out. Thank goodness for internet research software and customer insight solutions to make the act of surveying clients a little easier.

Increasing survey response rates is a major goal of most survey builders and market researchers. There's an art and a science to increasing campaign response rates whether it's an email marketing campaign or an online market research study. I wanted to share some of my tips for how to increase survey response rates:

• Make the email survey invitation from names easy to recognize. You can do this by including an individual's name within the organization that's well known (such as the CEO or if it's a client survey, the name of their sales rep). You can also use the organization's name, or both. For example, I'm subscribed to a few MarketingProf's newsletters. When they send out emails they include the same person's name and their organizations name so it looks like this: Anne, MarketingProfs. I recognize it everytime, and since I enjoy their newsletter, I made sure to open the email.

• Keep subject line's compelling, but short. The subject line and the From Name are the two most critical pieces to get your email opened. Try to keep your subject lines to 35 characters or less. You don't need to put the entire email in the subject line, but you do need to include enough information to make the recipients open the survey email.

• Create an attractive survey invitation. Studies have shown that well done HTML email messages get better response rates than plain text emails. With HTML you have the opportunity to include images, change font sizes, bold text, etc. Take advantage of this chance. It's one more way to get people to click through to your survey!

• Send personalized survey invitations. Personalizing your emails, even something as simple as including the recipient's name in the greeting, will return a higher response than a generic message. It creates a personal touch, and makes the recipient feel like someone took the time to send them a personal message (even though your email survey tool did it for you).

• Introduce the survey. Let the participants know why they should participate in your survey. If they don't understand why their opinion is important to your survey findings, why would they want to take the time to fill it out?

• How long will the survey take? Not setting expectations in the beginning for survey length leads to low response rates and high abandonment rates. Not what you want to see. If you don't let people know how long it will take to fill out your online survey, they're going to assume you're hiding something about how long it is. Tell them it will take X minutes or the survey is only Y questions long. Definitely be honest, if you lie here, you're going to hurt your future chances of getting those respondents to complete your next online survey questionnaire.

• Remind your survey sample that their responses will be kept confidential. This is particularly important for surveys about uncomfortable topics. For example, you created a poll for a public opinion survey to see how your population feels about an emotional topic such as abortion. If you don't keep the information confidential, you probably will not get honest feedback. Same thing goes with employee questionnaires, they should always be kept confidential and anonymous. Not keeping responses confidential will definitely hurt your response rate, as well as the validity of the data.

• Offer an incentive. Offering incentives is a proven method for increasing survey response rates. But this method doesn't work if you don't let people know about it up front. Put it in your email, put it on the welcome page of the survey, then make sure to follow up. Again, if you drop the ball here, the chances of that survey respondent completing your online survey form in the future is drastically reduced.

• Always say Thank You! Remember when your mom always made you write thank you notes when you got presents or cards from people for holidays and birthdays? It was because people like to feel their effort is noticed and appreciated. Same idea here, it's nice to just get a short note thanking them for their time. After all, survey respondents are doing you a favor.

• Don't over email your contact list. This is very important. You shouldn't be inviting the same people to complete your online surveys every month. It's important to segment your list using whichever survey sampling method that works best for your surveys to avoid email list fatigue. Make sure that you're coordinating with other campaigns as well. Just because you know they're different initiatives you're emailing about, your contact's wont necessarily see it that way. If you begin sending emails too frequently, contacts are going to just delete your email and never open it, opt out or report you as a spammer.

Have a tip that I missed? I'd love to hear it!

I was asked to complete a product market research survey today. The product survey asked me a series of questions about possible products related to improving my beer drinking experience. One of the many things I didn't like about this survey was they never asked me if I thought there was a problem.

For example, one of the possible products was for a different method of carrying beer. Unfortunately, I'm perfectly happy with my current method: keeping the beer in the package it comes in. The suggested product would make me move the bottles from their packaging to take them somewhere. I'm not interested in that extra step. Did they ask me why I wouldn't by the product? Nope. They only asked if I would.

Maybe for their survey research goals, that's all they cared about: Would I buy the product, Yes or No? Kelli mentioned in a post earlier today that it's important to gather product feedback on a smaller scale before launching a bigger market research study. The goal of this market research questionnaire easily could have been to identify which product ideas should be considered for further qualitative and quantitative research. Only products where more than 20% of survey respondents indicated they would be interested in purchasing will have more research around it.

On the other hand, I like to make sure my position is clear when completing attitude surveys. This is probably a respondent bias I bring to the table because I spend so much time sharing online survey best practices. I know that often survey questions are written in a way that doesn't always collect the data the survey creator wants. They just don't always write the right questions. So avoid being "mis-quoted" so to speak, I like to be able to answer a series of question about why I feel one way or another.

Believe me, there were a lot of poorly written survey questions in the feedback form, as well as other issues with their data collection method. I've found that where there is one serious problem with a survey template, there are others hidden as well. If you're worried your survey questionnaire may have problems, go ahead and ask our online survey Professional Services Group to take a look. We're always happy to help.

Looking for sample market research survey questions? Here are a few sample product survey questions you can use in your next product research survey:

How do you use 360 feedback surveys? Many people don't believe in doing 360 surveys, others will hang their hats on them. No matter how you slice it, there are some risks associated with conducting annonymouse 360 degree feedback surveys: Hurt feelings, burnt bridges, career retibution, etc. I think these are all fair. Even though giving and receiving feedback is important (and essential!), it's hard to not take comments personal. Many of us fail to really see the value of feedback and lack the introspective skills to apply this valuable perspective to our personal development.

So the real question is, how have you conducted 360 surveys in the past? Have they been successful? How did you use the data collected?

I think it's important to keep in mind that 360 degree feedback surveys are best used to begin the conversation. If it's not well managed, it can quickly take a turn for the worst and just become lots of negative rants. This isn't what you want. These feedback surveys should be used for development purposes, not to trash talk coworkers. Using these surveys to get the conversation started helps make the topics that society tells us are "no-nos" okay to talk about.

I'd love to hear your experiences with 360 degree surveys.

I recommend taking advantage of the technological power within good online survey software programs.  A great way to increase your survey response rates is to send reminder email survey invitations to your customers if they have haven't completed your questionnaire after receiving notification of selection for your surveys.

People are busy; email inboxes are bombarded with messages, alerts and spam.  Customers may delete your survey invitation email if they are in a hurry, trying to clean up their inboxes, or do not feel the feedback survey is relevant or interesting to them.  Often, people will receive a survey invitation and look through it, but not follow-through in clicking though to the survey questionnaire to complete the actual online survey poll.  They may even have made a mental note to complete the survey later, but then it gets lost in the shuffle.

You can take steps to reduce both these nonresponse problems by sending personalized email survey reminders.  If a respondent or customer contact does not respond to your online questionnaire within a given time frame (that you specify), you can program your online survey software to automatically resend survey invitations (multiple times!).  You set up the invitations, so you can choose to resend the original invitation or tweak it with a different message to remind them they have yet to complete the survey.

In your reminders, let respondents know that they previously received an invitation from you because their opinions are valuable, and they were selected as part of your survey sample for a good reason.  Restate the incentive if you're offering one. 

As we all know, however, there is a delicate line between reminding and nagging.  If you drift toward the latter, chances are your respondents will become annoyed and reactively delete emails from you (surveys or otherwise).  In general, send a maximum of three or four survey emails to your respondents after they’ve received the original invitation and survey poll link.  If they've deleted or lost your previous emails, they may respond to one of the reminders, and who knows… even if they’re ambivalent toward completing your internet survey, you might catch them at a better time and get a completion.

A recent article in Meetings & Conventions Magazine caught my attention this month: Survey Science, How to Craft more Effective Attendee Evaluations. Meeting planners are usually not survey experts, their expertise lay in planning and executing events, not crafting flawless survey research questionnaires. However, in the last year the value of meetings and events have been called into question after bad press surrounding some organizations' meeting practices. With meeting and event planners having to increasingly prove the values of meetings and measuring meeting results, being able to create event surveys to gather attendee feedback has become even more important.

While we've discussed several of these survey best practices in the past in reference to sample staff survey questions or customer feedback forms it never hurts to review them again. Here are the first five online survey tips from the article:

1. Set survey goals first. This shouldn't be a big surprise. On Friday I wrote about how to create a customer survey, and setting customer satisfaction survey objectives was the first step there too. If you don't figure out what your objectives are in the beginning, writing meaningful survey questions will be a lot harder later on. For example, if the survey objective is to figure out how to improve the event next year, only ask questions about things you can change for future events. It doesn't make sense to evaluate the location if you've already booked the same venue for next year; if you haven't booked next year's location, asking about the venue makes sense.

2. Write survey questions that are clear and ask what you really want to ask. Articulating a question to really collect the feedback you're looking for can be quite a challenge. Take these sample conference survey questions, if the planner wants to identify which sessions would be best to add to next year's lineup (assuming attendees must pay to attend the sessions):

If you've been paying attention to survey best practices, you'll know the third one is the wording you want. Why? Because it's the only one that explains the attendees will have to pay for the sessions. It's not a matter of which sessions sound interesting, it's a matter of which sessions present enough value to be worth the cost.

3. Find out why they're dissatisfied. It's not enough to know that an attendee was dissatisfied with the registration process. Planners should provide attendees with the chance to explain why they are dissatisfied - maybe it was a technical problem or there wasn't enough event staff to mitigate issues.

4. Keep it short. General survey best practices suggest keeping your online survey as short as possible. The best methods for making sure you're keeping it short is to only ask questions that have a direct link to your seminar survey objectives. The second method is to make sure you're using survey question logic, such as branch and skip logic. This allows you to keep the survey relevant to the respondent and only ask questions that make sense. We hinted at this in a recent post where we talked about using one survey to gather event feedback for all the sessions at your event.

5. Think about the survey's organization. When designing questionnaires it's important to keep the flow of the survey in mind. Start with general questions and work your way to the more specific questions. The survey should only focus on one topic at a time. In the example of multiple event sessions, it doesn't make sense to mix up the session questions. Instead, ask all the questions you have about one session, then move on to the next session.

In the next few days, I'll share the other 10 survey tips from the Meetings & Conventions article. As a meeting or event planner, how have you found pre- and post-event surveys helpful in planning events?

Have a question? We're here to help! Here at Cvent we're always trying to help people improve their survey projects. Whether you're trying to write new employee feedback survey questions, create a customer service performance reviews or simply get a better understanding of how our online survey research software and enterprise feedback management solution works, we're happy to answer your questions!

To make it easy to get all your survey questions answered, we've added a chat to our blog. Someone will be happy to answer your questions during normal business hours (9am - 6pm ET). So go ahead, click to chat and ask our experts your questions about employee feedback software, data collection methods, customer survey questions, or any other survey questionnaire related question!

Many people ask the question How do I create a customer survey? The basic steps are the same no matter what type of client survey you're writing: customer satisfaction, global market research, product development surveys, etc.

Step 1: Sit down and figure out what the goal of the survey is. Are you trying to identify upsell opportunities? Want to discover features missing from your current product? Figuring out if it's a good idea to take your marketing overseas and attack a global market? In the very beginning of the survey planning process, you should know what it is you want to get out of the consumer survey. If you don't have a firm customer satisfaction survey objectives in the beginning, while you go through the other steps such as writing survey questions or selecting the best survey software, you're going to stray from the path. If you stray from the path, you may find the final survey results are not as helpful as you had hoped.

Step 2: Decide on a research methodology. Your goals should help you on this step as well. You need to first decide if you're planning to do qualitative or quantitative research. From there narrow the scope further, if you want to do qualitative research are you interested in focus groups, advisory boards, one-on-one interviews? With quantitative research you may decide on comment cards, feedback forms and surveys. Is your survey method going to be online, telephone-based or paper questionnaires?

Step 3: Survey Design. I'm making the assumption since you're reading a survey blog about how to create customer surveys, you're not interested in the other market research methods right now so I'm going to focus on the process of building customer surveys. Once you've gotten through the first two steps, you're ready to start writing survey questions (Finally! I bet you thought this would be the first step!). Customer satisfaction survey design can be the biggest challenge. Luckily, there is survey designing software to help you step through this. Survey software tools often have templates and question libraries to help you write good survey questions.

Step 4: Data collection. Okay, you've picked your customer survey methodology, created a client survey and you're ready to field your survey (or use the data collection tool in your survey application to collect responses). Exactly what you do in this step will depend on what type of survey you decided to collected: telephone, paper, online. One way to get survey responses is to use email marketing tools to send personalized email surveys. You can also share the link on your website, social media sites, invoices, etc.

Step 5: Analyze customer feedback. Analyzing survey data is one of people's least favorite parts of the surveying process. We have some tips for how to analyze survey data here. Don't be afraid of this step. You need to conduct the survey customer analysis to achieve your goal. It's what you set out to do, so keep your chin up. You're only a step away from the final product (and once you choose survey analysis methods you should be almost finished).

Step 6: Share the survey findings. This is what you set out to do. Get answers to your customer questions. Take the customer feedback analysis you completed in the last step and format it. You're creating a survey report you can share within your organization (and maybe with others outside of your organization). If you need tips for creating survey reports or an example survey report, you can read more about them here.

Step 6.1: Take action. This is still part of step 6, but it's important enough it should be broken out. In your customer analysis survey report, you should have shared your recommendations for moving forward. Make sure you make recommendations and there is an agreement about moving forward based on the customer survey findings. If you don't plan to take action in Step 1, then you should save yourself the time of conducting the customer research in the first place.

Any other survey research design tips? How have you used these steps to create a customer survey that improved processes in your organization?

Every organization should ask themselves What is good customer service? and create their own definition for good customer service based on the answer they come up with. Giving customers the opportunity to provide feedback on their customer experience is one way to improve customer service quality, but only if the customer feedback gets back to the employees. Lots of organizations use customer service surveys to measure customer experiences and customer loyalty. What separates the organizations with mediocre customer service from the organizations with excellent customer service is sharing the feedback from the customer loyalty surveys with the employees. Seems pretty straight forward, right?

I suggest you take it a step further, however. While sharing the aggregate results of customer feedback surveys with front-line employees is important, you can use these customer surveys as assessments of employee performance or staff evaluations. If you're not already using customer surveys to support this type of employee performance feedback, here are some steps from the CRMBuyer to make this type of process possible:

• Move from random survey sampling to an attempted census. Random survey samples are great when you're just trying to get an overall sense of customer satisfaction rates. However, if you're trying to collect feedback to figure out how to improve employee performance, a random sample is unlikely to provide enough data for each employee. Like with all other types of surveys, not everyone you send personalized survey invitations to will participate, but you will likely get enough responses to support the employee assessments.

• Develop new employee reports. To improve workforce performance, organizations can't continue to provide infrequent high-level survey reports. Instead, employees should get to see weekly reports. Using standardized reports that compare the employee to the overall average and to their colleagues as a group have the most impact.

• Develop new management reports. Like with how employees see the customer feedback reports needs to change with this strategy, management reports do too. Managers should be able to see responses by employees so they can take appropriate action. Managers will have different opinions on how much information should be shared with their staff; some will want to share every customer comment from the employee performance evaluation form, others wont want to share individual survey results.

• Develop HR guidelines for the use of these employee reports. The HR department should be deeply involved in the creation of these HR employee appraisal forms and employee survey reports. If an employee constantly receives negative customer feedback, the organization may choose to terminate their employment so it helps to keep HR in the loop. However, that shouldn't be the goal of this type of customer survey program. The survey feedback should be used to improve employee job performance and mentor them. With the help of customer service assessment surveys and employee performance review forms organizations can figure out how to improve customer service quality.

As is the case with validity, there are multiple aspects of reliability in survey research.  In general though, while validity refers to accuracy in question design, reliability refers to the consistency of your results (i.e. the probability of producing the same results after repeated measurements). 

One way to easily conceptualize reliability is to consider it as another word for precision.  Let’s use archery as an example: if you shoot ten arrows at the target and they all hit the same area, your shots can be said to be reliable or precise. 

You can test for and estimate the reliability of your survey questions in a variety of ways.  You could use a test-retest design, where you use the same questionnaire more than once to see if the results remain consistent.  You could also send your feedback form to different survey samples (consisting of similar respondents) and then compare your results for any fluctuations.  Also, if you create a set of customer service questions designed to provide you with a composite scale, you would want the individual questions to produce similar results if they are intended to measure a single concept (an overall customer service scale, for example). 

It is also important to understand the relationship between reliability and validity; results can be reliable without being valid.  If we use our archery example, the shots are reliable, but if they aren’t near the bullseye (an undesirable outcome!) they cannot be said to be valid.  Reliability is necessary for validity, but it is not sufficient alone.  You want to accomplish both objectives: shots that land near the bullseye consistently.  By creating reliable, valid questions for attitude surveys, online market research, employee reviews or public opinion polls, you can be confident that your results are not due to chance.

You should take great care to avoid using leading questions and loaded words when you design survey questions.  These two faulty sample survey designs can do more harm than any other possible hazards during the survey creation process.  They can bias respondents’ views (and hence their answers) to the point of making your data unusable.

Leading questions bias respondents by subtly directing them toward particular answers.  These items usually provide judgments about ideas or concepts before the actual questions are asked -- or the wording of the questions may just be biased from the outset.  Leading questions can make respondents feel as if there is an obviously "correct" response, and that they would be foolish to answer otherwise.

Loaded words are those which carry overtones or connotations that predispose a survey respondent to think in a certain way.  If researchers use overly strong words (positive or negative), or use labels with clearly judgmental implications, this can bias respondents by priming them for certain mindsets.  Consider the following example of a leading question filled with loaded words:


We can easily tell that the purpose of this "question" is to bias respondents into saying they would not pay eight bucks for a burrito.  There is a clearly derogatory sentiment contained in the question itself (leading).  And with the inclusion of phrases such as most people feel, way too much, and simple burrito, respondents would have to be irrational fools to admit they might pony-up the $8.00 (loaded).

This of course is an extreme example, but if you’ve been selected for a political poll, you know that there are agenda-based questions out there that are almost as egregious.  When writing survey questions remember: your results are usually only as good as your questions!  By avoiding leading questions and loaded words, you can be more certain that your questionnaire results will accurately represent the views of you customers, employees or public opinion survey samples.

A new public opinion poll was commissioned by SCHOTT Solar and Solar Energy Industries Association (SEIA) for the annual SCHOTT Solar Barometer Survey. The attitude survey found 92% of Americans think developing and using solar energy is important for the United States. With all the political debates going on in Washington, this does not rank among them. Survey responses were consistent across all political affiliations and ideologies. 77% of survey respondents indicated they think the development of renewable energy sources should be a major priority for the federal government, this includes providing financial support when needed. The most favored renewable energy source is solar (44%), followed by wind (17%), natural gas (12%) and nuclear (10%).

The private sector sees the possibilities in the solar space as well. They aren't waiting for a web survey to tell them. According to Cleantech Group, the "cleantech sector" has grown almost 25% over the last 5 years. Just in the last quarter, solar was the leading sector. There is still plenty of room for growth in this area though. The SCHOTT survey found that almost half (49%) of the survey sample are currently thinking about solar power options for their home or business. This is a big opportunity for organizations looking to develop solar energy solutions.

One think I always tell you to look for is the survey methodology used to collect the data and draw conclusions. According to the SEIA press release, a third party market research firm conducted the online survey between August 31 - September 8, 2009. Email survey invitations were used to solicit survey responses to the online market research survey. Due to the quantitative market research method, the survey results are 95% accurate within plus or minus 3.1 percentage points.

You want your employee performance surveys, public opinion polls, and online market survey studies to produce valid data.  But what does validity mean exactly in the field of survey research?  Although there are actually many different types of validity, in general, designing valid survey instruments means that survey questions adequately measure (in reality) the concepts the researcher is attempting to measure.  As opposed to reliability, which refers to producing the same results with repeated measurements, validity involves designing legitimate, suitable survey questions that accurately address the ideas you’re seeking to evaluate. 

Survey researchers try to attain high levels of external and internal validity. External validity is the degree to which your study’s results are generalizable to individuals other than those in your survey sample.  If your results are externally valid, you can come to increasingly accurate conclusions regarding larger and different populations (people/markets across various time periods, geographical locations, etc.).  Obtaining external validity is a major goal of survey and market researchers, because most research is performed using a small sample of people from a larger population or target market in order to decrease costs and lessen workloads.

Internal validity, on the other hand, centers around estimating how valid your measures are based on an inward look at the research design and any other variables that might interfere with accurate results and conclusions.  To increase internal validity, survey researchers often like to implement experimental designs, as well as perform statistical analyses that control for variable effects.  Examining any additional measures and proposing alternative explanations for results both go a long way in judging the validity of any survey research project.

The first part of this two-part series outlined how to write survey questions that are relevant to your audience in order to design good surveys.  This post will provide the rationale for asking questions to a competent survey sample, and how doing so reduces error and increases the validity of your survey results.

In general, when employees, customers and other types of respondents receive online consumer research or opinion surveys, they believe it is for a logical reason.  They are usually selected because they are employees with insight about a certain company, have previously used particular products and services, provided contact information to you (such as an e-mail address), or are believed to possess other information and/or opinions that are valued by researchers and organizations at large. 

Because of this, respondents naturally feel they should "know the answers" to your market research questions (i.e. they are competent regarding the concepts covered in the survey).  In fact, if your survey respondents come across a question that confuses them, or one that they do not know the answer to, many will select a response regardless of whether it accurately reflects their behaviors or opinions.  To design surveys that can reduce this possible source of error, you should attempt to include questions about which your survey sample is knowledgeable and able to answer. 

You know your customers and survey population best; asking them client survey questions for which they are unqualified to answer can not only confuse respondents, but may cause you to end up with bad data.  Design survey questions that are appropriate for your target market - this means your questions are both relevant to your audience, and that your audience is adequately informed about the concepts addressed in your feedback form.

A year ago, the Cvent Web Surveys Blog posted it's first post. Over the past year, we've shared many survey best practices with you that can be applied to online surveys and paper questionnaires alike. Here's a list of some of our most popular posts:

• Tips For Providing Survey Incentives: We get asked all the time about incentives and their place in survey research. There are arguements for and against offering survey incentives. This post isn't about those sides. Instead, it focuses on tips for offering survey incentives if that's the path you choose to go down.

• Offering An Additional Comment Section Is An Online Survey Must: Simply asking for customer or employee feedback implies you're ready to make changes, you want to identify problems and fix them. If you fail to offer a "last ditch effort" with and additional comments (optional) question type, you could be making a huge mistake. Depending on your survey design, it may be the only place a survey respondent can give you truly honest, unprompted feedback.

• Survey Question Flow Impacts Survey Findings: Question order is an important part of good survey design. Whether it's a paper survey on customer satisfaction or an online questionnaire to gather employee feedback, how you order your survey questions could impact your survey findings.

• Survey Report Tips: Writing the Executive Summary or Setting the Stage: When writing a survey report, you can't just launch into the survey responses and the data collection results. You need to provide the report reader with some general background information about the survey project including why you ran the survey, what the goals were, what the data collection methods were. Then you can summarize the results and make recommendations.

• Five Steps to Begin Interpreting Online Survey Results: The hardest part of any survey project is creating the questionnaire. If you design a good survey and plan the analysis, interpreting the data should be a walk in the park. Make sure to review these five easy steps for analyzing survey data.

• Analyze Open-Ended Questions Faster with a Quick Trick: We all know using closed questions are easier to analyze. But sometimes they just don't cut it. This post gives you a quick six step process for how to analyze survey data quickly to summarize survey responses without spending days on the survey analysis.

• Difference Between Causation vs. Correlation in Survey Data: To be able to prove causation, you need to be able to rule out all other possible explanations for the connection. This post aims to debunk the myth that correlations found in survey data means that one thing caused the other.

• What To Look For When You Move Your Online Survey To Test Mode: It's definitely an online survey best practice to move your web survey to test mode before sending it out to your survey sample. Make sure to use this 7 step checklist to avoid any online survey pitfalls.

• Market Research Process: 6 Steps to Project Success: When working on survey research projects - be it a customer satisfaction survey or product development survey or a staff performance review form - you should always follow this six step process to make sure you get the maximum return on investment from your survey project.

• Online Survey Question Pitfalls—And How to Avoid Them: This post points out common online survey pitfalls that are in surveys all the time. However, identifying problems with your work performance assessment or customer feedback questions is only half the battle.

While many organizations are continuously focused on cutting costs, it becomes ever more important during a tight economy. While expensive consultants can do a great job at finding these bottleneck areas, there may be a more economic recession friendly way to cut costs: just ask your employees.

Employees tend to be the largest expense an organization faces and, believe me, they know it. They may be "expensive", but they're worth it. Your workforce is the DNA of your organization, which is why they are the first people to know where minor costs can be eliminated. By asking for employee feedback and suggestions of areas to eliminate expenses, you are identifying expenses that wont affect their productivity. For example, you may offer employees complimentary snacks and beverages to keep them going through that afternoon hunger. However, an employee opinion survey may show employees think the organization should cut out the snacks in an effort to cut costs. It wouldn't be what you expect, but it's certainly a real-life example.

So the next time you're trying to cut costs due to a shrinking budget, survey your employees. You may just find out that the cookies and soda aren't as important to them as keeping their job.