Internet Survey

Survey Research Definitions: Habituation and Acquiescence

Friday, November 6, 2009 by Tyson Gingery
It is tempting to include many similar question types with similar response options in your online survey design.  Matrix questions, for example, provide an efficient questionnaire design method to help you gather lots of data in a neat, brief survey form.  It is wise, however, to resist the urge to use too many uniform survey questions and response lists, namely because of two sources of bias that stem from doing so: habituation and acquiescence.

Habituation occurs when respondents begin providing the same answers to survey questions with the same response options.  They start to get in a habit and select the identical response choice for every question.

Acquiescence is related to habituation, and occurs when respondents passively agree with an interviewer or survey questions.  Agree-disagree scales are the most often-used response options in opinion surveys; it is important that you take steps to avoid the chance that respondents will passively agree with your statements in order to quickly complete the questionnaire or provide what they think may be the “right” answers.

To avoid these response biases, you can use online survey software that allows question randomization, break up your matrix questions with other types of questions and scales, and phrase some questions in a manner that makes respondents switch their thinking.  An example of the latter would be to ask a series of positive questions in your survey questionnaire, and then throw in a couple questions worded differently so as not to allow habituation or acquiescence.  Use care up-front in your online questionnaire design to be sure that you'll reduce error and bias in your results.

Survey Logic: The Importance of Planning Ahead

Friday, November 6, 2009 by Caitlin Rawles
I think I have always thought of myself as a "planner." While some people "fly by the seat of their pants," I am constantly thinking ahead to the consequences of my actions. The way I see it, this can be a good thing and a bad thing. Being a "planner" is bad because I am not as spontaneous as some of my friends. The "life of the party" is usually not someone who thinks ahead. However, it is a good thing at the same time, especially when operating in the corporate world, and specifically when designing online surveys.

I wrote a post a couple weeks ago about the importance of thinking ahead to reporting before designing a questionnaire online. I want to address a related issue: survey question logic. We on the Cvent Web Surveys Client Services team always strongly encourage our clients to use survey logic to their advantage. Lately, however, I have been getting lots of calls from clients who are having trouble with the logic they have applied. The reason for this is simple: too many clients do not plan or map out the logic they'll apply to their electronic survey. This lack of planning can cause numerous problems, most notably conflicting survey logic.

In the past two weeks, I have spoken with two clients who applied both branch logic and advanced logic to their online surveys. Both of these clients called because they were concerned there was a technical issue which was prohibiting the logic from functioning as it should. "But, I set up my branch logic correctly, and I know that my advanced logic should be working fine too, so what is wrong?" In both cases, the problem was the clients had applied branch logic which conflicted with the advanced logic, and the survey system therefore did not know where to send survey respondents when they answered a question a particular way. "If only these clients had planned ahead and mapped out the survey logic before launching their surveys," I thought, "then this problem could have been avoided."

Moral of the story: Please take advantage of the wonderful survey logic functionality available with Cvent Web Surveys software. However, at the same time, make sure to plan ahead. Even if you are someone who generally "flies by the seat of your pants," when designing online survey questionnaires, you should be a "planner" for once.

Quick Reminders for Using Online Surveys

Friday, November 6, 2009 by Kelli Kelley
In the past several years, many market researchers have shifted to using online surveys more frequently. Traditionally, these online surveys were emailed rather than posted online to avoid data skewing.

When creating the online survey design, there are several things to consider. Make sure the electronic survey is simple and easy to use. Too often, online survey forms are cumbersome or technologically dated. Keep it simple, and you won’t run into any problems.

You must also plan carefully to make sure no questions are missed. You can design online surveys so they will not allow survey respondent to move on if mandatory questions are not completed. In addition to requiring survey questions, I would advise setting up the internet survey so respondents cannot complete the questionnaire more than once. Most online survey research software applications have features to create limits on how many times someone can fill out an online survey form. This prevents skewed data – some respondents will try to complete online survey forms multiple times if there is a giveaway or drawing offered as an incentive.

Make sure you read over your electronic survey a few times as well. Proofreading is especially important when designing online surveys. You must have members of your team proofread not only for grammar and clarity, but also functionality. Make sure all the links work, and the survey can be completed with all your caveats and mandatory questions. 

Online surveys have made it possible to gather information much quicker, and when used properly provide an excellent resource for market researchers.

Designing Surveys: Getting the Creative Gears Moving

Friday, November 6, 2009 by Matt Michels
All too often, we begin the survey creation process, but draw a blank.  How should we design a survey?  Should a survey design have the company look and feel?  Or should we design it to be a fresh look?

Having an online surveys tool that has survey templates built into the system is extremely important.  It eliminates the nagging question, "What is a survey design? How do I create a professional looking web 2.0 survey?"  This gives the survey builder that boost to get the creative juices flowing. In the Cvent Web Survey solution, there are over 50 graphical templates, ready to help you in designing surveys. Any color, any pattern, any style. They are all preloaded in the Cvent Web Surveys application. Definitely check these out the next time you are trying to figure out survey research design ideas for your next questionnaire.

Want to learn more about our survey design software? Sign up for a product demonstration.

What is a Survey?

Friday, November 6, 2009 by Sherrie Mersdorf
What is a Survey?Rarely are we asked the question, What is a survey? Typically questions follow the path of, Why do I need a survey program? What am I going to get out of conducting online web surveys to collect customer feedback? Or How do I get started measuring employee satisfaction with online questionnaire templates?

However, sometimes it's good to define market research and what it means, and answer the rarely asked question, What is a survey?

Market Research Definition (mahr-kit-ree-surch)
The gathering and studying of data relating to consumer preferences, purchasing power, etc., especially prior to introducing a product on the market.

Survey Definition (ser-vey)
Collect quantitative information about items in a population. Surveys of human populations and institutions are common in political polling and government, health, social science and marketing research.

Chances are though, you're still wondering about those other questions. These posts may help you answer those ever burning questions about why you should create and design surveys.

Use Cvent to Clone your Surveys

Friday, November 6, 2009 by Ashton Motwani
Yes, you read right; we’re not talking about cloning people. But wouldn’t it be awesome if you could clone your electronic surveys? The advantages are endless. If you have an internet survey that has to be sent out to people who attended different conferences on different dates, the headers and welcome pages would be different – as would the responses coming in, but the questions and emails would be almost exactly the same. Or if there’s an old online survey, closed and archived years ago, but you’ve realized you need to send it out again – clone it!

The best part about cloning surveys is that you can still make changes to them – so if you were designing surveys with similar content for five different groups of people, you could create a basic survey with all the questions, headers, templates, security settings, etc. and make minor changes to each of them so that each group gets a customized online web survey, but you only spend a fifth of the time.

When you clone a survey form, all information except the people added to its targeted list, gets carried over. So the next time you spend hours adding complicated branch and pipe survey question logic to an online questionnaire, worrying all the time that you will have to do it again and again, you can breathe a little easy. You always have the option to clone a survey irrespective of whether it’s in Test mode, Active, Closed or even Archived. Once you’ve done the work, you will never have to do it again.

So go ahead and clone your next survey – send it out to different people, generate different reports for each of them – you can even have one as anonymous and the other collecting contact information from respondents. As for cloning people, that debate will rage on.

New to Survey Design? Use Pre-Created Survey Templates

Thursday, November 5, 2009 by Lisa Boruah
Cvent offers a variety of Pre-Designed Survey Templates you can choose from for your first online web survey. These internet survey templates contain default questions, email, welcome and thank you text which you can utilize when designing a questionnaire. You can also choose from over 50 different graphical templates to suit the look and feel of your survey forms. Here’s a list of the different pre-created survey templates that you can use to build the base of your survey:

Advertisement Evaluation
Association Member Survey
Blank Survey
Buying Experience Survey
Company Evaluation
Customer Satisfaction Questionnaire
Customer Service Satisfaction Survey
Demographic Survey
Employee Benefits Survey
Employee Exit Interview
Employee Satisfaction Questionnaire
Internet Behavior Survey
Post-Event Survey
Pre-Event Survey
Product Feedback Survey
Senior Management Evaluation
Training Evaluation

Besides this vast list of pre-designed questionnaires and graphical survey templates, Cvent also offers you a Question Library, which is filled with Customer Service, Demographics, Event, HR/Training, Marketing/Sales questions that you can utilize in your survey.

So! Go ahead and Sign up for an online web survey free trial account now and enjoy these á-la-carte features absolutely free.

Cvent Online Survey Best Practices: The Recipe for Perfect Surveys

Thursday, November 5, 2009 by Andrew Upadhyaya
Cvent provides you simple survey tips as best practices that you can follow while working on your electronic survey project to ensure that the project is flawless. Mentioned below are some survey form best practice tips that will help you achieve this.

Anonymous Survey: If you are creating an anonymous survey, please carefully consider the fact that you will not be able to link the responses that you collect to any of the respondents on your targeted list. As soon as a respondent clicks on a link in your online survey email, that person is removed from your targeted list and all of his or her contact information is removed as well. When you run survey reports for an anonymous survey form, the respondents will be identified by unique response numbers that are not linked to any respondent contact information. Respondent contact information is removed from the response for a particular anonymous survey, however it remains in your Cvent address book.

Removing Identity Confirmation Page: You can also create a collect respondent contact information survey and hide the identity confirmation page from your respondents so that the survey appears anonymous to your online survey respondents. However, for this functionality to work in your electronic survey, respondents must access the survey via a link in an email survey invitation. If the respondents are coming through the generic website link, they must go through the identity confirmation page, as there is no way to know who is responding.

Brand your company: As a valued Cvent Customer, we have activated the custom header feature in your account for a custom online survey design. Please take advantage of your ability to customize the headers on your welcome page and survey body pages to include your own images, banners and logos.

Be clear about privacy protections: People are more comfortable sharing information on the internet if they know how it will be used. The welcome page or the first page of the survey is the place to include information about how you will be using people's survey responses. Are they anonymous? Confidential? Shared with others? A university human subjects statement, if needed, would go here.

Use Page Breaks: We recommend putting a maximum of 5-6 questions on each survey page in order to keep the page lengths short. Not only does keeping each page short help reduce the likelihood that a respondent will time out, but adding page breaks helps you to collect partial responses. Anytime a respondent clicks on a "Next" button, the responses entered previous to that button are saved. This ensures that any respondents who exit the online web survey before hitting the "Finish" button will be able to go back in and answer the remainder of the questions to complete the survey.

Progress Indicator Bar: Use a progress indicator bar to allow your respondents to see where they are in the survey and to inform them when they have completed the survey.

Survey Logic: Where possible, drill down for more information. The logic in the Cvent Web Surveys system makes this very easy to do. If someone selects a negative answer choice, add a sub question to probe them for details. Use branch logic to create paths within your survey that are only applicable to one group of respondents. Pipe logic allows you to personalize your survey by pulling an answer from a previous question into the question text of a follow-up question. Lastly, advanced survey question logic can be used to make a question visible to a respondent when specific criteria are met. These criteria can be based on respondent contact information, custom contact fields, or questions in the survey. When you are applying advanced logic, you can also turn on link logic, so that respondents only see certain answer options for one question, depending on how they responded to a previous question in the survey.

Have your respondents market your survey: Activate the survey invitation forwarding feature to allow your online survey respondents send an email invitation to friends or colleagues at the completion of the survey. The contact information collected will be automatically added to your address book for future surveys.

From Name in the emails: Always use a recognizable From Name in your emails as this drives your respondents to open the email. This is very important because without opening the email, your respondents will not be able to take the survey.

Use Multiple Email Campaigns: Send targeted email marketing messages to your audience in order to help increase survey response rates. Within one survey, you can send out different messages to different groups of people by segmenting your invitee list. This functionality allows you to specify the From Name, From Email Address, Subject Line of the email, and body of the email. Take advantage of this functionality and manipulate these variables in order to increase the open rate of your survey emails and your response rates.

We often get asked, "What is a good survey design?" All of these survey best practice tips are components to keep in mind when designing a questionnaire to ensure quality survey data. Watch out for more tips coming soon...

Survey Basics: Types of Survey Designs

Thursday, November 5, 2009 by Tyson Gingery
The vast majority of survey research projects are studies at a single point in time of a specified population, such as employees, customers or the general public.  Fewer web survey designs track opinions over time.  This post outlines the different types of surveys carried out by researchers.

Point-in-time surveys are called cross-sectional studies.  They study a single population or sample size during a single specified time-frame, and give us a “snapshot” of opinion data.  Cross-sectional surveys comprise the largest number of projects that are undertaken. 

Longitudinal surveys
, on the other hand, are those which study trends over time, and usually consist of cohorts or panel respondents.  These can be further classified into three distinct types of longitudinal designs (trend, cohort and panel).

Trend studies focus on the same population of people use opinion poll surveys to look at their attitudes over time.  While the population is always the same, trend studies usually select different market research survey samples from that population.

Cohort research is a method in which a specific population is studied repeatedly as well, but these studies center around how given groups with a common characteristic view social phenomena over time.  A common cohort design uses a class of students as its population.  For example, the freshman class of 2008 would be given a survey, and then the freshman class of 2009 at the same school would be given the same survey, and any differences in opinion would be noted.

Panel studies utilize the same sample from the same population over time.  While more complicated and difficult to carry out, this is the best design to truly find out changes over time, because you are tracking opinions of the exact same respondents repeatedly.

Survey Design: Do Colors Matter? Part III

Wednesday, November 4, 2009 by Sherrie Mersdorf
This week I've shared what different colors mean and how they can effect people. The neutral color group is the last of the three groups, cool and warm colors being the other two.

Neutral Colors are good background colors because they unify diverse color palettes. When neutral colors are paired with warm or cool colors, they allow the focus to be on the other color (whether it's warm or cool). They also serve to tone down the intensity of the other color. As I've mentioned in the other two posts, neutral colors do have attributes of warm and cool colors. Blacks, browns, tans, golds and beige are considered warm. Cool neutral colors include white, ivory, silver and gray. As you might guess though, these attributes are much more subtle than those of reds (the hottest color) and blue (the coolest).

Black Black - As we've discussed with other colors, black can have contradicting meanings. While black is conservative, conventional and serious it can also be sophisticated, mysterious and sexy. Black, like many of the neutral colors, match almost every color. The colors black doesn't match well with is other very dark colors.
White
White - White represents purity, cleanliness and innocence. Like black, white goes well with most colors. Keep in mind that too much bright white can cause some people headaches and be a bit "blinding." For the most part, the colors paired with white, no matter the proportions, are often the ones that pass on meanings in your survey design.
Gray - This is a neutral color, but it also has cool elements and rarely evokes strong emotions. Dark, charcoal grays show strength and mystery, similar to black. Gray is a sophisticated color, without the negative connotations of black. Grays are good background colors because they're so neutral. You can swap a light gray for white, or a darker gray for black.
Silver
Silver - Silver can be cool like a gray, but it can also be livelier than a gray. Silver is often associated with being sleek and modern and imparts an ornate feel. Silver is a cool metal and lack the warm that gold has. When you use silver, it can give an earthy, natural, or sleek and elegant feel.
Brown Brown - Earthy. Wholesome. Dependable. Brown is a warm color that can be associated with all of these things, as well as being considered steadfast, simple and friendly. Not sure that brown represents dependability? What about UPS? They've built their whole brand around brown's dependability. Browns, taupes, beiges and creams all are excellent background colors because they make the other colors appear richer and brighter.
Beige Beige - Like a chameleon, beige takes on the attributes of the colors that accompanies it. However, on it's own, beige is a calm background color. The reason beige can behave like a warm or cool color is because it has the warmth of a brown and the coolness of white.

If you're using the Cvent Web Surveys software application, you'll notice all our pre-created survey templates take into account how colors interact with each other. So next time you're working on a world class customer service survey or creating web polls, check out the graphical survey templates in your online survey account.

Respondents Aren’t Finishing My Online Survey... Help!: A Case Study

Tuesday, November 3, 2009 by Dorian Rosen
Don't show survey respondents something new and fun when you're tyring to get them to complet the surveyPartial responses are an unavoidable caveat of online surveys.  There are no moderators to ensure the survey respondent completes the web survey in its entirety and there are, generally speaking, no punishments or consequences should a respondent exit the survey early.  Add in the ever decreasing human attention span, and we have quite an obstacle to overcome to ensure your survey gets the most complete and most accurate responses

This was exactly the issue facing one of our clients.  Their survey was a decent length, only about 30 single choice questions, and the contacts on the target list were all product users.  So when they called in about the substantial number of partial and visited responses, I will admit I was a bit baffled.  Hey, it happens

I asked whether people had sent in messages about possible error messages when they tried to continue on to the next page or submit their responses; nothing. I checked their emails to ascertain whether any information in the messages was discouraging people from finishing the survey or telling them to return at a later date to complete; again, nothing.  It wasn’t until I previewed the survey to test whether there was any bug preventing the collection of responses that I noticed something: a hyperlink.  In the middle of the survey body.  It was so innocuous yet tempting, offering something new and unknown after having monotonously clicked through numerous page breaks and questions. 

I clicked the link and was immediately connected to a new, enchanting website filled with animated images, graphics, and wild colors.  Oh my!  What was this exciting new Wonderland I had discovered?  It was the distant, yet audible cough on the other end of the phone that brought my attention back to the task at hand.  And, I had discovered the cause

The hardest part of any online survey is to motivate survey respondents to not only open your email survey invitation, but take time out of their day to complete the survey.  With the proliferation of internet-based communication, people are becoming more desensitized to email marketing.  If you have already overcome the most difficult task of having a respondent start your survey, why lead them astray?

The solution was simple: take the hyperlink out of the survey body.  Put it in an email message or as a link on the separate Thank You page instead.  Keep this survey best practice in mind and you'll keep survey respondents focused on the project at hand.  Once they complete the survey, you can unleash the wonderful and ever intriguing world of the internet upon them.

3 Steps to Filtering your Survey Views

Tuesday, November 3, 2009 by Caitlin Rawles
One of the great things about Cvent Web Surveys software application is that it is constantly getting “better.” I, for one, am not aware of another survey software company that can state with confidence that 80% of all product enhancements come directly from the requests of current clients. Cvent, however, has certain processes in place so that every time a client expresses interest in seeing a new feature added to the online survey application, this request is quickly relayed to our technical team.

For those of you who were clients before our most recent product release in August 2009, you definitely noticed at least one big change in your account the first time you logged in after the release. As soon as you logged into your Cvent Web Surveys account, you saw that your surveys were no longer organized into folders on the Survey Selection page. Instead, they are now displayed in “views.”

Now, you may wonder why I chose to write my blog post this week on the transition from folders to survey views. It may seem like a pretty dry topic. I wanted to write on this particular survey subject because I get so many calls from clients asking how to create a new survey view that pull the appropriate surveys into view. If you have a lot of surveys created in your account, then this is a pretty important thing to know how to do, so that you don’t have to sort through all of your company’s surveys just to find the few that you are personally working on!

When you are ready to create a new survey view and filter the appropriate surveys into this view, you need to remember 3 simple steps:

1) Create a survey custom field. You can create survey custom fields under the Administration tab, on the same page that you create contact custom fields. Survey custom fields are primarily used to classify the surveys in your account and pull them into the appropriate views on the Survey Selection page. So, for example, if your marketing department and human resources department are running surveys, you may want to create 2 separate survey views, one for each department. The first step to do this would be to create a survey custom field for department.

Create Survey Views 2) Create a new view on the Survey Selection page. You can create a new survey view by choosing “add new view” from the Display drop-down menu. When you add the new view, you will need to name it and also specify certain options (i.e. whether you would like the view to be private or public). Finally, at the bottom of the page, you should apply an advanced filter based on the survey custom field you just created for department. For example, if you are adding the survey view for “Marketing Surveys,” you should choose “department” as the field, “equals” as the operator, and “marketing” as the value.

Survey View Filters

3) Now that you have created the survey custom field and added the new view, all you need to do is pull the appropriate surveys into the view you just created! When you added the new view for “Marketing Surveys,” you should have gotten a message, “no surveys match your criteria.” This is because you have not yet applied the survey custom field at the survey-level! To do this, simply go into an individual marketing survey, and click on  Settings on the top navigation bar. On the General Information page, you should click on the Custom Survey Fields tab. Here you can apply the “marketing” label to the individual survey, so that it will show up in the “Marketing Surveys” view.

Survey View Results

Hopefully this post will be helpful to those of you who are struggling with the transition from folders to survey views. Believe me, survey views are completely customizable and will help you organize online surveys in your Cvent Web Surveys software account.

Survey Design: Do Colors Matter? Part I

Monday, November 2, 2009 by Sherrie Mersdorf
I found an interesting poll today about colors preferred by men and women, and it provoked some questions about what are the best colors to use when you create polls or design survey questionnaires. Here's the breakdown from the poll shared in a Lyris Whitepaper:

Favorite Color Poll

Why does it matter? Because colors are also a form of non-verbal communication. So whether you're creating an online questionnaire to collect feedback or using an email survey tool to craft email marketing messages for survey invitations, you should care how colors affect those reading your email or completing your customer survey forms.

Colors can cause physical reactions. For example, too much red has been show to increase blood pressure. As you design survey templates, keep in mind how color meanings can affect survey respondents.

Cool colors: Cool colors typically have a calming effect. Keep in mind that cool colors can appear smaller than warm colors and visually recede on the page.

Blue Blue - As you might have guessed, blue is calming. Almost everyone likes some shade of blue, whether it's a strong and steadfast blue or a light, friendly blue. In fact, in 2008 Pantone selected Blue Iris as the color of the year. As a result of the calming effect blue has, it can make time seem to pass more quickly and help you sleep. However, too much blue can cause the calming effect to go to the extreme and cause you to have the blues. Beyond just being calming, blue can convey richness and sometimes superiority (deep royal blue) or it can convey trust and truthfulness (combining light and dark blue). See how using blues could improve your response rate if it helps people trust you?
Green
Green - Like blue, green has some calming effects and can make time seem like it's moving quicker, but it also signifies growth, renewal, health and the environment. Like with blue, green has it's own extreme as well, green can mean jealousy or envy and inexperience. With a hint of warmth and coolness, green can create balance, harmony and stability.
Purple
Purple - Over the ages, purple has come to be synonymous with royalty. Since purple comes from red (warm) and blue (cool) it has intriguing qualities of both. Typically deep and bright purples suggest riches, while lighter purples are more romantic and delicate. Keep in mind though, while purple can be noble and spiritual, too much purple can cause moodiness - the same as with too much blue.
Turquoise
Turquoise - As a blend of blue and green, turquoise can have a soft, feminine qualities or a more sophisticated feel with the darker teals.
Look for parts two and three later this week for warm and neutral color meanings.

Conducting a Telephone Survey

Friday, October 30, 2009 by Kelli Kelley
As market researchers, we are all aware of the many ways data can be gathered for a study. There is the online survey, telephone survey, in-person interview, direct mail questionnaire, email survey, focus groups and more.

Telephone surveys often yield decent response rates but can be difficult to conduct. A lot of people simply don’t want to be bothered on the phone and spend time answering poll questions. But phone surveys are great because you can ask all the questions and get clarification on any answers that don’t quite have the information you are looking for. The opportunity for that is of course not present in an online, email or direct mail survey.

A telephone survey is not going to work for every study, however. There are some products that won’t match up well. For example, a survey about a medical product is likely not one that anyone will want to discuss over the phone with a stranger.

For a consumer survey with a lot of feedback answers using numbered responses, an email questionnaire might be best as it could grow tedious and leave too much margin for error.

If it works, you can also combine survey methods and gather data both ways. When creating the surveys be sure to incorporate the differences into the call script and email. If it is necessary to have pre-screening questions for the phone interview, make them as concise as possible. Combining data collection methods is helpful and can achieve a more well-rounded result, but be careful about choosing the best method for your purposes.

Survey Research Best Practices: Pretesting

Friday, October 30, 2009 by Tyson Gingery
There are literally dozens of ways respondents can misread and even misconstrue survey questions.  Some potential errors may be easily identified, while other errors can go unnoticed all the way up until data collection begins.  The possibility of a large number of respondents skipping the same questions, or customers providing invalid feedback because of faulty survey questionnaire design and implementation, are just two of the many reasons you should test-run a survey before sending out the real thing.  Conducting a pretest is the single best way to identify phrases subject to misinterpretations (and question design flaws in general).

Pretests (also referred to as pilot tests) are used to test the validity and reliability of individual survey questions, the entire questionnaire, and/or response scales.  While carrying out a pretest adds a step to your task list, the benefits of sending out a valid instrument far outweigh the costs of a pretest (which for online surveys usually means only extra time, not dollars).

To conduct a pretest, you first need to select a smaller survey sample that is still fairly representative of your target population.  You then have this pretest sample complete their surveys, while providing feedback about your questions, any technical concerns and other elements you feel could introduce bias or error into the process and subsequent results.  These respondents will no longer be eligible for actual survey participation since they will have been exposed to the questions ahead of time, but the process is well worth it.  The final step in the pretest is to analyze your results and decide how you should revise the survey to make it better and easier to complete.

One big caveat: make sure you use people unfamiliar with your research.  If you use colleagues or acquaintances who are knowledgeable about any relevant topics or technical issues, they may overlook correctable errors such as leading and loaded questions, faulty transitions and overly technical terminology.

By taking the extra step of conducting a pretest, you can gain valuable information from a small subset of people.  This will allow you to make the necessary and appropriate revisions, and in turn produce valid, reliable survey questionnaires for your formal survey research project.

Constructing a Survey Research Report or Presentation

Thursday, October 29, 2009 by Tyson Gingery
If you follow the bloggers on the Cvent Web Survey blog, you know we emphasize survey reporting concerns throughout the entire questionnaire project life-cycle.  This post outlines five general sections that comprise a good report or presentation for a survey research project.  By following this outline, you can be sure that you have a thorough summary of your research objectives, processes and results all in one place at the conclusion of your survey project.

Executive Summary
This is the "drive-by" version of the entire survey project.  It contains a brief summary of your main points, and predominately consists of broad research findings.  You can also think of this as the audience takeaway section: imagine if people had just five minutes to hear your results, and then had to make decisions based upon what they heard.  Include essential, bottom-line insights from your survey project here (and not much else).

Introduction/Background
In this section, you introduce your study, including its purpose, concepts, rationale and variable descriptions (where appropriate).  This is also the place to provide all the background information, as well as any prior research findings/citations upon which your current study is based.  If you have specific hypotheses, they can be placed here after you’ve established rationale.

Methodology
This is the part of the report where you get dirty with the details of how you went about designing and conducting your survey.  Descriptions of survey sampling procedures, survey question and response option/scale design, data collection activities and timelines all belong here.

Results
In the survey results section of your report or presentation, you provide all the survey findings.  This includes detailed tables, charts and other selected graphics that clearly explain what the data say, and can be quite extensive depending on how many survey questions (and research questions) you have.

Conclusion/Discussion/Recommendations
These sections can of course be listed separately, but I’ll group them together here for our general descriptive purposes.  This is where you take the step from findings to decisions.  You’ve detailed your results; now you draw conclusions, discuss anything that might have affected the research or your path forward, and make recommendations about where to go next based on the data.

Choose Whether to Manually or Automatically Send Emails

Thursday, October 29, 2009 by Lisa Boruah
Using Cvent’s Web Survey tool, you can choose to send your survey emails manually or setup a specific date and time for the emails to go out.

Manual Send is ideal to send emails to specific invitees from the target list. As you get the option to select:

1. Respondents by choosing which Contact Group the email needs to be sent to
2. Respondents that have not received the email before.
3. Manually enter the search details to search for particular respondent(s)
4. You can click on the Search Button to search for all respondents that have been added to this targeted list


Auto Send on the other hand is ideal to send out mass emails to every contact in the target list on a specific date and time. This feature is perfect to send out reminder email survey invitations to respondents who have not yet completed the online questionnaire or send confirmation emails to completed respondents thanking them for their time and feedback.


Along with these options, there are various other features that you can choose from in the Cvent email survey tool:

1. What format do you want to use to send this email?
Choose from both HTML and plain text or only plain text. If both HTML and plain text are selected, an invitee will receive either the HTML message or plain text message, depending on their email settings.

2. Click Tracking
A way to track which links are being clicked in HTML emails. You can run reports to determine which survey invitation emails and links are getting the most traffic. Turning on Click Tracking enables tracking in your HTML emails.

3. CC Option
Sending to a CC email address is available in all survey email templates. When the CC email recipient takes the survey, the primary contact’s information and email address will be pre-populated within the survey.

To use all these features for your organizations benefit. Sign up for a Free Trial Account now!

Sample Workplace Employee Survey Questions

Thursday, October 29, 2009 by Sherrie Mersdorf
I probably don't need to explain why creating employee surveys should be part of every HR department, but coming up with the correct employee evaluation template or employee job satisfaction survey questions isn't as as obvious as know you should do them. I recently came across a few sample workplace survey questions I thought may help when you start writing employee questionnaires:

Sample Employee Survey Question: How long have you worked for this organization?

Sample Employee Survey Question: From the list below, rank the top four issues you would like to  see addressed, with 1 indicating most important.

Sample Employee Survey Question; Are job openings posted fairly so that all employees are aware of new opportunities?

Sample Employee Survey Question; How important are each of the benefits provided by our company?
 
One thing you should notice in the example employee satisfaction questions are they are different survey question types. A general online survey best practice to remember when crafting employee survey questions is to vary the question type. It helps keep the respondent engaged and lowers survey abandonment rate.

10 Tips to Increase Survey Response Rates

Wednesday, October 28, 2009 by Sherrie Mersdorf
Increase Response RatesIncreasing survey response rates is a major goal of most survey builders and market researchers. There's an art and a science to increasing campaign response rates whether it's an email marketing campaign or an online market research study. I wanted to share some of my tips for how to increase survey response rates:

Make the email survey invitation from names easy to recognize. You can do this by including an individual's name within the organization that's well known (such as the CEO or if it's a client survey, the name of their sales rep). You can also use the organization's name, or both. For example, I'm subscribed to a few MarketingProf's newsletters. When they send out emails they include the same person's name and their organizations name so it looks like this: Anne, MarketingProfs. I recognize it everytime, and since I enjoy their newsletter, I made sure to open the email.

Keep subject line's compelling, but short. The subject line and the From Name are the two most critical pieces to get your email opened. Try to keep your subject lines to 35 characters or less. You don't need to put the entire email in the subject line, but you do need to include enough information to make the recipients open the survey email.

Create an attractive survey invitation. Studies have shown that well done HTML email messages get better response rates than plain text emails. With HTML you have the opportunity to include images, change font sizes, bold text, etc. Take advantage of this chance. It's one more way to get people to click through to your survey!

Send personalized survey invitations. Personalizing your emails, even something as simple as including the recipient's name in the greeting, will return a higher response than a generic message. It creates a personal touch, and makes the recipient feel like someone took the time to send them a personal message (even though your email survey tool did it for you).

Introduce the survey. Let the participants know why they should participate in your survey. If they don't understand why their opinion is important to your survey findings, why would they want to take the time to fill it out?

How long will the survey take? Not setting expectations in the beginning for survey length leads to low response rates and high abandonment rates. Not what you want to see. If you don't let people know how long it will take to fill out your online survey, they're going to assume you're hiding something about how long it is. Tell them it will take X minutes or the survey is only Y questions long. Definitely be honest, if you lie here, you're going to hurt your future chances of getting those respondents to complete your next online survey questionnaire.

Remind your survey sample that their responses will be kept confidential. This is particularly important for surveys about uncomfortable topics. For example, you created a poll for a public opinion survey to see how your population feels about an emotional topic such as abortion. If you don't keep the information confidential, you probably will not get honest feedback. Same thing goes with employee questionnaires, they should always be kept confidential and anonymous. Not keeping responses confidential will definitely hurt your response rate, as well as the validity of the data.

Offer an incentive. Offering incentives is a proven method for increasing survey response rates. But this method doesn't work if you don't let people know about it up front. Put it in your email, put it on the welcome page of the survey, then make sure to follow up. Again, if you drop the ball here, the chances of that survey respondent completing your online survey form in the future is drastically reduced.

Always say Thank You! Remember when your mom always made you write thank you notes when you got presents or cards from people for holidays and birthdays? It was because people like to feel their effort is noticed and appreciated. Same idea here, it's nice to just get a short note thanking them for their time. After all, survey respondents are doing you a favor.

Don't over email your contact list. This is very important. You shouldn't be inviting the same people to complete your online surveys every month. It's important to segment your list using whichever survey sampling method that works best for your surveys to avoid email list fatigue. Make sure that you're coordinating with other campaigns as well. Just because you know they're different initiatives you're emailing about, your contact's wont necessarily see it that way. If you begin sending emails too frequently, contacts are going to just delete your email and never open it, opt out or report you as a spammer.

Have a tip that I missed? I'd love to hear it!

Market Research Process: 6 Steps to Project Success

Tuesday, March 24, 2009 by Sherrie Mersdorf
Did you know there are 6 steps in the market research process?  While this process speaks directly to marketing research professionals, the process applies to HR, customer or education surveys as well:

  1. Identify and define the problem.  Before you start any web survey project, you should identify the key issues you hope to be able to solve.  This step should also include clearly defined objectives.
     
  2. Develop the approach. In this step, you need to establish a budget, understand influencing factors such as the environment or economy, decide on sampling and survey methods, and formulating hypotheses.
     
  3. Research design. Designing a survey or questionnaire is considered the most important step in any survey process.  Question design takes a lot of thought and time.  We like to say, "If you put garbage in, you'll get garbage out."  This means that if the questions are bad, the data will be bad as well.  During the survey research design, keep in mind sampling methods and data analysis factors you intend to use.
     
  4. Collect the data. Don't forget to test your survey before to ensure you're fielding the correct data.  Thankfully, with the help of an online survey tool, this step is relatively painless.
     
  5. Analyze the Data. The types of analysis you planned to perform on the collected survey data should have been decided in earlier steps, but after collecting the data you have to actually perform the survey analysis.  Analysis can be performed using survey analysis tools like office programs, such as Excel, or more advanced programs such as SPSS - the complexity of the questions will determine this.
     
  6. Report, Present, Take Action.  The final step in the market research process is to present your survey research findings and draw conclusions.  While Step 3 is the most important because it defines the outcome of your survey, if you fail to complete this last step and act on the findings in some way, the previous steps don't matter. 

As I mentioned in the beginning, this same process can be applied to any type of project: product evaluations, customer satisfaction questionnaires, public relation surveys, etc.  If you give each step the attention it deserves, each of your online surveys should be a success.