 |
|
| Date:09.22.03 |
 Hello
Readers,
Today's article is a thorough, step-by-step explanation of how to conduct an online survey. I like it because the author is so insistant, at every step, that you know exactly why you're asking questions to begin with.
Namely, what are the actions you will or won't take based on the results of your clients' or potential customers' answers? I'd like to see the polls you make based on today's article, so send them in! I fear my email client saga is not yet over. I recently made the switch to Mozilla mail, but have had it delete my inbox twice. Luckily I didn't have that many vital-to-business emails in it (I've only recently started using it). The lesson? Organize and deal with email immediately. Oddly, no one else at the office has had this particular problem with Mozilla, so it could be something about my machine. Have any of you Mozilla users ever had a similar experience? Be sure to check out this issue's related article on measuring conversions and the fantastic forum discussion on choosing a web stats package. Remember, the 25th is the deadline for OLLIonline reviews. Get those reviews in today! I hope you find today's issue useful, and if you have any questions or comments, please send them in. Best Wishes,
Visit OLLIonline.
So you’ve decided to conduct an online survey. There are a few questions in your mind that you would like answered, and you are on the lookout for a fast and inexpensive way to find out more about your customers, clients and so on. First and foremost, you need to decide what the objectives of the study are. Ensure that you can phrase these objectives as questions or measurements. If you can’t, you are better off looking at other means of gathering data, like focus groups and other qualitative methods. Online surveys tend to focus more on quantitative data collection. Here are a few guidelines: 1. Review the basic objectives of the study. What are you trying to discover? What actions do you want to take as a result of the survey? This helps you to double check the validity of the data-collection mechanism. Online surveys are just one way of collecting and quantifying perspectives. 2. Visualize all of the relevant information items you would like to have. What will the output report look like? What charts and graphs will be prepared? What information do you need to be assured that action is warranted?
3. Rank each topic in items 1 and 2 according to the value of the topic. List the most important topics first. Revisit items 1 and 2 again to make sure the objectives, topics and information you need are appropriate. Remember, you can’t solve the problem if you ask the wrong questions. 4. How easy or difficult is it for the respondent to provide information on each topic? If it is difficult, is there another way to obtain the information by asking another question? This is probably the most important step. Online surveys have to be precise, clear and concise. Due to the nature of the Web and the fickleness of users, if your questions are too complicated and are not easy to understand you will have a high dropout rate. |
|
6.Determine the type of question that is best suited to answer the question and provide enough robustness to meet analysis requirements. This means deciding whether you should use open-ended text questions, dichotomous, multiple choice, rank order, scaled or constant sum (ratio scale) questions. There is a fine line you need to walk here: Generally, tougher analysis requirements will lead to more complicated questionnaire design. However, there are a couple of tools available to make life easier: a) Page breaks: Avoid having a huge scrolling survey. Introduce page breaks as necessary. Please also refrain from just having one question per page. This increases the time to complete the survey as well as increases the chances of dropouts.
b) Branching: Use branching and skip logic to make your surveys smart. Avoid using text like, “If you answered No to Q1 then Answer Q4.” This causes respondent frustration and increases the dropout rate. Design the survey using branching logic so that the correct questions are automatically routed based on previous responses.
7. Write the questions. You may need to write several questions for each topic, selecting the best one. You might also be better off dividing the survey into multiple sections. 8. Sequence the questions so that they are unbiased. 9. Repeat all of the steps above to find any major holes. Are the questions really answered? Have someone independent review it for you. 10. Time the length of the survey. A survey should take less than five minutes. At three to four questions per minute, you are limited to about 15 questions. One open-ended text question counts for three multiple-choice questions. Most online software tools will record the time taken for the respondents to answer questions. 11. Pretest the survey with 20 or more people. Obtain their feedback... in detail. What were they unsure about? Did they have questions? Did they have trouble understanding what you wanted? Did they take a point of view not covered in your answers or question? a) An easy way to do this is to create another survey, with a few open-ended essay questions along with your main project. Let’s call this the “feedback survey.” b) Email the “project” survey to your test group and then email the “feedback” survey also after that. In that way, you can have your test group send you comments regarding the functionality as well as usability of your “project” survey by using you “feedback survey”! 12. Revise your online questionnaire using incorporating the feedback that you received. 13. Send the survey out to all your respondents!
|