torsdag 5 december 2013

What I learned, week 49


Reflections on quantitative methods


From the paper I read for this week I learned that is important that the result is shown in a good and clear way, with good explanations. I think my paper had some mistakes, and even if it’s probably careless mistakes (like the sum in percentage for all men and women that was participated doesn’t sum up to 100%, but rather 98%) it lowers the credibility of the paper. It’s important to show a result that is correct, and don’t make any assumptions from the statistic, that the statistics doesn’t show (I don’t think my paper had this mistake). Like if a class get a lower grade in a specific course one year, we cannot say for sure that the student’s of that year was lazier than usually, the lower grade could also be thanks to the exam was harder than usual. It’s something impossible to know, by just looking on the student’s grades.

The seminar this week fun and it’s obtained a lot of good discussions. Sometimes it was problem in the discussions because it could be hard to discuss quantitative methods as a subject and make generalizations that holds for all quantitative methods, when a proposal of advantages came on something that only hold for some of the quantitative methods. Like if it’s cheaper, compared to qualitative methods or not. It’s hard to say, sense it’s depending on the exact method. But some conclusion could be made for all the quantitative methods, like it is a good way to obtain much data, easier to do on a big geometric area and it’s good for statistic analyzing etc. Compared o qualitative data.

Some methods can be doing on different ways, for example; a survey could be hand out by paper or by the web. Web-based surveys have some advantages and disadvantages compared to the paper-based surveys. It was advantages like it could faster be send for long distances, if it’s many participants (threshold about 3000 persons) it is cheaper, it could be logical and skip some unnecessary questions about smoking if someone already have pressed “no” for the question “do you smoke?” for example. It could also have other medias like video and audio as complement to the survey. Papers on the other hand don’t have the same risk for technological problems as the web has, and often also have a higher response frequency. We hand some discussion in the seminar on web contra paper on what was best for the environment, but don’t came up with a conclusion. I have to see some calculations to say what is the most suitable choice for the environment.

In the seminar we also discussed how important it is to test the questions if someone is going to create a questionnaire survey before handing it out to the target group. It could easily be wrong and it’s often difficult to make sure that the participants understand the questions in the right way. The leader of the seminar showed some questions that at first sight could look like good questions, but somehow easily could be understand on several ways. It was useful to see, and a good idea would be to read some more about questionnaire survey and how to test it before next time I do one.

3 kommentarer:

  1. I think you are pointing out a very important thing in your first paragraph when it comes to quantitative methods and statistical data which is that you should not interpret or make assumptions that the statistics does not show. What we talked about in our seminar group on Olles seminar, as you discuss in the last paragraph, was how difficult it is to develop a questionnaire and Olle showed us some examples of bad questions. With your point about making assumptions in mind, i think that the questions, in a questionnaire for example, needs to be developed so that the possibility of making such assumptions are none or at least very low. Otherwise i think you can make these assumptions without even realizing it.

    SvaraRadera
  2. Hi Tommy! Thank you for your post, I think that you made a good compilation of our work at the seminar. You write that paper-based surveys have a higher response frequency then web-based ones. I remember that Olle Bälter said so and I was really surprised. I really do not understand how it is possible. I think that the filling of paper forms requires more action from the respondent. He must specifically find time to fill it. Besides, to handwrite is harder than to make some click on the mouse button. Moreover, most likely you want the person to send the questionnaire by mail. I do not understand why then it provides more responds. What do you think?

    SvaraRadera
    Svar
    1. I think that paper-based surveys often are often given by a physical person in front of you. In that way it is more personal, the participant feels like he/she doing a favor. And it’s very easy to hand in a paper if the person (which the case often is) is in front of you. If you think of course-evaluation for example, it’s easier for the participant if the teacher bring a paper that he/she hand out and then collect. Compared to if we students have to go to a computer and do several clicks on links in order to get to the survey. So my answer is that I think that paper-based surveys could be the easiest way for the participant.

      Radera