Idea emergence

My research question, originally conceived: to what extent do DIY online communities displace capital activity?

The major shift that has occurred in my thinking over this course is the realization that I am not an economist and I am not trained in economic disciplinary methods.  In other words, I am not familiar with economic quantitative analyses and I would not be able to conduct them in an acceptable fashion (later scrutiny to peer review) without said expertise.  Furthermore, my initial research question itself is huge.  I now think this research could ideally be executed as an interdisciplinary project between an information + an economic scholar.  The value I would bring to such a project is my attention to the online space (how it is dis/similar to offline) and my familiarity with the field of community informatics.  As I am ideologically invested in the question (let’s be honest), I could also use the research with the DIY online community to arrive at sound conclusions that could be used to empower others; as a longer-term goal, I could develop tools to help DIY online communities actualize their goals toward increased economic independence.

Retrospective

As I finished typing up my SSHRC Program of Work, I was reasonably happy with my chosen area of inquiry and hypothesis but I had this annoying feeling that my plan of action/research methodology was still a little vague...well, because it was. I had a hazy idea of what I wanted to achieve but I hadn't spelled out all the parts of the puzzle, how I was going recruit participants, design my experiment conditions and obtain research proposal. With every successive blog post, and leveraging the great feedback I got from Glen I think was able to refine my ideas and scope and come up with a less abstract and more grounded in reality version of my research proposal.

I think the biggest take home from the class for me was developing my ability to communicate clearly, in a written document, what I wished to carry out with an experiment design and outline the steps I would need to take to make the research endeavour a success.

I had initially intended to conduct an ethnographic study of the online course experience but that is no longer feasible given that design has pivoted to become a comparison/contrast of the various modes of social interaction on MOOC platforms and how each of them impact course engagement levels. I also decided to go with a more qualitative analysis and think this will best inform the future research I undertake in this direction.

Last Post!

Since we have started this course I can say that my research topic hasn't changed per se, however, a number of logistical questions have arisen in implementing my program. One, I have discovered that  a movement has recently started in Hamilton that is similar to my initial proposal, however, it is being done by private non-profits. I also discussed my idea with a professional who runs programs between libraries and museums in another city, and he brought up an interesting point that some people will assume anything free means it is of poor quality. I am not sure if it is even possible yet to run my program for free, however, I am now questioning if there should be a price tag attached to the program, and if so, what is fair.

The neighbourhood I want to work with is low-income, and I know they wouldn't associate free programing with poor quality, but it makes me wonder how this may affect other organizations wanting to become involved. Moreover, if the public sector does commit, would they give space or staff? If so can their budgets accommodate this? Will we be competing with this other initiative or programs within the city and if so what edge does mine have over theirs? If I am to implement this idea I think these questions can only be answered by spending a significant amount of time interviewing stakeholders and meeting with potential participants. Although my initial idea would be fairly large scale by physically combining services into one accessible location, for now it seems best to start small and build from there. I am adjusting the program to begin in one rec centre, library, or museum, and use a reflexive analysis to adjust as need be.

Research question or moving target?

We have reached the semester end and my research question has evolved from questioning the legitimacy of online gambling in Canada in light of the Kahnawake Gaming Commission, then looking at ways for small Canadian businesses to successfully launch online gambling ventures, to now studying how applying data and web analytics concepts could help curb problem gambling. The main reason from moving from the original idea stemmed from the fact that, it seemed to belong more in a law faculty; the second research idea appeared more fitted in a business/management school. I am confident that my current approach is more suited for a study in the context of the iSchool, however some concerns remain as to being able to somewhat simulate real gambling behavior in the context of a study for the purpose of gathering pertinent data.

Establishing credibility

I am generally interested in many fields including politics, philosophy, information technology, physics, music and sports - especially the coaching aspect.  What I like most about peer-reviewing is the ability it gives someone like myself to voice and validate the veracity and commonality of their views and ideas on a topic/field/area of interest etc.. without the requirement of a certified academic foundation as long as the opinions/assessment made are relevant, educative or reflecting of the state of the art in related disciplines without necessarily being field advancing. One can only study and get diplomas/certifications in so many fields however, there is often a need to establish credibility when contemplating the prospect of giving advice or consulting in a field of interest; I find peer-reviewed publications a good outlet for people in the previously described situation to make a strong case of demonstrating their credentials.

Re(search) Re(mixing)

For my last post on the blog, I consider some of the more challenging aspects of the course, but also the upsides that evolved out of these difficulties.

Some of us found the most trying part of Research Methods was to hone in on a research area, and a research question. Studying the connection between the DIY and Maker Movements, and the development of libraries (my chosen area of study) is a topic on which there is minimal specific scholarship, so it was an adventure to find linking materials. Often, it was a question of language - choosing the right words to use for optimal searches in the library database. Along the topic of the challenges of language, just choosing the right words to frame a research question was also very intimidating, because language can be a limiting entity. It can be hard to find the right words for a topic you haven't quite fully formed, and probably won't even understand until you have completed the actual research project (sometimes, if even!). Kristin Luker (2008) describes this feeling very well:

"[Your adviser] will ask you what your hypothesis is...what your research question is. You just go blank, feeling like a rabbit trapped on the roadway with the headlights bearing down on you, as you try desperately to explain what's so interesting about, say, privatized water, or rising rates of imprisonment in America, or adolescent sexuality. When you and your adviser part at the end of the time allotted to you, more likely than not, you part in mutual frustration" (p. 18).

Although I can't claim to having frustrating experiences with either Professor Galey's or Glen's comments and suggestions, I can definitely relate to the floundering student, trying to explain why they think topic A or B is the coolest! It really is a strange feeling to just try and build something (concrete sentences) out of what seems like nothing (fun thoughts floating in my brain), a "nothing" which is often very personal and somewhat of a naked concept being put forth to peers and the community. However, delving into the readings this term and attending class, I was surprised to learn how normal these feelings are, and what a non-linear process research can often be. Mostly, I have found that research takes time, as certain sources and resources might lead to other resources, in unexpected ways. Professor Galey was certainly right - I definitely look at the objects, people, and events around me in a new way, as well as topics and themes which are both new and familiar, and think: how can I transform this into a research project?

The same but different

I can think of a couple of main changes to my research question that I think are kind of fun to look at now that I'm done. Specifically, in the beginning, my research question was extremely broad in that I was looking at where, when, why, and how audiobook listeners use audiobooks. I knew that there was something interesting about how these aspects of audiobook listening fit together but I could not figure out how exactly and to what end. After I got feedback from my first proposal, I started to narrow the goal of my research to helping with marketing efforts and adoption issues. Also, I tried to narrow the where, when, why, and how down to the profiling of audiobook listeners, but something felt off. Then, as a really started to focus on the research method--interviewing--I would use, I realized that there are different ways to interview people. As I made choices about how I would want to interview people, mainly I want to interview using a narrative style, I realized that I wouldn't really be profiling people by hearing their stories. At last I had an ahha! moment, where my knowledge from information system and design (IS&D) intersected with my library and information science (LIS) knowledge: what I want to look at in my research is the use cases of audiobook listeners.

In retrospect, this history is probably only fun to me but I think it is interesting that my main idea from the beginning stuck, but it took me almost four months to articulate that idea in a succinct and effective way.

References

Heaberlin, P. (2009). Day 110/365[Photograph]. Retrieved from http://www.flickr.com/photos/lobsterboy1980/ 

Does anyone know how to leave lines between paragraphs on the blog? I put them in on the draft but when I publish it, my writing formats as one big blog blob with no paragraphs. Please let me know, someone, if you know. Maybe my computer is part of the problem. Thanks, Cynthia

Twists, turns and tangents By Cynthia Dempster

Last fall, the term seemed like an eternity. I was like Paul, I kept changing my research question. I liked doing this. Each change was exciting, like going on an intellectual picnic. When I finally decided on a topic, I kept changing methods(please don’t tell Prof. Galey or Glenn). I have danced the methodological tangent dance and enjoyed it immensely. I did finally determine a method. However, I found the tangents assisted me. The topical tangent helped me because I saw my chosen topic in the context of my multiple interests. I also found ways that my concerns overlapped. Luker describes salsa dancing research as a “conundrum:-“you don’t really know what it’s about until the very end”(2008, p. 130). The methodological tangent helped me. I came to see that the different methods can overlap and contain aspects of each other. The method that I chose was the in person interview method. There is an aspect of ethnography to conducting an in person interview.

My research is qualitative. However, it is impossible to avoid quantitative concerns. Quantitative questions, surmises and interests do influence qualitative studies even if they aren’t directly expressed. I think numbers are always present as an inference, even when they aren’t applied. For example, here are some questions that lurk behind my interview questions. Does this question get to the core of the matter? Does it potentially expose something that could be counted or compared? Is the response typical? How many archivists would respond in a similar way?

Part way through my work, I discovered I was trying to do something impossible. I am studying blind spots in archives. I am studying ways that archives are unconscious. I became aware that it is impossible to be conscious of the unconscious. It is impossible to see a blind spot. I then asked myself: is it possible to conduct a study of something that is impossible? Can an attempt to do something impossible yield results that are valuable and knowable? I decided ‘yes’. If I’m right, I’ll be happy. If I’m wrong there will still be an ancillary benefit to my attempt. Prof. Galey and Glenn will have a good laugh.

Luker, K.(2008). Salsa dancing into the social sciences. Harvard University Press.

Reflections on Research Development

I've found that I haven't made a lot of changes to my research question over the course of the semester. I think a lot of that is because this is a topic I've been thinking about researching for a couple of years. As I discussed in a previous post, I spent a lot of time at the beginning of the course thinking about how to make the topic more practical and adapting my research question to suit what I've learned at the iSchool.

However, my topic is a relatively exploratory one, and my research question is a little broad. My methodology, unstructured interviews, allows for some adaption during the course of the study to suit whatever I encounter at the time. So, perhaps, in the end I've left myself room to make last minute changes. As a fairly indecisive person I do have a tendency to try to keep my options open as long as possible, and I think it's interesting to consider how that aspect of my personality might have influenced the design of my research plan. Now that you've reflected back on the way your research developed, have any of you noticed a similar trend?

A Case to Consider

This is somewhat of an oddball post, as I am making up for a missed one over the reading week. I'm actually not sure why I didn't catch onto the fact that we would be posting over the reading week, as looking back, Professor Galey put up plenty of notices on both Blackboard and the course blog!

Anyway, these are some musings about research methods. For my research proposal, my chosen methodology is the case study, and reading about case studies has been a surprisingly inspiring experience! Before beginning the course, I knew very little about case studies (as a research method), but had heard the term often before, as it is used in a number of contexts, including education. Cases are useful teaching methods (especially in law, psychology, medicine, business, and more), in order to provide more contextual examples for students, setting theories and ideas into action.

Perhaps because the term "case study" is used as an umbrella concept to describe a number of different research and teaching approaches, that it is difficult to pin down the word in an easily definable definition. However, this is somewhat appropriate, as case studies are often detailed and complex narratives about microcosms of the world, and can be fascinating to read about.

Back to the inspirational moment! When thinking of research methods, the "aha!" moment often comes to mind, in which the intrepid researcher reveals an amazing fact about human existence, or whichever field their research focuses on. Not that I believed research was always about facts, but that it was about finding some sort specific result, which could be packaged into a sentence and shared with the world. So, essentially I always though more about the end, rather than the process. However, reading more and more about case studies and other forms of qualititative research, I have learned about the value in research in which the aim is not necessarily generalizability, and that this fact does not detract from its worth and relevance. Within the context of case studies, the case study itself is often the most important part, and not necessarily a clearly defined conclusion. Flyvbjerg's article regarding myths about case-study research (2006) is a really engaging read, revealing the intricacies of a misunderstood research method, and developing a detailed insight into what he believes (with the support of other scholars) research can be all about.

                                                                       Reference

 

Flyvbjerg, B. (2006). Five misunderstandings about case-study research. Qualitative Inquiry, 12(2), 219-245. doi: 10.1177/1077800405284363

Questioning Research…

My research question has definitely changed over the course of the semester.  I have changed and re-changed subjects so often that it has been difficult to keep track.  I have had to be a little more introspective about my interests in order to decide on a research topic.  Taking a deep look at your interests and thinking how to undertake a detailed exploration of them is actually a more difficult task than you would expect.

I have definitely learned how to take a new approach to research, as I have had to think of new approaches and methods to tackle different subject areas.  Not having any research background, I had a fairly stereotypical view of research (labcoats and scientists), so it took some time for me to adjust to the different types of research that can be done with different methods.

I am still wrestling with my research question in that I am not sure where to place my focus on my topic.  I can think of broad questions like "how does this work?" or "where did this come from?", but it is difficult to focus a research question to a specific issue or interest in my topic area.  And though I might come up with some sub-questions for my topic, but I am never confident that each question is as interesting as the topic as a whole.  You want to really explore the entirety of a subject and a feasible research question can sometimes feel limiting.

Gettin' the ol' discussion ball rolling

As part of this week’s blog question asks us to incite some inter-blogger commentary, I was struck with the realization that I haven’t really been commenting on other people’s blog posts.  I then began to wonder whether anyone had been commenting on mine.  As a newcomer to blogging, I figured that I would be somehow notified if someone commented on one of my postings, but I just went back and looked over all of my entries, only to realize that I had received some comments that I’d been unaware of!  To correct this lack of response, I will put in some time this week to respond to some of the comments on my posts, but for now I’ll speak to the portion of the question that asks how our research has evolved.

I have struggled throughout this course, as my research project methodology (oral history) wasn’t covered in class.  I found it difficult to articulate a research question, as oral history isn’t generally used as a method through which hypotheses are tested, or through which quantitative research is performed.  Rather, it seeks to identify, record and preserve people’s personal accounts for their own value.  I believe that this still qualifies as a kind of research, however I found it difficult to position this particular research methodology within the context of the class and the proposal paper. 

Nevertheless, I’ve been able to get through a first draft of my research proposal, and I thought I would use this opportunity to ask the members of the group a couple of questions about parts of my proposal that I’m still unsure about.  So here goes:

What are your general thoughts about the length of an introduction?  The examples of proposals from last year that Prof. Galey provided all tended to have brief and very concise introductions, but mine has turned out to be two pages long.  I figured that it was important to frame my research project within the context of current discussions in geography (because my project involves recording stories about locations in Toronto), so that the reader would be able to understand that there exists a gap in knowledge that my project would fill.  It didn’t feel right to launch into a sort of thesis statement before introducing the discourse within which I want to contextualize my project.  But I worry that it’s wound up too long. 

I’m also interested in asking the other group members how much detail they’ve gone into in their methodology sections.  Again, as oral history methodology isn’t particularly rigorous, I mostly just described the general principles of oral history, how I would locate the interview subjects, what equipment I will use in the recording and editing of the interviews, the kinds of questions I will ask, how I will present the interviews on a website, and the precautions I will take to ensure the preservation of the recordings.  If anyone else has a project whose methodology lies outside of the general methods we’ve discussed in class, I would love to hear a bit about how you tackled your methodology section. 

Any feedback at all would be greatly appreciated J

Peer Reviewing my Peers…

Well, I am quite late for this post.  To make up for my tardiness, I decided that I would take this as an opportunity to respond to all of my group members previous posts on this topic.  Think of it as a sort of peer review (and like peer review, it comes long after the original submissions!)

Akash has found some other interesting incidents involving controversy in peer review.  It is interesting to note that some incidents of peer review failure were cases where the research was perfectly valid, but it was completely plagiarized.  I think this serves as a good example of where peer review might not be able to hold up a standard.  I think that most peer reviewers would only being doing a review of an article to see if the ideas that it is espousing contain any merit.  I would not be surprised if many peer reviewers would be caught off guard by an idea that is perfectly sound, but completely unoriginal.  I think that this is especially true if you consider the fact that most research does not occur in isolation; it would be very difficult to be certain if a good idea in one paper hasn't already been thought of in another.

I like Lauren's discussion of Wikipedia as a source of peer review.  And I agree with her assessment that, despite Fitzpatrick's assertion that Wikipedia is a platform of ongoing peer review, the reality does not hold up that standard.  It is good to point out that most Wikipedians are not experts, as I think that this very much does make a difference in the quality of the review.  I have seen and heard of some of the infamous "edit wars" that can occur in Wikipedia over the simple placement of a single word.  A controversy caused by the placement of a word is less the exception, and more a rule.  I believe that this is for the precise reason that Lauren indicates: Wikipedians are mostly non-experts; but you do not need to be an expert to have an opinion on word placement.

I also think that this is why "Wikigroaning" exists.  "Wikigroaning" is a term coined for the practice of comparing the word count of a regular, serious encyclopedia article with a pop-culture one.  The resulting groan you will experience is how this term achieved its name.  Or, do a Wikigroan with my favourite method: compare an article on serious subject on Wikipedia: http://en.wikipedia.org/wiki/Spanish_Civil_War (word count: ~14000)
With an article on the Star Wars Wookiepedia:  http://starwars.wikia.com/wiki/Wicket_Wystri_Warrick (word count: ~25000)

I don't know if I completely agree with Jess' point on the Sokal affair (sorry!): That if satire slips past peer review it is a sign of sickness in the discipline itself.  I think that I will go back to my first point, about a peer reviewer being caught off guard by a plagiarized concept, and say that the same is true here.  If you are not expecting to look for satire, it can be extremely hard to spot.  Especially if you are the one who the satire is being direct towards.  We can have a very large blind spot when it comes to our own ideas and beliefs, and satire can very easily slip right past us.  And oftentimes, the point of the satire is completely lost on those it is directed against.  As in the Sokal affair, where the publishers of the journal said that they did in fact read Sokal's article, but saw nothing wrong with it, it just needed to be better written.  When something like this happens, you can start to lose track of who is "trolling" whom…

Vanessa's post about the peer review process was quite interesting.  Hearing about her friend's experience with peer review makes me wonder more about the process as well.  How is it that her friend could find a paper fundamentally flawed, yet others see it as being fit for publishing?  The questions that Vanessa raises at the end of her post are all good points, and I think that there are no easy answers to any of them.  Hearing her friend's experience with peer review does make me start to see the more troubling implications of peer review (I am just speculating here): What if her friend really wasn't qualified to read the paper, and completely misinterpreted it? Or, even worse, what if she was the only one who actually read the paper, and found it flawed?  Not something that you would want to think about too much…

I like Cythia's point about the personal impact of peer review.  When you are choosing to publish a paper, it is really up to you on where you want to publish it and what kind of feedback you are looking for.  While I am sure that many academics would like to see their work in the most prestigious journal, it is really more about seeking the feedback and recognition that will help your ideas to grow.  It is up to the individuals who publish papers to decide on how they want to have their work recognized, and which peer review process works or doesn't work is really a choice that is made by them.

I found myself laughing when reading Eva's post.  I liked her assessment of the Sokal affair, and I found that it was in line with my own thinking: it only created a controversy, and did not really advance a new topic or enlightened change in the system.  What made me laugh was that Eva's post made me think of Sokal's hoax being assessed as if it were his paper being submitted (as a sort of meta-analyis).  Eva's summation of it not being a very original idea is what gave me a chuckle.  Eva also has a good point about peer review being flexible in regards to open vs closed review.  I agree that a combination of both would allow for more constructive reviews.  And I think this relates to Eva's point about author's being flexible in their choice of peer review.

Courtney's post about peer review and the full stomach reminded me of my legal work.  And that I think I had heard about her professor's research in my studies as well.  It is a well accepted fact of legal work that judges are humans too, and are subject to the same weaknesses as everyone else (so it is never wise to do anything to annoy them; including presenting your case at lunch hour)  Though Courtney relates this to reviewers having an empty stomach, and thus giving a negative review of a paper, I think that the observation that others have made about the possible bias of reviewers is a more probable concern.  An empty stomach is the least of your worries when you are dealing with humans with all the same biases and weaknesses that you have.  (I still think that attaching a cookie to your paper is an excellent idea).

Ghaddar makes a good point about nonsensical writings not being related to single papers, but entire disciplines.  Whenever I encounter the subject of pseudoscience, I always think about phrenology, and because I am a Simpsons fan, I think about Mr. Burns' response when Smithers says that "phrenology has been dismissed as quackery 160 years ago" Mr. Burns says, "Of course you'd say that...you have the brainpan of a stagecoach tilter!" (Simpsons, 3F06).  I think that this quote actually teaches us something about peer review: that it is useless when an entire discipline is caught in its own nonsense.  Ghaddar makes a good point in the usefulness of allowing public review of academic papers.  This might help to shed some light in the darker corners academia, where peer review would make less difference.

Well, this has been the longest post ever.  I hope that I was able to hit on some good points in response to each person, and that my peer review of their work helps them out.  Also, I have no idea what the correct format for citing Simpsons episodes is, so I hope that my attempt works.  And now, I hereby deem all of the previous posts to have passed my peer review and be suitable for publishing!