Friday, February 29, 2008

Science Participation


The new kids on the block of scientific publishing are starting to make waves. PLoS ONE is the crown jewel of the PLoS empire, Nature Precedings is a pre-print archive for the life sciences (something that has worked wonderfully well for physics for years), and of course, JoVE is promoting a new medium for scientific publishing. The trick is that while these new initiatives in science publishing are useful and smart as they are, they need audience participation to reach their fullest potential.

An initiation of discussion about papers on PLoS ONE, commenting on manuscripts on Precedings, and discussing videos of procedures on JoVE can help science make more sense, make it a community effort as opposed to a field full of insular cells.

Yet, scientists are not commenting. Certainly not as many scientists as could be hoped for. Why not? Why do so many people comment on politics, religion, even food, but not science? I am sure that there are entire offices of people devoted to solving this problem so I will not attempt to do so. I don’t want to fix it, I just want to understand why it’s happening.

- It is because scientists are afraid to be openly critical of people who could later affect their careers?

- Is it because reading articles and leaving thoughtful comments requires too much time?


- Is it because it’s simply too new/unfamiliar to the notoriously conservative and occasionally old-fashioned world of scientific research?


- Is it the formal nature/format of the publications that deters comments? If the format were more blog-like, would people be more likely to participate or would it make no difference? Still the stranger-danger syndrome?


I think most obviously and most importantly, it is because there is no incentive to taking the time comment other than the grand ideal of helping the scientific community and science as a whole. For most people who do not have articles/videos up on these sites, there is no immediate benefit to participation. How do we change that?

There are a number of ideas bouncing around, many people with many decades of experience have spent those decades thinking about this problem, which makes me feel better because frankly, I am stumped. I can think of artificial incentives, such as entering commenters into a lottery to win a trip to a scientific conference, or perhaps a piece of lab equipment of their choice… but that can be perceived as tacky, no? So, I am back to stumped.


Do you comment?

12 comments:

McDawg said...

Equally stumped here.

I would estimate that in the last year, I've commented on about 35 Papers. Thus far (touch wood), I have a 100% acceptance track record.

Because so few people currently comment, I usually email the corresponding author to alert them to the comment.

PLoS ONE's Online Community Manager (Bora Zivkovic) "job is to try to motivate you to comment on the papers there." If we're lucky, maybe he might drop by and comment on this thread....

Anupma said...

When I become a scientist (as a recent personality test predicted) I will definitely comment. But I will want a new lab coat in return. Haha, jk.

McDawg said...

Hi Anupma,

Thanks for dropping by and commenting.

You don't have to be a scientist (I'm not) to post a comment on the websites mentioned in this blog posting.

If you or anyone is interested in science/becoming a scientist, such sites offer free access to all of their content.

"Research Made Public"

Read, watch, learn, enjoy and feel free to interact.

apalazzo said...

Yes, the lack of comments on PLoS is an obstacle to Science 2.0. But I think that unlike on a blog, which has an informal vibe, publications are much more formal. People will only comment on a article if they really have something substantial to say and that their comment is composed, edited and mulled over. Blog posts are spontaneous, and can at times have very insightful, but they are never taken with too much weight. It's a discussion rather than a work set in stone for all eternally that will be judged by countless future scientists.

I've yet to receive a single comment on my PLoS Biology article, yet within a couple of days I received a dozen comments on my blog post. Some of those were along the lines of "great job", but mixed were some questions and some interesting feedback.

Anna said...

Alex - I can definitely see (and understand) the psychological barrier to commenting on an actual paper as opposed to a less formal blog post. I experience it myself. I just wish I knew how to rid myself of it! Maybe time is key. Once the concept becomes ingrained in everyone's psyche, it won't seem like pulling teeth to get comments out of people.

Anonymous said...

For me, it's mostly the time it takes to write a useful, well thought out comment that prevents me from doing so. Though that's much less of an issue when I'm able to post anonymously. :)

Naveen said...

I think that the problem may extend beyond the world of blogging. In many (but not all) of my university science classes, the professors were met by a similar wall of silence, in which questions or comments from the students were often rare. Perhaps the lecture-based science education system is in part responsible.

Anonymous said...

The problem of not commenting may be as simple as many scientists not being aware of these blogs. Contrary to what you may belive, a majority of scientists simply do not look at blogs and are not even aware of these blogs. I am sure things are changing and will change for the better but it takes time. It may help to publicize the blogs in some manner so that more people are aware.

Anna said...

That is a very good point you bring up, Anonymous. The issue of anonymity on these sites is under active debate. Some people feel that you should be able to stand behind your comments and put your name on them, but it does deter people from commenting. Fear of having negative comments traced to you can be a potent obstacle. And I think you are right again - part of the problem is also lack of awareness. All this science/web 2.0 business is fairly new. It's going to take a while for people to become comfortable with the concept.

Naveen - I can understand that. I think I made a comment once in my four years in college. It's intimidating to put yourself on the line. There were a few students with the confidence (perhaps arrogance) enough to speak up frequently and not be crushed when proven wrong.

Anonymous said...

I think you have touched an interesting point: "right or wrong" : we are taught to think and act in these absolutes and by doing so limit ourselves significantly. If we leave the categories right and wrong - and with it the inherent fear of being wrong - the quantity and quality of the ensuing discussions will increase significantly (btw, there can be no "right" without the "wrong").

"afraid to damage a career" - "truth" - "right and wrong" - I think we really need to overcome these traditional concepts especially in the context of an open scientific discussion and debate.

It is very "funny" (or sad ?) that
the most "courageous" scientists I ever met all LEFT academia to do something on their own - often because the academic environment in general does not reward the open and frank discussion - in contrast, I always found it to be a very oppressive environment that will drop you immediately if you do not follow the well established rules and procedures...

McDawg said...

So far, almost 30 people (myself included) have left a comment on a PLoS Medicine Paper which only got published a week ago !!

Statistically, such volume is unprecedented as far as I am aware.

This is a great example of broad review post publication in a Peer Reviewed OA Journal.

Nature Precedings and JoVE also encourage commentary as per this blog posting. Moreover, from the JoVE Facebook group very recently:-

"You can use our video-articles to illustrate your posts. Email nikita.bernstein@jove.com if you would like to embed a video from our site into your posts."

Nikita Bernstein said...

Whoa! I was mentioned :) Then I guess I should chime in...

I think an important element in commentary is the purpose of a comment. When I left comments on blogs, it was in one of the following modes:

1. Engage in a discussion
2. Voice my support/opposition
3. Contribute additional information / direct users to another location

What other modes are there? Which forms apply to academia?