August 17, 2009, 5:48 am
Before I joined Novell, I spent years writing software reviews ‚Äî mostly, but not exclusively, about open source and free software projects. In that time, I ran into hundreds if not thousands of bugs. I might have filed 20 bugs in that time, and that‚Äôs being generous. A couple of reasons for that:
- When I first started reviewing software, I really wasn‚Äôt familiar with the process for filing bugs.
- Even when I became familiar with filing bugs, it was a different process for each project, and if it required creating a login or too many steps, I simply didn‚Äôt have the time to follow up.
- Sometimes the bugs were already known, so no point in filing a new bug. This was usually the case with really egregious bugs.
- Occasionally I would email the developers directly and assumed they were filing bugs‚Ä¶ at any rate, they were aware of the problem, and sometimes it would get fixed during the process of the review.
- I reviewed a lot of software and I didn‚Äôt get paid to file bugs, I got paid to turn in reviews. Taking time to file bugs (even 30 minutes) was time that I wasn‚Äôt earning.
But the big question to me is whether or not a software reviewer has a responsibility to actually file bugs. Occasionally I would get comments or emails asking/complaining ‚Äúwell, did you file a bug?‚Äù ‚Äî sometimes as a ‚Äúhey, help us out and file the bug‚Äù and sometimes as ‚Äúhow dare you ding us for something in a review instead of filing a bug?!‚Äù
As a part of a project, I often wish people would take the time to file bugs ‚Äî lots of people will take the time to comment extensively on posts on news.opensuse.org about bugs they think they‚Äôve found, but won‚Äôt bother to actually file the bugs. It might feel good to vent that way, and perhaps if someone else has the problem or is feeling kind, they‚Äôll file the bug for the commenter, but usually that bug goes unreported (officially) and the same person wonders six months later ‚Äúwhy hasn‚Äôt my issue been addressed?‚Äù
I‚Äôm not really sure of the answer. It‚Äôs clearly not what reviewers are being paid for, and I know a lot of people still doing reviews for a living ‚Äî not sure they have the bandwidth to spend a few hours per week filing bugs in addition to testing software and writing about it. But it‚Äôs also good community citizenship to file bugs if you‚Äôre using the software. (Even better to go ahead and send a patch if you‚Äôre a developer, but that‚Äôs another story‚Ä¶)
Anyway, just something I‚Äôm pondering with my morning coffee‚Ä¶