Main Area and Open Discussion > General Software Discussion

Organizing Reviews

(1/3) > >>

Renegade:
I'm splitting this from a previous topic...

You know I'd love to see a more organized process on this forum where a small group of people could agree to do an organized, exhaustive, frenetic testing of programs and try to come up with some consensus of best tools for a task.

In other words, it would be nice if we could take a thread like this and have a few people just go out and try every help file maker they can find and winnow down the list of top candidates.  Not only would that be helpful but we could then go and try to get some discounts on these, as well as provide some guidance to the non-top authors on how they could improve their programs.
-mouser (August 18, 2007, 12:19 AM)
--- End quote ---


Just one consideration...

I'd like to throw in "not-testing"... For these kinds of things there are people that use the software in real-world production and can contribute that real-world experience.

One of the problems I find with a lot of reviews is that they are little more than "feature lists" with no real commentary on how the application truly performs in real life.

I simply don't have the time to go out and download, install, then test a bunch of software, but I can certainly contribute for those applications where I really know them very well from real world experience.

I say "real world experience" because there's a VERY big difference between running a simple test for 5 minutes, and using an application on a daily basis.

Of course feature lists are important, but adding in something about the performance would take a review from being a "review" to being "authoritative".

Ok - That's all. Let the ideas start flying on how to get this organized... Perhaps we should start with a list of goals. I'll go first:

GOALS:

1) Make the reviews authoritative and reliable for readers
2) Exhaustive reviews of individual pieces of software
3) Exhaustive comparisons between pieces of software
4) Relatively easy to contribute to the process in a structured way, perhaps "templated" - this would require a metadata type structure
5) Not sure... Please continue...

Cheers!

mitzevo:
The official reviews follow these guide lines pretty much, as for the mini reviews, they are not as strict, and do not have "Exhaustive" testing methods. That's why they are called "mini-reviews", because they are for DC members to write about software which they like and/or think other people will like and find useful etc.

If you want more authority, the official reviews are what you want. It takes a lot of time to review "stuff", especially the way you have outlined above.. The official reviews have been idle for since 2004/2005, I think first of all they should be updated for 2008 (I have mentioned this many times in IRC and a few times on the forum) and then probably updated at 2010 or some thing..

Grorgy:
I like both sorts of reviews.  The detailed review of certain types of applications that renegade is after are excellent but, and it’s a big but, if the reviews posted weres limited to those that were extensive, then the number of reviews would decline significantly, and the chance of anyone who isnt technically minded to write one almost disappears.  If im looking for something or just looking then being able to get a list together of possibles and probables from people who just like their latest purchase/find whatever and the comments that then flow and other programs that are in that category and relative merits is both entertaining and informative and open for quick updates and new players appearing on the scene.   :o tooo many words i'll stop now  ;D 

But just to finish lets have both  :)

Perry Mowbray:
A while ago I floated something not dissimilar to Mouser where DC members could add their rating for various aspects of a particular piece of software.

Mouser was concerned that it was too easy for unethical people to overrate their products, or products they like, and if that happened then it certainly isn't a great idea, or not a bad idea too easily ruined.

But I still like the idea of having a rating system, or as Renegade said a "Non-Testing" review. I thought that aggregating all of DC's opinions about applications would be a great addition to the site. Sort of like Wacoopa but not just usage. It'd work hand-in-hand with the other reviews too, and actually add more value to them.

Anyway Renegade, in answer to your suggestion: I agree!

Darwin:
+1 for me too. I like your idea, too, Perry, but I agree with mouser. Renegade's is the best solution - still "ripe" for exploitation but at least anyone unethical to do so is going to have to write a thorough review of an app to get it posted. My guess is anyone tempted will be put off by the effort involved and move on...

Navigation

[0] Message Index

[#] Next page