• Three rating categories (reliability, insight and style)
  • User can rate one or more categories
  • Overall rating based on category votes ** Calculate the average of each category ** Optionally assign a weight to each category (weight of categories TBD) ** Calculate a weighted average of the three category averages
  • Shorter category description text will be needed in order to show it on a tooltip
  • No range of ratings will be displayed
  • Descriptions for rating values 1 and 5 only
  • Rating tool will float on the side of the article
  • Users can rate and add a comment at the same time
  • If users comment, their ratings will be visible, otherwise the ratings will only be averaged
  • New page that displays all the rating comments with ratings. Readers can flag it for admin review
  • Ratings will be only in whole numbers (1 - 5), but averages will be displayed at the resolution of 1/2's
  • Use stars and half stars to indicate ratings
  • Admin needs to be able to delete ratings and comments that are flagged
  • Ratings may be displayed on browse page
  • Will have highest rated articles published in last 4 weeks tab on home page
  • Rating tool will have a link to a static page with a explanation of the terms and rating categories
  • User cannot delete his ratings, only change them
  • On article page, display average rating in all 3 categories, overall rating, and number of users who voted
  • On other pages (browse, home, etc.) display overall rating and number of users who voted

Categories

Insight

How thought provoking is the article?
1 - Bland. The article provides a insignificant incremental advance on the published literature.
5 - Profound. The article substantially deepens or alters current thinking in the topic.

Reliability

How reliable are the results and conclusions?
1 - Tenuous. The results are preliminary and will need confirmation.
5 - Unassailable. The results are high quality, the reasoning is tight, and the conclusions are very solid.

Style

How well presented is the paper?
1 - Crude. The technical accomplishment and presentation of the study are of low quality
5 - Elegant. The study satisfyingly presents the results of technically accomplished and expertly executed experiments.

Weighting

When calculating an overall rating, we'd like to weight the different categories as follows:

  • Insight : 6/15
  • Reliability: 5/15
  • Style: 4/15

Attachments