RMS Home | Guide Writing | Test Server | New Servers | Latest Reviews

Author Topic: Having trouble understanding the Rankings /swt  (Read 1069 times)

0 Members and 1 Guest are viewing this topic.

Offline bleu

Having trouble understanding the Rankings /swt
« on: Dec 20, 2008, 12:43 am »
The default Ranking is 6 months sorted by Total Score.

What is Total Score? How is it calculated? What's the difference between "Total Score" and "Average Rating" for the period selected?



p/s: hope this is the correction section.

RateMyServer Ragnarok Community

Having trouble understanding the Rankings /swt
« on: Dec 20, 2008, 12:43 am »

Offline yC

Re: Having trouble understanding the Rankings /swt
« Reply #1 on: Dec 21, 2008, 12:58 am »
total score is the total amount obtained from adding every review score. 

i.e. if there are 3 reviews for the server and the scores are 91, 85, 100.  the total score will be 91+85+100.

Average rating is the total score divided by the number of reviews ( [91+85+100] / 3 in this example) to get the percentage such that it is always 100 or less.

Offline bleu

Re: Having trouble understanding the Rankings /swt
« Reply #2 on: Dec 24, 2008, 06:33 am »
Thanks for clarifying this.

Additional question: Wouldn't the current ranking system (by total score) be bias towards larger population servers?


Assuming the followings:
- each servers tries to encourage its players to write reviews legally (just general, non-intrusive and non-incentivized reminders)
- the percentage of reviewers over the total population players is constant (not every player will spend time writing a review). I.e., the larger your player population, the more reviews a server will likely receive.
- current system favors Quantity over Quality. As of today, AnthemRO has 72 reviews. It's ranked 5th on the Low Rate Default Ranking. It's Average rating is 71. On the other hand, a smaller server like SerenityRO has managed to obtain 53 reviews with an average rating of 88. By using the default ranking system, any review is good - coz, good or bad; it still adds to the "Total Score" contributing a minimum of 10 points each review... and in AnthemRO's case, it might be just enough to be listed as a TOP 5 with >20 less than average review (flagged with the option of owner comments). Of course, one could always argue, a reader could always click in AnthemRO's server page- note the average rating and peruse through six pages of comments.


Another way of looking at things:
When applying to college, instead of using GPA; we introduce Total Points. Student A, takes 5 subjects and achieved a Total Points of 450. Student B, enrolls in 10 subjects and achieved a Total Points of 500. According to the Total Points system, Student B is better than Student A; even though he/she may have failed in several of his/her subjects.


Offline yC

Re: Having trouble understanding the Rankings /swt
« Reply #3 on: Dec 24, 2008, 03:55 pm »
i know ... but there isn't any easy way to optimize the result.

Say for example only rank by the average: server with one perfect review is going to be at the top while server with multiple reviews not all perfect will stuck at the bottom for having more reviews. 

A weight to the number of review added to the average would be okay though I don't want things to get too complicated for the general users to understand.