Topic: Rating system
Posted at: 2019-07-01, 19:43
That would allow for a permanent rating system, on the website, and bring a bit more competitivity in the game (outside the tournaments)
After a bit of discussion with Worldsavior, he suggested using the Glicko system. The main advantage compared to something like ELO, is that Glicko tries to add variation for people that don't play a lot (which is pretty frequent in the widelands context compared to chess for example)
"The RD measures the accuracy of a player's rating, with one RD being equal to one standard deviation. For example, a player with a rating of 1500 and an RD of 50 has a real strength between 1400 and 1600 (two standard deviations from 1500) with 95% confidence. Twice the RD is added and subtracted from their rating to calculate this range. After a game, the amount the rating changes depends on the RD: the change is smaller when the player's RD is low (since their rating is already considered accurate), and also when their opponent's RD is high (since the opponent's true rating is not well known, so little information is being gained). The RD itself decreases after playing a game, but it will increase slowly over time of inactivity. "
How we could envision a rating system without changing anything in regard to game and server:
We create a new page, specifically for ranking, when you click on it the first thing you see is the current rank of everyone who's ranked. Preferentially in the playtime scheduler "index" page
If you want to be ranked too, there will be a "my rank" page accessible from there:
If we want more automatically update of games
It has also appear the website and the game are starting to be really synchronized (with the password with actual security for example). So I think it's a good time to start and discuss such system. Maybe there could be a way for the website to know directly who you player against and the score of the game? That could pose some problems when the game bug and the game has be restarted?
Posted at: 2019-07-01, 20:25
I thinking starting one myself (with elo, because it's what I know). problems are twofold: 1) most people play very little. 2) different win conditions make for very different games.
those two obstacles always stopped me
Posted at: 2019-07-01, 22:14
If anyone is asking himself which version of Glicko was suggested: It was Glicko2. Might be not the perfect rating system for Widelands though; I'd be interested in suggestions for a better one.
But I guess that if it will be good if both players have to agree before every match about that? It would be a nice additional feature if one could still play unranked matches.
One important thought about the ranking system: It should be forbidden to artificially decrease or increase the rating, and this behaviour should be prevented by punishments.
You also know Glicko2 very well I think that Elo would be not so good, because it takes more time until the real ranking gets achieved... Maybe you can work with trimard together
One could give every player one rating number for each win condition, similar to one chess website which uses one rating number for each chess variant.
Wanted to save the world, then I got widetrackedTop Quote
Posted at: 2019-07-01, 23:44
I also thought that. but seriously, there are few enough people that can be ranked for autocrat. how many games of wood gnome or territorial time are played?
Posted at: 2019-07-02, 00:26
Yes I agree with kind of nowhere on that point. We don't have enough players and games played of each type to do more than one ranking.
I think we should allow people to play any type of game, and that would count at the same weight. The principle isn't only to have a good rank, but to promote play. I feel like limiting player as to what they can't play, isn't really helping at that.
At the same time, the less rules we put, on which game can be played, the less representative it becomes...
What about actually two ranks? Competitive and general:
No idea if we could have enough players. Though, we should keep in mind, such system has for main interest also to attract new players
@king_of_nowhere you think ELO is better?
Huh, didn't think about that. How do you fear people will cheat? Fake games between themselves?
Huh, well that really brings the interest to an automatic system... But before that... How do you suggest punishments?
Edited: 2019-07-02, 00:29
Posted at: 2019-07-02, 12:44
The rating system topic is going back again. Good. That means that we need that in the game.
Unfortunately we don't have any well known rating system for teams or multiple players at once. Maybe other games has this solved already? Recently I have seen that Age of Empires II game was restored (HD version) and has pretty good amount of plays every day. Maybe they did some ratings already? (They also are playing 1 vs 1 and teams)
Another thing is idea how to validate the results. There are few possibilities (that came to my mind):
First, we can send all replays to the server and an administrator will go through the replay and see who played and who has won. It takes lots of time, but for sure make cheating almost impossible.
The more we automate, the easier will be to cheat. But should we consider cheating in the first place? I am not saying "no" to this, but rather "let's try and see what is needed".
Edited: 2019-07-02, 12:44
Posted at: 2019-07-02, 13:45
league of legends used a ranking (it still uses one, though it's hidden), and it is based on the team average, so it is possible to do it. it's going to be a problem if we have to adjudicate the ranking of new people entering in a team game, though.
I would avoid human intervention in checking eveyrthing. too complex, and too dependent upon an individual willing to spend time to do it. I also would not worry too much about cheating in this early stage, because frannkly, I don't think there's enough of a reason to cheat here. And if someone do try to cheat at their ranking, send them against worldsavior or me, it should rectify the matter
I don't know the alternative system, so I cannot judge.
Posted at: 2019-07-02, 14:15
Thanks to Einstein13 I realized there was already a topic on implementing such system from... 2010.
A few things to get from there:
Might take a lot of time from that administrator. But yeah that avoid problems
I think that's much better, with an arbiter looking at the replay if a problem arise.
What about this: each game have a hash. We give one way or another for a player to get the number of that hash.
Now after you played the game, you send to the server: Hash + result of your game.
If it appears there is a problem with that game. Players are invited to send the replays to the arbiter. This one first check that hash correspond to game and then go on to judge about the problem.
TBH, I prefer this idea even more. But how do you think it can be abused?
Yes, but there is no 1vs1 AFAIK? Or do they have different ranking in function of the mode in which you're playing 1vs1 or 5vs5?
Yes, but I think as a first stage and prove of concept it would be pretty useful!
Yes! Even in the tournament I think you said you never actually needed an external arbiter. And we can still implement anti-cheating system afterward
Edit: If nobody has a problem with Glicko2, I think we should start with that system.
Edited: 2019-07-02, 14:16
Posted at: 2019-07-02, 17:19
As far i know GGZ was an external service for online gaming with the ability to rank players. This was used by widelands for some time (don't know how long), but the ggz service was discontinued. No idea why. The only resource i found is an old manpage. All other links seems to be dead...
Fight simulator for Widelands:
Posted at: 2019-07-02, 21:17
Not many games, as far as I know. But different rating numbers could encourage to play even more, like "I'm not so good at autocrat, so I'm trying to become highly ranked in collectors".
Even on imbalanced or inofficial maps? I think that they shouldn't become rated. If you really want you could start with only one rating, and as soon as it seems pointful to create a second rating number for another win condition one could still split that.
Yes, that could be a problem.
I don't know how to apply a 1vs1-rating in a match with more players. A possibility would be to use an own rating number for 2vs2 and maybe another one for 3vs3 and so forth
The rating system could encourage more playing. And if tournaments get ranked, it's already a good number of games ...
Yes, if somebody lets the other always win and the winner continues with getting this free wins it's cheating from both sides.
First of all the changes of rating points should get reverted. Other punishments would be temporarily bans or in really bad cases permanent bans...
Before I forget it: It can also happen that somebody who is about to lose quits the match and never continues it. After a while this should be considered as loss...
Age of Mythology used a rating system which also worked for 2vs2, 3vs3 and so forth, this is really not rare. But I don't know how it works...
Yes, replays are very useful if someone refuses to answer...
It may be possible to implement the rating system first and to implement anti-cheat-measures afterwards.
So you meant that you don't know it well enough, I see...
Wanted to save the world, then I got widetrackedTop Quote