Rating not being updated?
- Created Monday, February 8th 2016 @ 15:12:48
The current version of my bot has around 90 games played over the last couple of days, but the leaderboard only shows 8 games as having been played. Is anyone else seeing this too?
- Created Monday, February 8th 2016 @ 15:35:08
Same here, has been like this for close to a week. Probably the main reason I was able to stay at #1 for this long.
- Created Monday, February 8th 2016 @ 18:27:32
For my bot it seems that only the automatic games being played count towards the number of games played shown on the leader board (and your profile page). Do you count the bots you challenged manually towards those 90 games too?
My bot has only played 3 of those "automatic" games in the last 12 or so hours, so the number of games played that is shown for my bot is low too.
- Created Monday, February 8th 2016 @ 19:21:46
Yes, I noticed also that my score changes independently of manual matches. I also tried to notice if it updates after N games but I think not. It seems updated either after random matches only or at regular time intervals.
- Updated Monday, February 8th 2016 @ 19:34:45
The ranker has been updated to discard results stemming from challenged matches when calculating a players rank. This due to the fact that the challenge feature makes it possible to exploit a bot's specific behaviour, thus making it possible to violate the fifth rule listed under site rules:
Entries which are deemed to violate the spirit of fair and sportsmanlike competition will be disqualified from all (future) competitions without any opportunity for appeal. In particular, memory scanning, intentionally losing games, and behavior conditional on the opponent's identity are prohibited.
- Created Monday, February 8th 2016 @ 19:40:58
Ok, that makes perfect sense! Is there any consideration to limiting the number of challenges, then? Because while challenges are useful to test, it seems like they might be being abused (8/9 of my matches are challenges, most of which I am be the one being challenged). Assuming challenges detract from the number of "legitimate" matches, I would pick more "legitimate" matches over being able to challenge people, but that's just my personal opinion.
- Created Tuesday, February 9th 2016 @ 19:17:23
I hope that the number of challenged games does not affect the number of scheduled games (as melsonator assumes), because that in itself would be a way to influence the leaderboard: by challenging a lot of opponents when you are at the top of the leaderboard, you could prevent any scheduled games from happening.
Nevertheless this seems to be the case: my bot is also challenged a lot, and it played only 11 scheduled games in the last 45 hours. That's way too few to move up or down on the leaderboard.
By the way: It would also be nice to see in the game log which games are scheduled and which games were challenged, and by whom. And to be able to filter on these two categories.
- Created Tuesday, February 9th 2016 @ 19:29:03
We're aware of the fact that there are not enough ranked matches being played. Adding server capacity is on the roadmap for early next month.
- Created Wednesday, February 10th 2016 @ 13:19:44
According to my stats, using all played games,and all versions, this would be the current ranking. To overcome potential cherry picking, the average score against every other bot (both with O and X) are seen as two games played.
1 2291 HalesJewett v29 (95) 2 2046 TripleBot v38 (101) 3 2018 Dolan v94 (574) 4 1979 Kaasschaaf v29 (638) 5 1881 SimulatedButter v8 (68) 6 1840 luckman_Ultimate v26 (43) 7 1839 Jaeger v47 (12) 8 1822 Toast v119 (75) 9 1818 WildCat_Ultimate v5 (339) 10 1784 AJuin v19 (70) 11 1719 lemonade v16 (272) 12 1716 TeaTime v13 (46) 13 1704 yergicoltest v12 (119) 14 1700 ButterCheeseEgg v16 (27) 15 1686 chianti_Ultimate v28 (171) 16 1682 Ultimus v12 (247) 17 1680 Daybreak v43 (21) 18 1662 Suodeth v24 (124) 19 1567 Gynther_Ultimate v10 (72) 20 1554 MapleSyrup v32 (310) 21 1546 tvv766_Ultimate v8 (16) 22 1529 TikTak v23 (4) 23 1483 Mqthiqs v22 (25) 24 1456 RandToe v11 (18) 25 1426 tonkstactoe v46 (134) 26 1406 Azerbaijan v32 (51) 27 1404 PrimaBot v0 (491) 28 1381 jesmiatka v2 (398) 29 1380 toddler v8 (197) 30 1379 Lennier_Ultimate v12 (10) 31 1348 ClockworkOrange v5 (242) 32 1342 PHPDefenderBot v21 (32) 33 1328 Wimpie v21 (2) 34 1323 supinf_Ultimate v3 (26) 35 1308 yawbym_Ultimate v7 (312) 36 1291 AaronTheApe_Ultimate v2 (102) 37 1283 TDUB v9 (279) 38 1268 HAL v23 (50) 39 1259 tidebot v24 (196) 40 1174 Slava_Ultimate v7 (19) 41 1167 Puzzle84_Ultimate v14 (214) 42 1164 Washington v38 (183) 43 1133 mvakili_Ultimate v1 (11) 44 1126 ShallowBot v81 (90) 45 1055 IAmHungry v5 (184) 46 1043 SemicedevineWL_Ultimate v1 (171) 47 1026 UltiTactical v0 (230) 48 994 jim_Ultimate v1 (225) 49 990 freshlight_Ultimate v2 (15) 50 981 TicTacDawg v0 (218) 51 962 BH4_Ultimate v23 (152) 52 946 CaveUltimate v2 (173) 53 875 Taccer v7 (98) 54 791 Eifjeifje_Ultimate v0 (31) 55 397 pixartist_Ultimate v10 (120)