Is there a mistake in Rumble battle staging

Jump to navigation Jump to search
Revision as of 22 February 2023 at 02:59.
The highlighted comment was created in this revision.

Is there a mistake in Rumble battle staging

Hi, I just looked at ranking of Vodious Jen http://literumble.appspot.com/BotDetails?game=roborumble&name=eem.zapper%20v4.41&order=-Battles

for a bot which is in the rumble for many years, there are quite a lot of opponents with which this bot has less than 5 matches and those are bots which are also in the rumble since forever.

I wonder why match selecting algorithm avoids particular bots. Is it normal?

    Beaming (talk)21:19, 19 February 2023

    What do you mean by avoiding particular bots. From the code, LiteRumble selects missing pairings first, then pairings with less battles, etc.

    Given enough time, each bot should have similar amount of battles.

    Anyway, it's not a good idea to rely on LiteRumble to accurately measure how good each small change of your bot is. LiteRumble is designed to give everyone a ranking, well suited when you have a big change (proven to be effective) and want to publish the result. Small changes are prone to noises from the rumble environment (e.g. running on different computers for different versions, having updated opponents), thus may report unreliable result.

    Rumble clients are also much slower than running battles locally (with RoboRunner), due to added network communication (which isn't parallelized), as well as running battles from other updated bots. One can also notice that once each bot reaches ~5000 battles, most battles are then nano battles instead of randomly distributed across the entire rumble, due to some "propagation" effect, further slowing down the stabilization of the general rumble.

      Xor (talk)05:46, 21 February 2023

      Ups, I posted wrong link to Jen rating, see http://literumble.appspot.com/BotDetails?game=roborumble&name=voidious.micro.Jen%201.11&order=-Battles

      I do use LiteRumble to check for my bot improvement (if I run clients anyway, why not update "real" rating). But the issue I report is unrelated to my bot.

        Beaming (talk)04:59, 22 February 2023
         

        as far as I can remember, some time ago (~1 year) there was a hickup which resulted in the strange rumblerankings. Bots had disappeared from the ranking, and when they came back after a battle, their stats against others was either complete or just 1 battle. Just can't find evidence of it on the wiki

          GrubbmGait (talk)09:28, 21 February 2023