Is there a mistake in Rumble battle staging

Jump to navigation Jump to search
Revision as of 21 February 2023 at 03:46.
The highlighted comment was created in this revision.

Is there a mistake in Rumble battle staging

Hi, I just looked at ranking of Vodious Jen http://literumble.appspot.com/BotDetails?game=roborumble&name=eem.zapper%20v4.41&order=-Battles

for a bot which is in the rumble for many years, there are quite a lot of opponents with which this bot has less than 5 matches and those are bots which are also in the rumble since forever.

I wonder why match selecting algorithm avoids particular bots. Is it normal?

    Beaming (talk)21:19, 19 February 2023

    What do you mean by avoiding particular bots. From the code, LiteRumble selects missing pairings first, then pairings with less battles, etc.

    Given enough time, each bot should have similar amount of battles.

    Anyway, it's not a good idea to rely on LiteRumble to accurately measure how good each small change of your bot is. LiteRumble is designed to give everyone a ranking, well suited when you have a big change (proven to be effective) and want to publish the result. Small changes are prone to noises from the rumble environment (e.g. running on different computers for different versions, having updated opponents), thus may report unreliable result.

    Rumble clients are also much slower than running battles locally (with RoboRumble), due to added network communication (which isn't parallelized), as well as running battles from other updated bots. One can also notice that once each bot reaches ~5000 battles, most battles are then nano battles instead of randomly distributed across the entire rumble, due to some "propagation" effect, further slowing down the stabilization of the general rumble.

      Xor (talk)05:46, 21 February 2023