Is there a mistake in Rumble battle staging
The highlighted comment was created in this revision.
Hi, I just looked at ranking of Vodious Jen http://literumble.appspot.com/BotDetails?game=roborumble&name=eem.zapper%20v4.41&order=-Battles
for a bot which is in the rumble for many years, there are quite a lot of opponents with which this bot has less than 5 matches and those are bots which are also in the rumble since forever.
I wonder why match selecting algorithm avoids particular bots. Is it normal?
What do you mean by avoiding particular bots. From the code, LiteRumble selects missing pairings first, then pairings with less battles, etc.
Given enough time, each bot should have similar amount of battles.
Anyway, it's not a good idea to rely on LiteRumble to accurately measure how good each small change of your bot is. LiteRumble is designed to give everyone a ranking, well suited when you have a big change (proven to be effective) and want to publish the result. Small changes are prone to noises from the rumble environment (e.g. running on different computers for different versions, having updated opponents), thus may report unreliable result.
Rumble clients are also much slower than running battles locally (with RoboRunner), due to added network communication (which isn't parallelized), as well as running battles from other updated bots. One can also notice that once each bot reaches ~5000 battles, most battles are then nano battles instead of randomly distributed across the entire rumble, due to some "propagation" effect, further slowing down the stabilization of the general rumble.
as far as I can remember, some time ago (~1 year) there was a hickup which resulted in the strange rumblerankings. Bots had disappeared from the ranking, and when they came back after a battle, their stats against others was either complete or just 1 battle. Just can't find evidence of it on the wiki