Is there a mistake in Rumble battle staging

Jump to navigation Jump to search
Revision as of 23 February 2023 at 18:27.
The highlighted comment was created in this revision.

Is there a mistake in Rumble battle staging

Edited by author.
Last edit: 05:00, 22 February 2023

Hi, I just looked at ranking of Vodious Jen http://literumble.appspot.com/BotDetails?game=roborumble&name=voidious.micro.Jen%201.11&order=-Battles

for a bot which is in the rumble for many years, there are quite a lot of opponents with which this bot has less than 5 matches and those are bots which are also in the rumble since forever.

I wonder why match selecting algorithm avoids particular bots. Is it normal?

    Beaming (talk)21:19, 19 February 2023
    Edited by author.
    Last edit: 05:57, 22 February 2023

    What do you mean by avoiding particular bots. From the code, LiteRumble selects missing pairings first, then pairings with less battles, etc.

    Given enough time, each bot should have similar amount of battles.

      Xor (talk)05:46, 21 February 2023

      Ups, I posted wrong link to Jen rating, see http://literumble.appspot.com/BotDetails?game=roborumble&name=voidious.micro.Jen%201.11&order=-Battles

      I do use LiteRumble to check for my bot improvement (if I run clients anyway, why not update "real" rating). But the issue I report is unrelated to my bot.

        Beaming (talk)04:59, 22 February 2023

        OK, a thought the missing pairings is related to your bot (which just get updated), but it turns out to be an ancient one.

          Xor (talk)07:06, 22 February 2023
           

          If you look at Jen pairing, you will see almost 200 bots, with which it has only one pairing. This is not normal for a bot which is many years in the rumble. http://literumble.appspot.com/BotDetails?game=roborumble&name=voidious.micro.Jen%201.11&order=-Battles

            Beaming (talk)06:54, 22 February 2023
            1. We need to find out whether they have only 1 pairings 10 years ago. If so, we could add back the missing pairings from backup.
            2. From the code, "Battles" is merely a counter. If it shows 1 pairing, then there must be data loss unless it's 1 initially.
              Xor (talk)07:10, 22 February 2023
               
               

              as far as I can remember, some time ago (~1 year) there was a hickup which resulted in the strange rumblerankings. Bots had disappeared from the ranking, and when they came back after a battle, their stats against others was either complete or just 1 battle. Just can't find evidence of it on the wiki

                GrubbmGait (talk)09:28, 21 February 2023
                  Beaming (talk)05:03, 22 February 2023
                   

                  The pairings are already missing in 2021, so it mustn't be resulted from the 2022 hickup http://web.archive.org/web/20210127174934/http://literumble.appspot.com/BotDetails?game=roborumble&name=voidious.micro.Jen%201.11

                    Xor (talk)07:18, 22 February 2023

                    A strange thing is that most pairings wit 1 battle (of nz.jdc.nano.NeophytePattern 1.1) are either 2020.10 or 2022.3 (which is the exact time the last hiccup happened). This may indicate that the loss of pairings are resulted from restoration process.

                    http://literumble.appspot.com/BotDetails?game=roborumble&name=nz.jdc.nano.NeophytePattern%201.1&order=-Battles

                      Xor (talk)07:44, 22 February 2023

                      Would it mean that there is a lingering database which has old pairing number? I.e. literumble thinks that there are plenty of pairing (thus not asking for more battles) but it shows in the stats only actual ones.

                        Beaming (talk)15:56, 22 February 2023

                        No, you can clearly see from the code that all data is saved into bot.PairingsList, which gets overridden each time a new battle is ran. So if a pairing is missing, the data may not be lost, but if a pairing shows 1 battle, then that's all LiteRumble has.

                        Skilgannon once said that he had backups. We could ask help from him and do a merge, e.g. take whatever pairing with max battle counter.

                          Xor (talk)04:09, 23 February 2023

                          Then it must be a bug in the pairing selection algorithm which some how avoid certain bots. Do we have old data or not is irrelevant, if bot has low pairing that it should be scheduled for a battle, which does not happen with the old bots.

                          Currently if you put a new bot in the rumble, it usually fighting non stop for at least for a several thousand battles with different opponents. So at same point it would have more battles then old ones like Jen.

                          For example, the bot which I put a couple day ago http://literumble.appspot.com/BotDetails?game=roborumble&name=eem.zapper%20v4.44&order=-Battles already has at least 9 battles with everyone. So I would think Jen or nz.jdc.nano.NeophytePattern would be already scheduled to fight some one for the 2nd battle, but this does not happen.

                            Beaming (talk)20:27, 23 February 2023