Testbed

Jump to navigation Jump to search
Revision as of 24 October 2017 at 00:28.
The highlighted comment was created in this revision.

User:Xor recently brought a discussion about building a good testbed in 1v1 which had a big impact on the way I build my 1v1 tests.

Now I question the same about melee. I build like three different beds after each minor release in RR:

  • 5 HOF
  • 2x (1 bot I lose against, 1 DrBob, 2 bots I score less than 60% and the rest is random)

This was a very simple strategy that I use until today and that rarely helps me distinguish the difference between two adjacent versions. Now I feel like I have to step up on this matter instead of releasing a bunch of versions everyday to evaluate it against the whole population.

Do you guys have any strategy to build melee testbeds that are worth sharing?

    Rsalesc (talk)22:52, 23 October 2017

    I usually use a mix of the top nano bots (because they let me run battles faster).

    My usual test bed doesn't contain a single robot more than once. A diverse test bed seems to be better. If you really want to focus on a certain task, e.g. dodging HOT bullets, I can also recommend running battles in a 800x800 battlefield with 3 HOFs. This simulates the "middle game" where the weak bots are already dead and you have to fight to get into the 1vs1 stage.

    My standard test bed looks like this: 1000x1000 HOF, DustBunny, Infinity, DoctorBob, Wallaby, KomoriNinja, Lib. This collection covers 80% of all melee movement and targeting styles. Sometimes I include SittingDroid to see whether I can fire at him fast enough. Sometimes adding a rammer is interesting too. I can also recommend testing a simple bed with nano and micro bots, and afterwards testing the same bed but replacing one of them by a top melee bot to see how your bot compares to that one.

      Cb (talk)01:28, 24 October 2017