Bug?

Jump to navigation Jump to search
Revision as of 25 March 2013 at 12:26.
The highlighted comment was created in this revision.

Not sure if its a bug with RoboJogger, RoboRunner, or my robot. However I'm getting spurious results vs some bots.

For example vs Tron 2.01 in the TCRM challenge I'm getting an average of 87% percent when running 10 seasons manually, but in RoboJogger I'm getting an average of 61%.

I'm running Robojogger on the Mac, latest version of Robocode. I'm aware that Tron seems to be quite a slow bot, I was wondering if my bot was generating skipped turns for some reason as my bot is not too fast either. Notably in Robocode I am not generating any skipped turn events from what I can see. How do I access the Roborunner bot output? Is there a way or not?

    Wolfman08:56, 25 March 2013

    Manually means running by hand in Robocode directly FYI incase it was unclear. :)

      Wolfman09:00, 25 March 2013
       

      Oooh just saw there was a Robocode update that fixes some skipped turns, it literally came out today so I'm going to re-test with that and see what happens!

        Wolfman09:04, 25 March 2013
         

        Tried the new Robocode version and I'm still getting the same result - running manually in Robocode gives a higher score by around 25% for my bot vs Tron compared to running in RoboJogger. :(

          Wolfman11:12, 25 March 2013
           

          Are you sure you're using the same scoring mechanism? I know the TCs define score as TOTAL_BULLET_DAMAGE/ROUNDS.

            Skilgannon12:02, 25 March 2013
             

            Yes, the setup for the RoboRunner config file is using AVERAGE_BULLET_DAMAGE. Note that the results for all the other bots in the challenge look correct. It only appears to be vs Tron for some reason, which is why I postulated it was because Tron appears to be a slow bot which may cause skipped turns.

              Wolfman12:07, 25 March 2013
               

              It might be because Tron starts firing - if it doesn't get its config file which puts it in TC mode copied correctly, for instance.

                Skilgannon12:44, 25 March 2013
                 

                Yeah, I bet Tron is firing. Pretty dumb we don't just have a non-firing version in the TCRM downloads? Or do we? I remember doing that manually for a long time, anyway. Same with DT.

                Bot output doesn't go anywhere in RoboRunner. Actually not exactly sure how to catch it but it would be a nice feature. You could log stuff to files though.

                  Voidious13:18, 25 March 2013
                   

                  Makes sense, but I checked the .data directory for tron for the 4 instances of RoboRunner that RoboJogger generates and all of them have a properties file with "challenger" set. :(

                    Wolfman13:20, 25 March 2013
                     

                    Oh, hmm. That sucks. 61 is a pretty unthinkably low score vs Tron, looking at the TCRM results. I guess it would be useful if RoboRunner/RoboJogger had a switch for displaying battles to help debug this kind of thing.

                    Can you try running battles manually from one of those Robocode instances?

                      Voidious13:26, 25 March 2013