Talk:RoboRumble

RoboRumble history

April 27 2005 - The RoboRumble@Home server is now moved to Pulsar's machine. See /TemporaryServerUp for the RR@H settings files to use and some more details. The only difference you should note is that the flag-less bots no longer have the Jolly Roger flag. This is temporary and will be fixed soon. Huge thanks to Pulsar for carrying the burden (reponsibility-wise) a while with this. I'll sleep tighter now when I don't need to worry if my WinXP Home PC (yes, it was hosted in such an environment before!) is awake and responsive. -- PEZ

October 28 2005 - The RoboRumble@Home server will be down for several hours for upgrades tomorrow (Saturday Octber 29). As a side effect this will solve the issues some people have with port 8080. --Pulsar

October 29 2005 - The RoboRumble@Home server is going down shortly and will be up and running again within 12hours hopefully. -- Pulsar

October 29 2005 - The RoboRumble@Home server is up and running. Updates are needed for RoboRumble@Home clients. -- Pulsar

February 18 2006 - The RoboRumble@Home server connection might experience some downtime the following hours as I will reorganize the firewall setup. --Pulsar

March 7 2006 - The firewall switch over has now finally been done, and everything seems to be working. Some people might experience a short delay until DNS records have been updated around the world (though they were and are set to a very short "time to live" to minimize this). RoboRumble@Home clients need to be restarted as Java by default caches DNS lookups. --Pulsar

Subpages

Should we replace ALL of the subpages? or just the 'important' ones? -- Starrynte 22:16, 17 November 2007 (UTC)

Name

Since the new wiki supports symbols in page names, should we put this page at RoboRumble@Home instead of RoboRumble? We already have a redirect from that page to this one... --AaronR 23:34, 17 November 2007 (UTC)

I second this change. » Nat | Talk » 02:30, 28 April 2009 (UTC)

RR seems to be down

Roborumble is returning 503 Unavailable for all pages today. Not sure why. -- Synapse 03:07, 19 September 2008 (UTC)

Are you sure? Both rumble.fervir.com and ABC's work for me. -- KetsuNfwu 03:33, 19 September 2008 (UTC)

I fail. I meant Robocode Repository. -- Synapse 05:44, 19 September 2008 (UTC)

Not a big surprise there. =P -- KetsuNfwu 13:21, 19 September 2008 (UTC)

Hi! What the heck happened to RR@H again? The main roborumble has only ~60 bots again... Otherwise, I uploaded Pugio 1.2 1 week ago and has only 120 battles in nanoRumble. Situation is the same in Darcanuck's page, too. Nobody is contributing?--HUNRobar 12:30, 11 October 2008 (UTC)

Both ABC's server and DarkCanuck's server have no full pairings yet. Once the megabots have full pairings, the minirumble will get filled completely and as last the micro- and nano-rumble. Be patient, but it probably requires a few weeks before all nanobots have 1000 battles. Remember, 640 * 640 bots means a lot of battles! Pulsar's server has another issue. I don't know what happened, but I still run (repair)battles there. --GrubbmGait 13:14, 11 October 2008 (UTC)

I realised that in Darcanuck's server the older versions of bots are still in game. I think the competitors there should be cleaned up. For example, I don't want to generate battles for Pugio 1.0 when I wait for the results of 1.2. --HUNRobar 14:57, 11 October 2008 (UTC)

That's a temporary thing -- I'm uploading a huge amount of data from ABC's server which includes old participants. There's a big performance hit to activating/retiring participants repeatedly, so for now everyone's in the rankings until I get caught up. But don't worry, no rumble clients will actually run these bots. They'll use only the version from the participants list. In a few days you should see the old bots disappear from the rankings. --Darkcanuck 15:03, 11 October 2008 (UTC)

Whoops edit conflict, accidentally overwrote Darkcanuck's reply with this: "What versions get battles doesn't depend on the server, it depends on the participants list that clients are configured to (which should be the old wiki's one, the one here has not been synced for a long time). The server would have nothing to do with that so you shouldn't be generating battles for Pugio 1.0 unless your client is misconfigured I believe." Anyways Darkcanuck's reply clearly explains why there are currently old versions listed :) --Rednaxela 15:10, 11 October 2008 (UTC)

Ok, thanks but I'm very excited about the results of Pugio 1.2. :)--HUNRobar 17:40, 11 October 2008 (UTC)

Why can't I access ABC's server? My connection get timeout before it finished loading! -Nat 12:42, 6 January 2009 (UTC)

Lynch the Multi-Threaders!

A thought just occurred to me. I have never liked the fact that robots could be threaded. Why?

1. On a single-core (non-hyperthreaded) machine it cannot help the bot without hurting the opponent. Either a) all computation is done on one CPU during your turn, in which case you could have done the same computation with less overhead without the threads, or b) you do computation past your turn, eating up CPU cycles from your opponent.
2. On a multi-core (or hyperthreaded) machine, it violates the idea that all bots are equal except for their AI. You suddenly get 2 CPU's in your robot, essentially.

This is a reality we have had to live with, because that's the way robocode is designed. HOWEVER - it just occurred to me that we could enforce a rule saying that no multi-threaded bot is allowed in the rumble! Which I hereby propose. Besides being unfair to the bot's opponent, acting like a virus stealing CPU, it steals CPU from bots in OTHER battles now-a-days when more than one rumble client executes at a time on multi-core machines! Any bot caught using multiple threads would be immediately removed from the rumble. Does anybody agree? --Simonton 02:47, 23 September 2008 (UTC)

Agreed. It isn't fair on the opposition, and makes it impossible to design a bot within the CPU-constant constraints. --Skilgannon 10:34, 23 September 2008 (UTC)

I either didn't see or forgot about this section. There are already bots that use multiple threads in the rumble: Toad definitely does, possibly X2 (which shares some Toad code), and probably others. Not sure how I feel about removing them at this point, just contributing some facts here... --Voidious 02:20, 7 August 2009 (UTC)

Well, there are java APIs that allow things like only measuring the time used in a particular thread. Robocode could start to use these in order to make this fair, AND as a major bonus it would make using Robocode on a computer with a heavily loaded CPU not cause skipped turns. The issue is... those APIs don't give the same kind of resolution, thus meaning that the only way we do it would be if we calculated something more like "How much CPU time did threads of this bot use in the last 20 ticks?", instead of "How much time did this robot take between the start and end of this turn?" which would make skipped turns behave a bit different. Personally I think that may not be such a bad thing, but I'm not really entirely sure... --Rednaxela 02:51, 7 August 2009 (UTC)

It looks like this » Nat | Talk » 12:53, 7 August 2009 (UTC)

Hm? "ERROR This artifact is not accessible." is what that page gives --Rednaxela 13:11, 7 August 2009 (UTC)

Sorry, I never noticed that this is 'private' tracker... Fnl thought that he needs more precise time and mem.usage detection. I have a comment on some time measuring much like to your "How much CPU time did threads of this bot use in the last 20 ticks?". However, we didn't mention a thread at all. But I believe that Robocode allow Robots to create up to 5 threads, I'll email Fnl this. » Nat | Talk » 13:53, 7 August 2009 (UTC)

The tracker is public now. :-) Basically, I want to measure the CPU usage with the new features in Java 5.0 for measuring the exact CPU per thread. Hence we will (when using the TheadMXBean) know for a fact exactly how much time all threads in a robot is using in total. However, the time interval when measuring using the ThreadMXBean is big compared to what we are used to with the CPU constant currently used in Robocode. So we need a solution that can deal with this issue. I have waited with this improved feature as this will have a big impact on the scores for the robots in the RoboRumble. We have already seen how much difference the getNextVelocity() makes, so imagine the difference when we make change the concept behind the CPU constant. --Fnl 21:07, 7 August 2009 (UTC)

Personally, I'm actually not too worried about the impact of this change. Most bots don't skip many turns at all, and the effects of a few skipped turns are often overstated. As long as the average amount of CPU allowed per tick is still similar, I can't imagine it affecting scores too much. I suppose it might have a big impact on bots that abuse the currently untracked multi-threading, but I think we can all agree that they're sort of abusing the system right now, anyway. Of course, I'd be happy to run extensive tests, too. =) --Voidious 21:55, 7 August 2009 (UTC)

I'm agreement with Voidious on this. I doubt there would be any problems caused by this so long as the correct amount of time was chosen. I would say though, that I think that this feature should be targeted at a 1.7.1.5 release, for the same reason that it's generally considered bad practice to change both a bot's movement and gun in the same rumble iteration, haha. As a side note, I wonder if while we improve the measurement method to not be affected by other things on the system, that maybe we should also improve the cpu constant calculation. For one, it should use the same ThreadMXBean methods to be accurate, but also I wonder if we could have a more realistic benchmark of what a typical bot actually does with it's time. I propose we include a small suite of some of the things a more cpu intensive bot does in order to create a more representative benchmark. I propose coding a small suite consisting of something like the following: 1) KD-Tree, 2) Nanobot-style pattern matching, 3) Array operations (searching for peak, addition of a gaussian curve to an array, multidimensional array access), 4) 'Play-It-Forward' simulation, 5) GF calculation (aka simple trig). I think I'll begin a page for comments on and code for an improved benchmark --Rednaxela 00:00, 8 August 2009 (UTC)

1.7.1.5? It was there for about eight months. I think maybe 1.8 or so... » Nat | Talk » 06:10, 8 August 2009 (UTC)

What Now?

How can I submit the new versions of DrussGT and Cunobelin? Has anybody heard any news on the old wiki? Will it be recovered? Is it gone forever? --Skilgannon 15:47, 8 December 2008 (UTC)

Well on November 30th I emailed PEZ and got a reply that it's an ugly error and that he'd look into it. I haven't heard anything since but I guess I might email PEZ again. I certainly hope it won't be gone forever as I'd at least like to have a read-only version due to how much great stuff there is there that's unmigrated. --Rednaxela 16:12, 8 December 2008 (UTC)

I really hope the old wiki content still lives on. In the meantime we could agree to use this wiki's list for my server. I don't have time this week to make the proposed participant list changes, but I could lock out add/removes for all but a few select clients to make sure we all use the same list? --Darkcanuck 18:28, 8 December 2008 (UTC)

Well, the old wiki is back! I do wonder though, should we switch to using this wiki's participants list anyway? or should that wait till some other day in the future? --Rednaxela 18:17, 9 December 2008 (UTC)

I'd like to keep using the old wiki at least until I can code up something to validate participants on the server side. Then it would be easier to switch and not have to worry about some clients using the wrong list. --Darkcanuck 05:39, 10 December 2008 (UTC)

Random question: How much do you think the local client would speed up if I compiled it natively? Right now, we haev a bit of a bottleneck figuring out battles andif we could speed it up by a factor or 3 or so, why not? --Miked0801 21:52, 25 May 2009 (UTC)

Nanos get little love when things get busy

I've been waiting for nearly 4 days for my latest bot to get to 2k battles against nanos, and I'm probably gonna have to wait 3 more for it to happen. Why? Nanos, after they get to their 1 battle per bot limit, are the last bots to be updated under the current system. I understand why the system was done this way, but is there anyway we can add a time component to the battle chooser to make sure that when things heat up in the rumble, nanos get some love as well? --Miked0801 20:47, 19 June 2009 (UTC)

I hear ya. Even in Mega-land, it can take a while to get to 2k battles, and I don't really trust a rating until it does (even with all pairings). There are some RR client options you could try, like excluding bots or running NanoRumble only, but the latter will just do random battles, I think. A couple of nice client side options, imo, would be mini/micro/nano while still honoring pairing priority, and ignoring pairings while running bots with under NUMBATTLES (in all applicable rumbles). I'm definitely in favor of RR contributors having control over what battles they want to run... --Voidious 22:48, 19 June 2009 (UTC)

Nanos get way more than their fair share of processing time. By a time a nano reaches 2000 battles in its own class, it has typically reached 5000+ battles in the main rumble. Few, if any, megabots have yet to reach that level. Not only is it unfair to folks releasing larger bots, it also takes away cpu time from other nanos. So should we abolish nanos? Of course not!

I'd vote for changing the client's battle selection such that when a new bot reaches full pairings, the remainder of its 2000 battles are fought against opponents in its own size class. Those battles will still count for the higher classes, so a nano would really only need 2000 battles overall. This would mean faster results for nanos and more cpu time for everyone else, regardless of size. --Darkcanuck 03:19, 20 June 2009 (UTC)

I second Darkcanuck's suggestion, as it seems most fair to me. :) --Rednaxela 05:12, 20 June 2009 (UTC)

And yet, some nanos love to beat up on their larger sibling... But yes, when things slow down, nanos do get a ton of extra battles, but to be fair, most nanos run much, much faster than megas so the hit isn't that bad. My main concern was waiting at the back of a line of never ending micro/mega selections. Impatients and such. If we're going to change things to minimize waits, then first completing pairings, then 2k in class, then low priority updates across other classes would be awesome. Unlike melee, just 2 or 3 battles with a mega are usually sufficient to get a strong idea of where things stand. --Miked0801 09:10, 20 June 2009 (UTC)

You can also set RUNONLY=NANO, but alas then no priority battles are fought, just random ones. And I set the battlecount to 1000, so nanos will get their battles earlier. --GrubbmGait 10:51, 20 June 2009 (UTC)

• setting RUNONLY=NANO is not a good idea. The results only count for nano, so is not counted at micro/mini/mega. Setting the battlecount lower does pay off however, except when the bigger rumbles are flooded with new versions. --GrubbmGait 11:00, 20 June 2009 (UTC)

It would be awesome if roborumble could execute smart battles with runonly parameters. For example, run prioritary battles but only among nanos. I don't think it would be such a difficult developement. --HUNRobar 14:33, 20 June 2009 (UTC)

I think the RUNONLY setting needs to be fixed -- as GrubbmGait pointed out, the battles don't get uploaded to the bigger size classes, which they should. I might put together a patch for this, but first I have some wave surfing to iron out... --Darkcanuck 17:41, 20 June 2009 (UTC)

About battlecount, one habit I have, is constantly making my battlecount set to just a little above the lowest value in the rumble. That seems to have nice results sometimes. --Rednaxela 16:03, 20 June 2009 (UTC)

All right, I think I've figured out how to implement the change I suggested, plus fix the RUNONLY problem. If enough people are ok with this, I'll put together a patched 1.6.1.4 client with the changes and send the patches to Fnl for future releases too. --Darkcanuck 18:21, 21 June 2009 (UTC)

Quick question: Would this only affect the 1v1 pairing order? I definitely support it there, but making your suggested change in Melee pairings would have a major impact on some bots' scores... And thanks as always for your RoboRumble efforts! --Voidious 19:33, 21 June 2009 (UTC)

Only at first. The game already does all class battles for roughly 50% of the numbers in nano now. That's why DustBunny has been slowly rising in APS - he does worse in nano only. --Miked0801 20:42, 21 June 2009 (UTC)

Well, right now a NanoBot gets 2,000 battles against the whole field, then a bunch against MiniBots and below, then MicroBots and below, then NanoBots. With this change, it would get some amount of battles against the whole field, then all NanoBot-only battles. Depending on the bot, I think it could have an impact. Then again, that's a quirky aspect of MeleeRumble that's tough to really regulate, anyway, so maybe it's not worth worrying about. --Voidious 21:51, 21 June 2009 (UTC)

Ah, good point, I hadn't considered melee. It does use a different routine for preparing battles though, so it's possible to patch 1v1 without affecting melee. Looking at the melee routine, it does create an interesting mix of battles -- I didn't realize that there were all-nano matchups. That must skew the scores depending on the ratio of battles a nano gets with mixed sizes versus all-nano? --Darkcanuck 02:15, 22 June 2009 (UTC)

I don't think it is a bug, i think it was made on purpose the way it is. Alas I don't remember the reason . . . --GrubbmGait 21:03, 21 June 2009 (UTC)

Mobile Devices

Who here things I'm crazy to try running roborumble on my Ipod Touch? :) --Rednaxela 02:01, 7 August 2009 (UTC)

• Definitely crazy. --Simonton

I think you're crazy, but only because the iPhone OS doesn't have Java. =) I actually just looked into this the other day, lol. Was there some tech you were looking at to make it work? --Voidious 02:03, 7 August 2009 (UTC)

Actually, when you don't limit yourself to the app store, there is a port of JamVM w/ GNU Classpath. There's no JIT so it won't be fast... but it'll run.. or... almost:

Iteration number 0
Downloading rating files ...
Downloading participants list ...
Downloading missing bots ...
Removing old participants from server ...
Preparing battles list ... Using smart battles is true
Prioritary battles file not found ...  
java.awt.AWTError: Cannot load AWT toolkit: gnu.java.awt.peer.gtk.GtkToolkit
   at java.awt.Toolkit.getDefaultToolkit(Toolkit.java:607)
   at robocode.security.RobocodeSecurityManager.<init>(Unknown Source)
   at robocode.manager.RobocodeManager.initSecurity(Unknown Source)
   at robocode.control.RobocodeEngine.init(Unknown Source)
   at robocode.control.RobocodeEngine.<init>(Unknown Source)
   at roborumble.battlesengine.BattlesRunner.initialize(Unknown Source)
   at roborumble.battlesengine.BattlesRunner.<init>(Unknown Source)
   at roborumble.RoboRumbleAtHome.main(Unknown Source)
Caused by: java.lang.UnsatisfiedLinkError: Native library `gtkpeer' not found (as file `libgtkpeer') in gnu.classpath.boot.library.path and java.library.path
   at java.lang.Runtime.loadLibrary(Runtime.java:763)
   at java.lang.System.loadLibrary(System.java:662)
   at gnu.java.awt.peer.gtk.GtkToolkit.<clinit>(GtkToolkit.java:173)
   at java.lang.VMClass.forName(Native Method)
   at java.lang.Class.forName(Class.java:233)
   at java.awt.Toolkit.getDefaultToolkit(Toolkit.java:583)
   ...7 more

It seems that both:

1. RobocodeSecurityManager is foolish and tries to query the default graphics toolkit even if run from the command line
2. The install of GNU Classpath is foolish and thinks it has GTK avaliable when it's running in command line only

Were it not for one or the other of those issues, it'd probably run just fine... Now can i fix this I wonder... --Rednaxela 02:13, 7 August 2009 (UTC)

Wow, that would be really cool. But I'm a wuss and I'm afraid to jailbreak and void my iPhone's AppleCare; I was thinking more from the perspective of writing an iPhone app myself that could do it. Good luck, though, I'm curious to hear your results! --Voidious 02:17, 7 August 2009 (UTC)

Aha! I got around that stupid issue! I just had to pass the VM -Djava.awt.headless=true... When you see rumble uploads with a user of "RednaxelaIPod", that'll be it :) --Rednaxela 02:32, 7 August 2009 (UTC)

Ouchie, building the robot database this first time sure isn't fast... --Rednaxela 02:39, 7 August 2009 (UTC)

Sadly, while it mostly ran, it didn't quite work:

java.lang.ArrayIndexOutOfBoundsException: 1
   at java.util.concurrent.CopyOnWriteArrayList.get(CopyOnWriteArrayList.java:27
5)
   at java.util.AbstractList$1.next(AbstractList.java:354)
   at robocode.battle.Battle.updateBullets(Unknown Source)
   at robocode.battle.Battle.runTurn(Unknown Source)
   at robocode.battle.Battle.runRound(Unknown Source)
   at robocode.battle.Battle.run(Unknown Source)
   at java.lang.Thread.run(Thread.java:743)

...

java.lang.NullPointerException
   at robocode.battle.Battle.updateBullets(Unknown Source)
   at robocode.battle.Battle.runTurn(Unknown Source)
   at robocode.battle.Battle.runRound(Unknown Source)
   at robocode.battle.Battle.run(Unknown Source)
   at java.lang.Thread.run(Thread.java:743)

...

Exception in thread "sul.Pinkbot 1.1" java.lang.NullPointerException
   at robocode.peer.RobotPeer.setEnergy(Unknown Source)
   at robocode.peer.RobotPeer.setEnergy(Unknown Source)
   at robocode.peer.RobotPeer.run(Unknown Source)
   at java.lang.Thread.run(Thread.java:743)
Exception in thread "serenity.moonlightBat 1.17" java.lang.NullPointerException
   at robocode.peer.RobotPeer.setEnergy(Unknown Source)
   at robocode.peer.RobotPeer.setEnergy(Unknown Source)
   at robocode.peer.RobotPeer.run(Unknown Source)
   at java.lang.Thread.run(Thread.java:743)

Though if a workaround can be found for those issues (most likely bugs in the version of GNU Classpath in question. May not apply to newer versions, or a patched robocode might be able to work around it), it may work. Not sure that'll be possible though. Oh well... --Rednaxela 03:54, 7 August 2009 (UTC)

Rumble Computers

I'm curious, what kind of computers are people using for roborumble? Voidious and Simonton seem to really have some nice ones I think. Personally the computers I have avaliable to run rumble consist of:

• Intel Core 2 Duo T5300 (1.73GHz), 2GB ram, laptop, usually avaliable
• AMD Athlon XP 2000+, 512MB ram, often avaliable
• AMD Athlon XP 2400+, 1GB ram, rarely avaliable

I would also have my wimpy iPod were it not for one little bug preventing successful running of bots in the VM installed there. Sometimes... I'm really tempted to get a brand new shiney quad core monster for the sole purpose of storing backups, and running RoboRumble/Research :) --Rednaxela 03:41, 16 August 2009 (UTC)

I have:

• MacBook 2.0 GHz Core Duo, 2 GB RAM, and I can run two clients on it safely. It's actually 3+ years old, but it holds up pretty well.
• AMD 2000+, 768MB RAM (Ubuntu 8.10), which I've been running a rumble client on almost 24/7 for a while now.
• Just yesterday, I ordered a MacBook Pro 2.8 GHz Core 2 Duo with 4 GB RAM. So that will more than double my total rumble power, I think. =)

I wonder what Corbos had, I couldn't have kept up with him if I tried when he was rumbling recently. I've also been tempted many times to spring for a quad core Linux box just for Robocode, but so far I've been able to resist... (mmm, quad core...) --Voidious 03:55, 16 August 2009 (UTC)

Haha... I unfortuantely can't run two clients on my Core 2 Duo laptop... the CPU just plain gets too hot. What I really want to see though, is MXThreadBean timing in a new robocode version, which would make it safe to enable the option to allow robots to run concurrently, when in rumble... Then one could take advantage of a 8 beast when running melee rumble with only one client... --Rednaxela 04:29, 16 August 2009 (UTC)

My client runs on an old laptop -- all it does is run roborumble + meleerumble:

• Intel Pentium M w/512MB ram, 100% available

Occasionally I press my main machine (MacBook Pro, Core 2 Duo, 3GB) into service, but mostly I need it for work or running RoboResearch (that's what it's doing right now, in fact). It's also where the development rumble server lives, so this client is normally pointed at that anyway. Running both I was able to keep ahead of GrubbmGait for awhile until Voidious et al made our upload counts look puny by comparison. --Darkcanuck 04:26, 16 August 2009 (UTC)

My client is a 2.66 Mhz Pentium4 (single-core) with 1GB. There was a time that I ran roborumble on a 400Mhz laptop with 128Mb using robocode 1.0.7. Btw, Darkcanuck, are you able to remove (or rename) those somewhat embarrasing contributions of GrubbmGait_15x and GrubbmGait_17x at the very low bottom. --GrubbmGait 11:08, 16 August 2009 (UTC)

Wow, 2.66 MHz!!?! :-D J/k. --Voidious 15:04, 16 August 2009 (UTC)

It's done. I merged GrubbmGait_15x into GrubbmGait_154, and removed the lone battle from GrubbmGait_17x (the upload still shows up, merged into GrubbmGait). --Darkcanuck 17:38, 16 August 2009 (UTC)

When I used to run it, I ran it on my Intel Centrino 2 P8400 2.26GHz with 4GB of RAM (but with 32bits OS it only sees 3GB) laptop, which I used for other works too. The time I run I only use FF to surf the web, but now I need to use Photoshop, Eclipse, LAMP and one virtual machine almost all the time so it doesn't available anymore. » Nat | Talk » 11:31, 16 August 2009 (UTC)

I run my client in a Pentiun Dual Core 1.86 GHz, and I usualy run 2 clients, but right now I'm using it to test several new versions of my robot, so the rumble has to wait...--Navajo 14:36, 16 August 2009 (UTC)

Lower Rank Limit?

Wouldn't it be reasonable to remove bots that gets negative ELO Rating (i.e elvbot.ElverionBot(ELO: -191.0) & ry.Worst 1.0 (ELO: -365.3) ) ?

They almost always score 0% and uses cpu-time while they contribute with near to nothing. --Rsim 15:37, 16 August 2009 (UTC)

Whoops

Err... sorry my client reactivated some old melee bots due to old data lying around, seems they crave pairings now... plus a large number of recently released melee bots... means sloooow melee right now... --Rednaxela 05:10, 10 September 2009 (UTC)

Iteration

I wonder if this happen to everyone or just me. When I run RoboRumble client, both 1.6.1.4 (which upload to darkcanuck's server) and 1.7.1.4 (which I use to test locally because it is faster), I found that after iteration 80 things got slower. I mean with 1.6.1.4 I can run 100 iteration in 4 hours, then another 4 hours it can run only 50-60 iterations. SO I tend to restart my client every 80 iterations. (and cool my hard disk down a little, it is around 80 degree Celcius when I run it for 150 iterations) Do anyone, especially who run RoboRumble overnight, have similar situation? --Nat Pavasant 03:10, 11 October 2009 (UTC)

I've found that 1.6.1.4 still seems to have some long-term memory leakage actually. Not as bad as older version, but enough that it's still worth not using the ITERATE option actually. --Rednaxela 03:54, 11 October 2009 (UTC)

JVM Crash

After running the RoboRumble client (1.6.1.4) for about 12 hours, my JRE crashed. I have not been able to reproduce the problem, but I thought I'd post about here in the event it has happened to someone before. I've submitted a bug report to Sun and saved the logs [Here]. It may not be relevant, but this happened when evaluating Krabb.sliNk.Garm 0.9u. --Christopher.Hilla 22:06, 7 February 2010 (UTC)

Huh... that's a very peculiar bug. I doubt there's anything more to it other than there being a bug in the JVM though, assuming this isn't something you're able to repeat reliably. --Rednaxela 22:48, 7 February 2010 (UTC)

Contributor's Sum

I started contributing less than 30 days ago, yet my "All time" and Monthly sums don't match. My "All time" sum is much larger than what I've actually contributed. Even though my point tally is sort of like keeping score on "Whose Line Is It Anyway", it's worth mentioning :) --Christopher.Hilla 06:49, 9 February 2010 (UTC)

The monthly and 30-day totals are based on battles, whereas the all-time list is number of uploads. For a 1v1 battle between megas there is only one upload, but for smaller classes there will be one upload per size class (e.g. two nanos will generate 4 uploads). Melee is even more complicated since a full set of pairings for 10 megas will yield 45 uploads, even more if there are smaller bots in the mix. So your all-time uploads should be greater than the sum of the battles you've contributed so far. --Darkcanuck 07:41, 9 February 2010 (UTC)

Thank you for the explanation. --Christopher.Hilla 19:49, 9 February 2010 (UTC)

Incomplete robot list

Hey Darkcanuck, I 've been running a few rumbles..and noticed I am missing a large number of bots " can't file specified file". Any Suggestions? Thx.. oh , I should mention Last night while Running an iteration envolving DR3.06 , Portia and 8 other bots. Something probably on my end screwwing up results for 1 battle. Not sure how, or why, but just one battle. -Jlm0924 20:06, 27 April 2010 (UTC)

DogmanSPE

I just ran a few tests to try and figure out the discrepancy between 1.8.0 and 1.8.2 of DrussGT, and now I can't repeat 1.8.0's results against DogmanSPE. I then decided to try a few rounds against Diamond 1.5.5, and it seems he also isn't living up to the scores he's getting on the rumble against DogmanSPE. The only thing I can think of is that it may be different versions of Robocode, as I'm doing my testing with 1.7.2b2. Any ideas? Maybe Dogman gets smart only at certain times of day? --Skilgannon 15:06, 9 May 2010 (UTC)

Eh, DogmanSPE is a major troublemaker and always has been. It sometimes doesn't crash, but when it does crash it crashes for every subsequent round of the battle. This makes it's results always unpredictable. It doesn't affect overall APS too badly because of the sheer number of bots, but it's probably the single worst offender in the rumble. Issues with DogmanSPE have been pointed out before. Personally, I'm in favor of removing DogmanSPE. --Rednaxela 15:25, 9 May 2010 (UTC)

So am I. Anyone object? --Voidious 17:28, 9 May 2010 (UTC)

Done =) --Skilgannon 19:17, 9 May 2010 (UTC)

LRP

Perhaps we should have a section on what the LRP does. I mean most of use from the old wiki know but... Anyway in the words of Paul,

May seems a stupid question, but, what is the blue line, and the 4 quadrants?
I can guess that on the X axis there is the expected score and on the Y the difference between expected and actual score.
But what the blue line is supposed to mean? -- [[Simonech]]

You are correct on the X axes and Y axes scales - the Blue line is a best-fit straight line through the data. if it has a negative
gradient slopes downhill (left to right) I believe it would indicate that the movement for the bot is stronger than the gun. A
positive gradient would indicate a good gun is being let down by relativley poor movement. -- [[Paul]]

— Chase-san 04:55, 4 July 2010 (UTC)

Rumble use of 1.7.2.1 Beta?

Guys, do you think that Robocode 1.7.2.1 will be good enough to replace the very old 1.6.1.4 for RoboRumble? If not, what must be done? --Fnl 22:06, 29 June 2010 (UTC)

The main problem I have with 1.7.2.1 is that objects from the data section in jars from inside zips at least do not get extracted to the cache. I also have problems with duplicate robots in the repository (mostly only ones on the development path). — Chase-san 00:57, 30 June 2010 (UTC)

Huh, I was under the impression that the data files were extracted properly still. (note, it's technically not a robotcache anymore). Also, what do you mean by duplicate robots, and is this different than older versions? --Rednaxela 05:30, 30 June 2010 (UTC)

Well, I haven't noticed any new problems myself, but I've yet to have a chance to test very extensively, but I plan to on what is a long weekend coming up here. I'm going to clear my localhost rumble server and re-run testing with the latest version. Does anyone thing it would be good if I opened up the 1.7.2.1 testing rumble server to the world so others could speed up the process of testing it? --Rednaxela 05:30, 30 June 2010 (UTC)

I think it would be good. I am more than willing help you. If not due the stability of internet connection of my server I would open a testing server ages ago (well, my server located at my school in the university's infrastructure which is like twenty years old or more). Just a side note, 1.7.1.x runs at least five times faster than 1.6.1.4. --Nat Pavasant 12:51, 30 June 2010 (UTC)

Okay. I will wait a little with releasing 1.7.2.1 so you guys get the chance of testing it a bit more. 1.7.2.1 is "just" replacing the Jikes compiler with ECJ + some bug fixes compared to 1.7.2.0. I have started working on the 1.7.2.2 with some new features + I try to improve the speed with loading/updating the development paths, which are loaded extremely slow compared to the .jar files. :-) --Fnl 19:57, 2 July 2010 (UTC)

Alright, I just moved the bots that are known to not work in 1.7 for "WontFix" reasons out of the participants list. Anybody mind? I kept them on the bottom of the pages with links to the SF ticket that's relevant. --Rednaxela 20:46, 4 July 2010 (UTC)

Okay, I now have a rumble test server facing the world on [[1]]. It should be secured and fast enough now, I think. Feel free to run 1.7.2.1 Beta clients on it for testing! :) --Rednaxela 21:56, 4 July 2010 (UTC)

I have my roborumble and meleerumble client pointed to your server now. --Nat Pavasant 13:29, 6 July 2010 (UTC)

Red, do you have any comparing method planned? The melee is almost completed, though it should need more before becoming stable. --Nat Pavasant 14:48, 12 July 2010 (UTC)

My current comparing plan is:

1. First look for obvious outliers (things missing from high ranks, things at extreme low ranks)
2. Then import the 1.6.1.4 rumble and 1.7.2.1 rumble results tables into a spreadsheet, sort each by name, line them up beside eachother, create a column for rank difference and PL difference, then sort by those to find outliers.
3. Test any outliers. Determine if it's a bug to report, or the bot doing something that it shouldn't

Currently, 1v1 rumble has two outliers at the bottom. I already reported the bug for one and it was fixed, and I think the other is breaking due to using File IO without using the proper robocode streams. About to do the spreadsheet with melee :) --Rednaxela 02:13, 13 July 2010 (UTC)

The biggest melee outliers by APS. Positive numbers mean improvement:

	Rank change	APS change
jab.DiamondStealer 5	145	20.07
gg.Squaraus 0.6	-72	-14.08
com.syncleus.robocode.Dreadnaught 0.1	49	9.40
stelo.Spread 0.2	62	6.34
bayen.nut.Squirrel 1.615	48	4.36
stelo.Moojuk 1.3	10	3.95
stelo.SoJNanoMelee 1.1	-23	-2.95
exauge.GateKeeper 1.1.121g	21	2.37
sgp.JollyNinja 3.53	18	2.12
lrem.micro.SpikeSoldier 0.4	19	2.00
sample.TrackFire 1.0	-0	-1.87

I suspect DiamondStealer may have had bad results on the main rumble server, and I suspect the APS differences below 3% are probably a fluke. Maybe some of the larger are too, but I plan to test Squaraus and Dreadnaught anyway. --Rednaxela 05:16, 13 July 2010 (UTC)

Dreadnaught also had bad results in the beginning (not complient to 1.5.4 I believe) --GrubbmGait 08:49, 17 July 2010 (UTC)

.NET

Is it possible to submit robots written in .NET to RoboRumble? --dserbia 15:18, 15 July 2010 (UTC)

No, not at the moment. We have to make sure Robocode 1.7.x reach the really stable phase before. And I think we should wait for jni4net to reach at least beta status, for Mono support. Many of high-contributing RoboRumble clients are running under either Linux or OSX. --Nat Pavasant 15:38, 15 July 2010 (UTC)

Thanks for the quick reply! --dserbia 17:21, 15 July 2010 (UTC)

Personally, I'm not sure I'd ever be in favor of allowing them into the rumble. There would then be bots in the rumble that Mac/Linux users could never test against (and there are a lot of us), and it would also make us dependent on .NET users to contribute battles for those bots when we post new versions of our own. But I do sympathize - if/when more .NET Robocoders come onto the scene, things could change.

Keep in mind that all of this stuff is community driven, though it may all seem very "official" to a newcomer. Anyone is free to setup a competition / tournament / rumble that includes .NET bots if they want! We've had tournament style competitions like the MiniBot Challenge and Twin Duel in the past, Robocode has APIs that make automating battles for tourneys fairly easy, and Darkcanuck posts the source to his rumble server somewhere (Nat or Rednaxela would know). And there's always Challenges you can compete in, too.

--Voidious 17:38, 15 July 2010 (UTC)

I think Pavel Savara has plan for suporting jni4net, which is the core of .NET Robocode, on Mono, which can be run under Linux and Mac OS X. I don't think there is a valid reason for not supporting those when that day come. --Nat Pavasant 06:57, 16 July 2010 (UTC)

Yeah, it could work out, but there's still lots of room for issues. How stable is Mono? Will Mono add behavior discrepancies to .NET bots? Or will Java bots hit subtle behavior discepancies when battling .NET bots on Windows? (Either of those could be very hard to debug for the bot author.) Will .NET bots run much slower when running through Mono? Will that count against them in terms of CPU time/skipped turns? We've seen plenty of issues just from different JVMs / CPUs / OSes, so adding Mono and .NET to the rumble definitely requires caution. Or it may work perfectly smoothly and we'll all coexist peacefully. =) --Voidious 15:18, 16 July 2010 (UTC)

As long as one isn't doing GUI or calls to native libraries (not allowed for bots anyway), I'm pretty sure Mono is quite accurately compatible, however my concerns are around the fairness issues. x86 Java is reasonably uniform in terms of what parts of the code get optimized how well by the JVM. As I understand, Mono's performance is pretty reasonable overall, however since it's coded from scratch it's optimization characteristics are notably different I think, which makes cpu fairness somewhat tricky for having MS .Net and Mono running the same rumble. If one looks at this, it's fairly old, but shows large performance differences going either way in terms of different types of operations. That exact issue only becomes larger between the JVM and .NET, so I really do think it makes sense for .NET to be kept to a separate rumble (possibly on the same server but separated like the different formats?). --Rednaxela 19:23, 16 July 2010 (UTC)

New Rumble

Rednaxela and I have been talking a bit, and we have put considerable thought into a new 1-vs-1 rumble. Unlike our current 1-vs-1 rumble, this would have no data saving, be single round battles on a 800x800 field. Also considering having the game 'white out' names in a battle to just numbers, so there can be no hard-coded specific bot data saving either. I personally feel this kind of 1-vs-1 competition would allow for much greater competition from non-adaptive movements, and lower the bar considerably for newer robocoders. But not too much, since obviously, Crazy would never be able to win over DrussGT.

We also considered non-random starting positions (for greater fairness) and a 4 bot single round melee on the same field size.

— Chase-san 16:16, 24 July 2010 (UTC)

Yeah, I think this would be a really neat thing to have. Now, I don't think it should replace the old-style rumble, but I think it would make a very interesting competition, and perhaps much less daunting for newcomers. And to clarify on what the "white out" of names, it means robot names that bots would see would just be like "1", "2", "3", or perhaps "robot 1", "robot 2", "robot 3". Now, that does require a modification to Robocode, but I think it would probably be relatively simple and quick to get implemented. (I say it should be simple because Robocode already alters names when multiple of the same bot are in a battle, so I'd imagine the same code path can be reused, so just a matter of changing it for a certain rumble flag) --Rednaxela 16:27, 24 July 2010 (UTC)

We have put togeather a seed of 60 robots, please keep in mind this is just a seed, and you can add your own robots when it gets started. This is just to round out the robots so that we can get some meaningful rankings.

abc.Tron 2.02
ags.micro.Carpet 1.1
ags.polished.PolishedRuby 1
apv.Aspid 1.7
apv.NanoLauLectrik 1.0
apv.ScruchiPu 1.0
ary.nano.AceSurf 1.2
axeBots.Musashi 2.18
axeBots.Okami 1.04
chase.pm.Pytko 1.0
cjm.Che 1.2
cx.Lacrimas 1.36
cx.mini.Cigaret 1.31
darkcanuck.Gaff 1.50
davidalves.net.DuelistMini 1.1
davidalves.net.DuelistNano 1.0
dummy.micro.Sparrow 2.5
gh.GrubbmGrb 1.2.4
gh.GrypRepetyf 0.13
jam.mini.Raiko 0.43
jk.micro.Toorkild 0.2.4b
kawigi.robot.Girl 1.2
kawigi.sbf.FloodHT 0.9.2
kawigi.sbf.FloodSonnet 0.9
kc.micro.Needle 0.101
kc.micro.Thorn 1.252
kc.mini.Vyper 0.311
kc.nano.Splinter 1.2
kid.Gladiator .7.2
Krabb.krabby2.Krabby2 1.9o
mld.Moebius 2.9.3
mue.Hyperion 0.8
mz.NanoDeath 2.56
pe.SandboxDT 3.02
pe.SandboxLump 1.52
pedersen.Ugluk 1.0
pez.mako.Mako 1.5
pez.mini.Tityus 0.9.1
pez.mini.VertiLeach 0.4.0
ry.VirtualGunExperiment 1.2.0
rz.Aleph 0.34
rz.GlowBlowAPM 1.0
sample.Walls
sample.Crazy
simonton.beta.LifelongObsession 0.5.1
simonton.micro.GFMicro 1.0
simonton.micro.WeeklongObsession 3.4.1
simonton.nano.WeekendObsession_S 1.7
stefw.Tigger 0.0.23
synapse.Geomancy 15
techdude.Carruthers 1.2.6
tzu.TheArtOfWar 1.2
voidious.micro.Jen 1.11
vuen.Fractal 0.55
wcsv.Engineer.Engineer 0.5.4
whind.Strength 0.6.4
wiki.BasicGFSurfer 1.02
wiki.mini.Sedan 1.0
wiki.nano.RaikoNano 1.1
zyx.micro.Ant 1.1

— Chase-san 17:36, 24 July 2010 (UTC)

1.7.x rumble eventually...

Hey guys... I kind of think I dropped the ball on working on getting 1.7.x to main rumble before... but I still think it would be good to eventually. Now... unlike before (where the rumble server was a little VM on my machine that I sometimes had to shut down for lack of memory), I have a more proper server I could use for rumble. I probably won't get around to setting this up till after winter holidays (have plans with family), but just wanted to ask, how much interest in this is there? Best Regards. --Rednaxela 07:29, 21 December 2010 (UTC)

I am still interested in. Right now (well, not really, since I am not actively writing robots), my movement predictor have flags for 1.6.1.4 or 1.7.1.3+ movement. Since rumble runs 1.6.1.4 but 1.7.x+ runs much faster. Also, the whole rumble would take less time to stabilised (but it would put more load to server, since client can run, as Pavel claimed, ten times faster. --Nat Pavasant 11:36, 21 December 2010 (UTC)

I'm still interested. Kept meaning to ask you why the test rumble server went down but never did. Do you still have all the results, or would we start from scratch? Anyway, it would be good to be current. A lot of new people get 0 scores because they use new APIs, plus there's the performance benefits. --Voidious 14:00, 21 December 2010 (UTC)

Yeah, I do still have the old data, but I'm not sure we want to use it. Presumably we'd want to test now with the very latest version, and mixing the results in this of multiple versions in this test could cloud results. --Rednaxela 14:59, 22 December 2010 (UTC)

Alright! I have a new rumble test server up and running at http://rednaxela-robocode.dyndns.org/rumble/. For ease of use, rumble configuration templates are linked from it's main page. Also, if you want, here's a convenient zip of all the bots currently in rumble: [2]. This one is located on a more proper type of server, rather than a virtual machine on my laptop. So... time to get testing 1.7.2.2 and prove it stable? :) --Rednaxela 06:37, 19 January 2011 (UTC)

Hm, I thought I had this page "watched" but it looks like I've missed a lot... Is the new server running the same code and database schema as the current one? --Darkcanuck 06:43, 19 January 2011 (UTC)

Yep, same code and database schema. The only changes I made were to the front html page, and changing the accepted version of robocode to 1.7.2.2. --Rednaxela 06:57, 19 January 2011 (UTC)

I found my old laptop, I will set it to run, I might tweak the CPU constant up a little too, since it is a older/slower machine. (I will just set it in my closet, away from hustle and bustle). — Chase-san 09:32, 19 January 2011 (UTC)

Nice! I'll start running my clients against this again. Thanks Rednaxela! Btw, the superpack .zip is gone from RoboRumble/Starting With RoboRumble. I'll make a new one with the above archive unless you could just repost the old one. --Voidious 14:47, 19 January 2011 (UTC)

It turns out both my laptops puked at some point while I was out (one locked up while loading rankings, the other I forgot to make a loop and iterate was NOT). Not sure if you still have to do iterate not, and make a script loop, but I did. Only my main system had kept running the rumble. But I restarted both of those now. — Chase-san 02:36, 20 January 2011 (UTC)

As far as I know, all the memory leaks have been fixed. I had my client run over the whole day and the memory use plateaued nicely with no issues whatsoever. --Rednaxela 02:39, 20 January 2011 (UTC)

Ah well, I will switch them to use ITERATE then. Thanks. — Chase-san 02:59, 20 January 2011 (UTC)

Is there anything that we're waiting on for the switch to the 1.7 rumble rankings? I'd love to help make this upgrade happen. Ncj 16:45, 4 April 2011 (UTC)

I know Rednaxela was investigating some of the outliers from the test server's rankings. I'm not sure there was really anything "stop ship" though. I think the rankings look pretty good. Rednaxela, what do you think? --Voidious 20:38, 4 April 2011 (UTC)

Well, here's the "Table of Anomalous Results" I made when the 1.7.2.2 rumble first stabilized:

	Old Rank	Old %	New Rank	New %	Rank Diff	% Diff		ABS % Diff	ABS Rank Diff	Explanation
CharlieN.Omega.Omega 1.03	319	55.29	774	9.19	-455	-46.1		46.1	455	tracker item 3207405
NDH.GuessFactor 1.0	787	0.42	578	39.54	209	39.12		39.12	209	uses post-1.6.1.4 functions
jeremyreeder.Vincent 2011.12.09	788	0	645	33.68	143	33.68		33.68	143	uses post-1.6.1.4 functions
Krabb.krabby2.Krabby2 1.9o	71	73.63	528	43.12	-457	-30.51		30.51	457
gg.Squaraus 0.6	714	26.3	786	4.62	-72	-21.68		21.68	72	tracker item 3207405
elvbot.ElverionBot 0.3	785	0.72	751	19.75	34	19.03		19.03	34	uses post-1.6.1.4 functions
TJ.Exupery 1.39	403	50.02	174	63.3	229	13.28		13.28	229
zh.UnderDog 0.0.2	782	4.31	762	14.11	20	9.8		9.8	20	1 on 5 exception in TacticalAdvisor in 1.6.1.4
reaper.Reaper 1.1	357	53.1	194	62.6	163	9.5		9.5	163	crashes on some clients in 1.6.14 but not 1.7?
sm.Devil 7.3	517	44.13	351	53.45	166	9.32		9.32	166	crashes on some clients in 1.6.14 but not 1.7?
xiongan.Xiongan 1.1	709	27.05	614	36.22	95	9.17		9.17	95
ag.Gir 0.99	762	13.25	739	22.26	23	9.01		9.01	23

The case of "CharlieN.Omega.Omega 1.03" was tracker item 3207405, and has been fixed in 1.7.3.0 Beta. Unfortunately I've yet to investigate the other results.

Some of positive results I suspect may have been from using some Robocode 1.7 features perhaps (i.e. some new events). The case of Krabby2 I in particular mean to investigate because that result looks quite odd. Some other positive changes like Devil seem strange to me, because Devil predates Robocode 1.7 by a huge margin, yet seems to do better than in 1.6 by a notable margin. I've yet to be able to figure that out either. Anyone have any theories or can look into these cases?

Anyway, presuming these issues can be worked out, what do people think of moving straight to 1.7.3.0 perhaps? The difference relative to 1.7.2.2 is small so I don't see it as that high risk, and if it turns out there were issues, then we're no worse off than if we had spent the same effort to test 1.7.3.0. Thoughts?

--Rednaxela 04:45, 5 April 2011 (UTC)

SmallDevil crashes on my clients (dunno about others), so his 1.6 score is probably just wrong. I'm probably OK with moving to 1.7.3.0, but I'd prefer to just go with 1.7.2.2 since that's the one we've actually spent so much time testing. The difference being small could support either decision. =) 1.7.3.0 is still beta, too. --Voidious 12:44, 5 April 2011 (UTC)

Well, of course some testing of 1.7.3.0 needs to be done, but that should be possible to complete before it's out of beta. I think it's changes from 1.7.2.2 are definitely seem small enough to me that it's not like we need to do a full rumble run again. --Rednaxela 13:23, 5 April 2011 (UTC)

The three bots 'NDH.Guessfactor', 'jeremyreeder.Vincent' and elvbot.ElverionBot' all use post-1.6.1.4 functions, no further investigation needed for them. SmallDevil indeed occasionally crashes, why it does not do that on 1.7.2.2 I don't know. I believe the same goes for 'reaper.Reaper'. Friday I will have some time to check other differences. Is there a possibility to check all '2100-0' scores on the server for a specific bot? A bad client on the moment of submission has a permanent influence now. On the old server (years ago) these bad results faded away with each new battle (0.7*0.7*0.7 etc). --GrubbmGait 18:35, 6 April 2011 (UTC)

I suspect SmallDevil just crashes due to some corrupt saved data, tho I haven't investigated it. I've seen the same with other bots, like TheBrainPi. I wiped my robotcache today so I'll watch out for SmallDevil battles from me with any new bot releases. --Voidious 00:30, 7 April 2011 (UTC)

Interesting. Tomorrow I think I'll be able to look into these more, especially Krabby2 I think. --Rednaxela 05:00, 7 April 2011 (UTC)