KNN PBI

Wow, I'm really excited about this! Finally I have a better idea where to focus my benchmarks. =) [1]

What k are you using? And is DrussGT getting k/2 because there's nobody above him, or still getting k, but all below him?

Voidious‎

(Well, I mean, I'll know where to focus once you've run about a million more battles... ;))

Voidious‎

Sorry I missed this...

Right now I'm using k=sqrt(opponents), and it just chops it off. So the top bot gets k/2, second bot gets (k/2)+1 etc.

Skilgannon‎

I just discovered that my numpy conversion had broken the KNNPBI completely, so I've fixed that and re-run all of the rumbles. Now that it is using numpy, it should give nice symmetrical results (although KNNPBI isn't really symmetrical, by design, but now they are consistent).

Also, looking at the code, k=sqrt(len(bots))/2

Skilgannon‎

Hi, the KNNPBI doesnt work for DeepThought (http://literumble.appspot.com/BotDetails?game=roborumble&name=cb.DeepThought%201.0)... any idea why?

Cb (talk)‎

I'm not sure, I'll look into it this evening. How long has DeepThought been in the rumble?

Skilgannon (talk)‎

Since 15:13, 24 May 2013.

Sheldor (talk)‎

OK, I've made some changes in the way the batch rankings (KNNPBI, ANPP, Vote) are calculated. Notably, the memcache is set using different sized batches and while I was messing about I made Vote account for ties (so it should be more stable). I'm not sure if this will fix the scores for DeepThought since I'm not really sure why they aren't being saved, I'll check back in a few hours to see if it worked. I know DeepThought is definitely getting the scores calculated because the ANPP and Vote show up in the main rumble score, so clearly it isn't being saved somehow.