scale standard deviations to 1

Jump to navigation Jump to search

Yes, I think you mentioned this rule-of-thumb somewhere on the wiki, (or was it somebody else? not sure now) thanks for that. I found that improve my performance. However, I focused on becoming stronger against surfers, which made me weaker against non-surfers.

I just run a battle against some bot, collected the standard deviations and afterwards divided each attribute by the respective std deviation. I found that now the standard deviations remain pretty close to 1 against most bots.

Cb (talk)11:26, 27 October 2017

Well, that's the easiest way I can think of... And it really surprised me that the standard deviation is almost the same for most bots. If so, then I think normalising standard deviation may not be that useful — since we already tune weights very hard. But for neural networks, I think this is invaluable, since we don't tune weights manually, and that would affect the learning speed a lot.

Xor (talk)11:56, 27 October 2017

I never thought about normalizing standard deviation for neural networks, because they should adjust themselves to the attributes anyways. But yeah, the learning speed is probably affected by it, I should consider that for further NN experiments :D

Cb (talk)15:15, 27 October 2017