scale standard deviations to 1

Jump to navigation Jump to search

scale standard deviations to 1

Good to hear that some experiment was done with this rule-of-thumb. Anyway, did you find that improve your performance? Or some weight re-tune is needed imo.

Btw, are you using some online standard deviations algorithm and update the knn weights on the fly, or just do it offline with pre-collected data?

Xor (talk)01:52, 27 October 2017

You do not have permission to edit this page, for the following reasons:

  • The action you have requested is limited to users in the group: Users.
  • You must confirm your email address before editing pages. Please set and validate your email address through your user preferences.

You can view and copy the source of this page.

Return to Thread:Talk:Firestarter/Version History/scale standard deviations to 1/reply.

Well, that's the easiest way I can think of... And it really surprised me that the standard deviation is almost the same for most bots. If so, then I think normalising standard deviation may not be that useful — since we already tune weights very hard. But for neural networks, I think this is invaluable, since we don't tune weights manually, and that would affect the learning speed a lot.

Xor (talk)10:56, 27 October 2017

I never thought about normalizing standard deviation for neural networks, because they should adjust themselves to the attributes anyways. But yeah, the learning speed is probably affected by it, I should consider that for further NN experiments :D

Cb (talk)14:15, 27 October 2017