Good Jump

Fragment of a discussion from Talk:SimpleBot
Jump to navigation Jump to search

It's simply because I finally decided to try some kNN instead of random ;) It's still very simple without any kernel density; ) And I'm really excited and expected to see your new bot beating this! :D

Xor (talk)11:37, 25 August 2017

Right now it has some fast learning problems like getting beaten against Walls or SpinBot in the first round=). Maybe I'll do some adaptive learning rate.

Dsekercioglu (talk)12:13, 25 August 2017

Yes neural networks are typical experiencing a hard time at the initial ;p How many layers are you using? Would you try using two networks, one fast learning, one deep learning?

Xor (talk)15:58, 25 August 2017

It is a perceptron with some pre-processing. I can try deep learning. It may be useful at hitting simple=) movements.

Dsekercioglu (talk)18:05, 25 August 2017
 

I tested it with some tuning. It can't pass my Anti-Surfer Gun against any sample bot.=(

Dsekercioglu (talk)19:19, 25 August 2017
Edited by author.
Last edit: 21:07, 25 August 2017

Have any of you had any success with a DC+NN gun? I got my NN gun working pretty well against surfers and, even though my DC gun is still doing better, I think I can improve it enough to surpass it. But it performs really bad against random movers compared to my anti-random gun, even when I set up more than one NN, like in Gaff. Does that combination make any sense?

Rsalesc (talk)20:08, 25 August 2017
Yes it makes sense. I once got +%5.2 APS by getting the sum of Anti-Surfer and Anti-Random weighted by their hit rates. (The old gun was just AS).
Do you use pre-processing in your NN? It can be really helpful.
Dsekercioglu (talk)20:30, 25 August 2017

I'm not sure what you mean by pre-processing. Can you clarify that?

Rsalesc (talk)21:10, 25 August 2017
    • For example you have two attributes x, y
    • Use some formula on it.
    • For example input = {|x|, |0.5 - x|, |1 - x|, |y|, |0.5 - y|, |1 - y|}
    • Give it to the Neural Network
Dsekercioglu (talk)22:46, 25 August 2017

Yeah, I did this. My worry about NN + DC gun is exactly because of this. The backprop algorithm gets really slow as my NN grows in the number of perceptrons, my general purpose DC gun is pretty slow and my anti-surfer DC gun is blazingly fast. When I put my AS NN together with my general purpose DC gun, I have to decrease the size of my NN and/or decrease the complexity of my training process to avoid skipping turns, which turns out to reduce my score. I was just wondering if the training process really needs to be that complex, or if I have room to improve other things like this pre-processing step or something like that, put that together with a very simple training process and still get a good result against surfers without using another NN, for example.

I just found it amazing that you and Darkcanuck could get such good results with NN. I found it really hard to debug and to work on compared to DC, since there is a lot of things you can tweak in a neural targeting system. Congrats for that, and I hope to see Xor results on his NN experiments soon as well :P

Rsalesc (talk)23:10, 25 August 2017

Yes of course you can get a good score against surfers with an only NN. After only tuning against Shadow I got a %74.2 score against him.

I don't know what type of pre-processing you use but mine uses gaussian function instead of abs as above. Maybe you should try it.
Remove some data and try it again. Some data slows down NN learning.
Change your training process. For example don't train your NN when enemy doesn't have any waves to surf.
Try to find an error in your NN. ColdBreath is the fixed version of Havoc(116th) whose backpropogation was wrong.
By the way congrats with Roborio. Really High PWIN.
Dsekercioglu (talk)11:46, 26 August 2017
 
 
 
 
 
 
 
 

I now beat SimpleBot with %57 both by Damage and Survival=). Maybe I'll pass you again.

Dsekercioglu (talk)14:53, 26 August 2017

Good result! SimpleBot's movement is not tuned at all (surfing last hit & 1 nearest neighbor gf) and I'm rewriting it ;)

Xor (talk)14:56, 26 August 2017

My gun just uses 5 input and movement uses 4 input. I didn't increase the number of features which will increase my performance %100. I will rewrite surfing too.=)

Dsekercioglu (talk)15:03, 26 August 2017

my movement uses just 3 inputs ;) my gun was using just 5 inputs too ;)

Xor (talk)15:05, 26 August 2017