Cache effects on benchmark

Jump to navigation Jump to search
Revision as of 17 July 2013 at 00:37.
The highlighted comment was created in this revision.

Cache effects on benchmark

I was thinking that running *just* the benchmark vs a single tree at a time would result in the KD-Tree code and data being cached quite a bit better than would be realistic for real-life situations. Perhaps it would make more sense to run all of the trees at the same time, giving each tree the new search/data one tree after the next. This would simulate the cache thrashing between turns that happens when you are running multiple robots at the same time, because the trees would be competing with each other for cache space.

Thoughts?

The reason I ask is that I designed/wrote a tree to deal with the cache problem. It outperforms Rednaxela Gen2 on large (2mil points, 12 dim) random datasets by ~2X, but ties on smaller (30k point, 12 dim) datasets. I think the fact that for the small dataset the entire thing is in cache might be causing the difference.

    Skilgannon (talk)21:03, 16 July 2013

    Maybe using a reference bot would make benchmarking more meaninful?

    Pick one bot, put each tree inside it, one at a time, and run it against a 1v1 test bed.

      MN (talk)01:37, 17 July 2013