Inconsistent APS with LiteRumble
From Talk:RoboRunner
Jump to navigation
Jump to search
Revision as of 22 December 2022 at 06:28.
This is the thread's initial revision.
This is the thread's initial revision.
Quoted from APS:
The server calculates APS for each bot by:
- taking the average percentage score of all battles against each opponent separately to get an APS for each pairing,
- then averaging all pairing scores to obtain the final average.
Formally, it's
mean(challenger_score / total_score)
for each pairing.
LiteRumble seems to follow this algorithm.
However, RoboRunner is using:
sum(challenger_score) / sum(total_score)
instead for each pairing.
This causes scores calculated by RoboRunner to be different from LiteRumble.