Darkcanuck/RRServer/Updates

21-Oct-2008: After the Upload

SVN Revision 27.
Importing all data from ABC's server is finally complete.
Re-enabled bot removal function
- Old bots (from import) now removed from rankings
- Ranking data (eg. #pairings, aps) will update once each current bot gets at least one new battle
Found and resolved another performance issue (now that we're nearing the million battle mark).
Tweaked a few other database queries.

SVN Revision 25.
Added ABC's amazing LRP plots.
Slowly importing data; about 60% (?) done for the main rumble
I have an idea to speed up scoring/uploads, but it's major work so not this week...

SVN Revision 23.
Based on | ABC's announcement, relaying is now turned off for faster uploads.
Importing is still in progress:
- Minirumble finished yesterday.
- Roborumble is only 30% done, lots of battles still left
- I also need to import any new battles since the 7th
Importing is a great high-load test; improved upload speed in a few areas, but it can still slow down if several clients (including the importer) all try to upload simultaneously.
- The bottleneck is the rating update process, querying all pairings for the two competitors is expensive.

Finished testing import utility (just a Perl script) which takes battles_*.txt files and re-submits them to the server.
All battle data from ABC's backup directory was imported to the new server this morning.
Nanorumble data as of 15:30 PDT imported to new server (starting small).
Currently importing Microrumble data... complete!
Minirumble and Roborumble will take quite some time, I think. Normal results uploading may be slow during this period ... --Darkcanuck 01:19, 9 October 2008 (UTC)

SVN Revision 19
Fixed a major bug introduced in rev 11 where new upload users could not be added.
Tentative PL scoring column added to ranking table
Added some additional stats to the details pages, including standard deviation for APS.
Added import functionality; currently testing an import of ABC's data on my local test server.

SVN Revision 14 15
Pairing and battle detail views can now be sorted like the rankings view.
- Finally you can group your worst ProblemBots together!
- PBI, Expected scores still use Glicko ratings, looking for feedback now that both Elo & Glicko are displayed together.
Added Glicko-2 ratings; uses existing Glicko rating as initial value. Let's see how this works out.

SVN Revision 11
Added Elo scoring based on old server's code.
- Includes rating "jumpstart": bots with >50 battles start at an ideal rating based on APS.
- This is causing slower uploads but should clear up once all bots get Elo ratings.
Ratings updates now done after every upload (no more periodic update).
Ratings use all available pairings for each update (slow, but this is the classic method).
Streamlined battle results table to use only one record per battle (was two); user data now in separate table.
- Table size down to 30% of previous.

Added priority pairings and battle number output to clients. I missed this last time around.
Tweaked database performance for results uploading.
Ratings rebuild has caught up, so rankings are now up-to-date within the last minute!
Melee rankings are starting to fill out.
Many thanks to GrubbmGait and [Darkstorm]] for generously contributing battles

One week, 4 clients uploading without any major issues. 68,148 battles in the general rumble so far.
No outstanding "known" bugs at this point (fingers crossed).
Added Glicko ratings and flushed existing pairings & ratings yesterday. That means the ratings are still rebuilding, and will probably catch up sometime tomorrow.
Added table sorting on the main rankings pages.
Added support for melee (works) and teams (my client doesn't work for teams so this is untested).