Great work Siphon.
I think a better balance chart would involve match up between levels, not between ranks [...]. This is how I believe the matchup tries to match people, not on rank.
Thanks!
Well, actually its neither, matches are supposedly made between players of a similar (hidden) ELO value.
This works out (at least for lower levels) so that roughly people of similar levels are matched, but it depends on the faction matchup as you can check
here. For example, OH players seemed to be predominantly matched with USF players that are about 1.5 levels lower than them.
However, two details about levels, relevant in this context are:
- For ranks below 201, levels and ranks are more or less the same thing: A rank 200 OH player and a rank 200 UKF player both have rank 16.
- The problem at the ranks around 200 is that depending on the number of players for the specific ladder, certain levels are missing.
In the post I linked above I got around that by looking at top % (quasi levels) as well as top ranks. But in the end, the thing you'd really need is a significant number of samples between players on the same skill level; which of the four values that I give there reflects that best is up for debate.
The main point I'm trying to make in this post is that any statistics from automatch (regardless if you do it like in coh2charts, or like I did in beforementioned post) will be heavily influenced by matchmaking. In fact, the matchmaking is tasked to nullify any differences in balance and what you are left with are scrambled remnants of balance, combined with other matchmaking shortcomings. So, I'm not saying those are meaningless, it's just not the hard truth about balance that people often use it as in discussions.
Plus what Momo said in the other thread...