I know how to read a graph, mate. But I am still talking about the graph that plots game rank vs win rate. This one contains by far the most information.
I understand
No it does not. These cherry picked players are the same that you find in the top 5% of the graphs and therefore the region that I am talking about.
True. The difference is that their games are cast, uploaded to YT and can be analysed! My whole point is that this is probably the only way to improve an already pretty well balanced game.
Tournaments are additionally held on only a couple of maps which further scews the outcome in case one of them is slightly unbalanced. Additionally, the "form" of the player is way more important since they are a snapshot of only 1-2 days. If you're playing Asia/Oceania but the tournament runs until late evening in European time, the cherry picked players from Asia will have a disadvantage because they will play their games in the middle of the night. Did not sleep well that day, had a cold, a stressful day at work, argument with your family? Well suddenly the player's favourite two factions will get an additional loss. The game size is small. The only thing that tournaments have going for them is that the skill gap is - assumingly - smaller, but that's all.
I agree with everything above. That is why I wrote in the previous post that this is the best we have. Probably far from ideal but if AE cantinues his tourney quest (fingers crossed) there will be so much more material soon.
Most, if not all, other factors still apply (they still run via Relic's servers, there can still be a bugsplat.
True - but I really think that the number of problems and random loses is greatly reduced. I don;t really think anybody playing in the tourney will have a baby on their lap, will have to open the door to a mailman or answer an urgent phonecall.
And quite famously, in game bugs as it happened in Luvnest vs Asiamint. All these weight actually MORE than in the 15k game sample), but with a smaller sample size and that actual RNG has more weight.
Yes, but because such games are cast you can always just delete their result (a bugged game) from the stats.
You said you know your statistics, so give an actual reason as to why all this does not apply instead of sentiments and statements.
I feel I answered above.
The "silly matchmaking" is a fair point, but as I said: At the edged of the graph this happens to all players, therefore all factions have higher winrates at the top 10% of players. There is no good reason to assume that this happens more often to one specific faction than another.
Yes and no. When you have a bigger sample the result will be better/more realistic. You have many games as Soviets and many fewer as UKF or USF. Also there might be players who play only Soviets and manage to enter the top zone only with one faction. They are usually worse players than those who play all factions (tourney guys, for example). Anyway, this is the variables thing. It is really impossible to predict what strange constellations of factors might influence that. It may or may not be faction strength related. Looking at those graphs my bet is that there are simply more Sov players and the peak is less sharp because of that (quite typical in stats).
If you know statistics you should also know that - for the most part - the tournament matches are a subsample of the data that SiphonX visualized, but slightly scewed due to the tournament environment.
But it is a cherrypicked subsample that will grow in time. And this is the sample that can be reviewed under microsope
. You will know if a match was won or lost because of specific strat, early game failure, simply a bug or some non balance related mistake or rng or some period of player godmode. It is impossible to determine balance problem or faction strengths only basing it on such graphs (sadly).
Alright, then give a reasoning as to why all this is wrong. Just saying "it's wrong" does not make it wrong. You also focus on the end of the graph - but don't say anything to my points regarding the top players.
Yep. I guess top really is a bit more solid. Still, just like I wrote earlier, not solid enough imo to draw conclusions. Assuming that all those top players keep switching factions and have all their stats there....nah. Probably one army players blur the picture there - that is my guess. They probably play Soviets as their main faction and enter the zone with them only. Their other played factions are further behind on the ladder (especially their axis), maybe even 100-200 positions lower or even not existent at all - this way they don't lower other armies performance in the top of the graph. This way their other armies stats don't lower other armies performance, but their Soviet performance lowers the graph. This together with more Soviet players makes the peak lower. But that is my guess as I can't verify it.
Those random elements have been addressed already as above. I agree that the bigger sample size is better, that's why SiphonX's data is better. You specifically claim that the more games were played, the closer the win rate is to 50%. Let's have a look: For OST this is true, SOV has the most games from Allied factions yet differs the most, UKF and USF differ the least yet have the least games played.
Are these differences significant? You say no. The honest answer is: We don't know for sure. But it's a lot of games, and the differences in the top player department is between 5-10% with 15k games played. The drops and other random mishaps that you mention are likely a very minor fraction of all these games.
I don't think that his data is better from the perspective of assessing balance. It is because you don;t really know who is in the top mix. There might be people who play only one or two factions, unlike in the tourney where players are usually really good at playing all armies. When such people enter the top of the graph they will blur the picture. And yes, the honest answer is we don't really know. In tourneys you know these things.
If it came across as if these is the be all end all conclusion, then this was not intended. But if a faction performs the worst with both high end low skill players, it's a decent hint that this faction might be weaker than the other factions.
It doesn't have to be like that, especially if the faction was the first faction introduced into the game. Their playerbase may be bigger. This will usually lower the peak of the Soviet graph.
This data is not the perfect set to prove faction strength, but at some point you have to see that your initial argument is based on your personal "game experience and my tourney and cast observations" stating that "Soviets are much more forgiving and generally easier to play with than OKW". You said I can't conclude from a simple graph how easy it is to play a faction, yet you do it from what? The 100-200 games a CoH2 fan can play in a month maximum (unless you have a full month of free time) + the 50 you watched? How do your observations suddenly beat data from 15k games? You said you know your statistics, but this is fully ignoring good scientific practice. You even agreed that the matchmaking will even things out for the majority of all players. So how does your personal game experience then translate into actual balance knowledge if you additionally have to filter out that all your matches were decided by the matchmaking algorithm to give you a chance of roughly 50% (I am assuming at this point that you are not in the top 5-10% of players)?
These stats would be ok if every player played all factions imo. If you have players playng only as Soviets, or only as allies/axis the stats will always be not informative enough. in tourneys players are forced to switch sides and this makes the difference imo (plus the fact that you can actually watch the game)
And again: How can you say that tourney stats could be a decent basis with those few games, split across 5 different factions and a small player and map pool, but then say you agree with the spreadsheets author that the games and players in his (much, much larger) data are possibly not enough to draw conclusions?
Nothing of this adds up.
Tourneys make players switch sides so they have to play at least one axis and one allied faction. IMO it changes a lot as the same player tests both sides. In the graphs there probably are quite a few players who play only one faction or their ranks with (usually axis factions?) are below the top tier. They blur the picture of balance in the graphs. We don't know how many such players there are even in the top tier. I also don't know if the players whose ranks got hidden with one army are in the graph.
(Sorry for a lot of repetitions)