This is all true of course. My point is that the Nazi party existed to react and defeat communists. Without communism and the debauchery of the Weimar Republic which fed it, I don' think there would have been a Nazi party. The goal of the German Reich and the racial ideology all served the purpose of creating a state that could stand against communism foreign and domestic. Same thing with fascism in Spain and Italy, except they didn't have the weird racial views, as far as I know.
It's a complex question, and there were a lot of factors. Certainly the communists were a huge part of it, and the Red Front fighters were almost as big of troublemakers as the SA was. Their reputation was even worse. However, the German economy was also in horrifically bad shape especially on the inflation front, and the people were humiliated by and massively pissed off about the Versailles Treaty (and rightly so). They wanted radical change that got the economy under control and restored national pride, and the Weimar leaders has blown their credibility on both priorities. So my guess is that Hitler or somebody like him was coming to power either way - even without the communism factor, as big as it was.