I am a huge proponent of free speech but an even bigger proponent of good government. I don't believe that the result of these huge cash infusions will necessarily be good for that end:
Wouldn't special interests include unions? And the money contributed by corporations has to dwarf the amounts donated by anyone or anything else. This is not good for democracy. Corporations are not people and should only have the rights that we chose that they have.
I personally think gerrymandering is absolutely unconstitutional. However, I think unions in this country are much more damaging and dangerous than gerrymandering.