I give credit where credit's due. Their OLs were good to very good under Sherman, their DLs have been quite good the last few years, and of course Johnny Football was a superstar at the college level (and a major league muff on our recruiting staff).
For me, the reason aggies generally tend to be so annoying is that they have a massively overinflated, and frankly delusional, view of themselves, their school, and their sports teams, and they won't ever shut up about it. When our teams suck, most Longhorns know it and, if anything, are too hard on our team.* As a group, we're definitely not delusional about it.
*in that way, as a group we're closer to NY sports fans than to aggies.