It wouldn't surprise me if ND is responsible for a lot of Heisman trophies going to less deserving folks.

Notre Dame Heisman winners:
1943 - Angelo Bartelli
1947 - Johnny Lujack
1949 - Leon Hart
1953 - Johnny Lattner
1956 - Paul Hornung
1964 - John Huarte
1987 - Tim Brown

Finding stats on all players from some of those older ones are rough, but ND would routinely have 3 players in the voting (usually a #3 or #4, then taking up the final slot as well at #9/#10).

1953 - One could definitely make the argument for Paul Giel, who finished as the UPI PotY, AP Back of the Year, and ended up in the CFB HoF

1956 - Jim Brown (Syracuse) and Tommy McDonald (Oklahoma) all had significantly better numbers than both Horung and Majors. Majors finished second in voting, with a statline of 108 Att, 549 Yds, 5.1 Avg, 7 TD, but McDonald had 119 Att, 853 Yds, 7.2 Avg, 12 TD. Jim Brown finished 5th in voting with 158 Att, 986 Yds, 6.2 Avg, 13 TD.

1964 - Jerry Rhome definitely got shafted. John Huarte finished with 114 Cmp, 205 Att, 2062 Yds, 16 TD, 11 In, but Rhome (Tulsa) came in second with 224 Cmp, 326 Att, 2870 Yds, 32 TD, 4 Int. It's crazy when you see that Notre Dame End Jack Snow finished 5th with 60 Rec, 1114 Yds, 18.6 Avg, 9 TD - basically accounting for over half of Huarte's completions, yards and TDs.

Tim Brown was definitely deserving. Lots of great players the year he won, but I don't think he "robbed" anyone.