The former England and Manchester United star said he loved watching rugby union matches at Twickenham compared to the "nastiness" of football stadiums