Barkley has a stern message for NFL fans hating on Taylor Swift