When the full-time whistle blew, angry home fans directed much of their discontent at long-time chairman Daniel Levy.