One man is an island: not all the neighbors love Barry Diller's Hudson River fantasy