Getting rid of the garden would detract from the late 19th century robber baron's country house aethetic.