Margerum Manor Map, Palacios