Spencer House Map, The Colony