This is a picture of what it used to look like, they actually had canals from the ocean to fill the moat, and Castle Hallepoort was just one of the entrances to the city.