Apart from the castle the wealthy had their manor houses with inner courtyards within the fortress walls.