The building was built in 1747 by the Dutch East India Company as a residence for the Magistrate. Soon afterwards, a jail, a house for the secretary, a mill and various outbuildings were erected