Named after Frederick, Duke of York, it was built in 1799 by the British during their first occupation of the cape.