The barracks was built as a night time holding place for the convicts who had been shipped over to Sydney.