Except... Admission was £16 a person, and thus we too were turned back by the walls of this Scottish castle