A fascinating house and history of the first settlers, with a significant Scottish flavour