A rock formation that looked like a large baboon's head. Hence the name Baboon's castle.