These animals are used because the kangaroo and emu are two of very few animals that are said to be unable to walk backwards. So putting them on the emblem means we "advance Australia" as sung in their national anthem. These creatures symbolise progression forwards.