In the last episode of Game of Thrones season 4, Stannis's army comes and kills the wildings. It's great but which path did they take to go behind the wall?
The wildings want to go to the other side of the wall, if there is an easier way than go through Castle Black, why don't they take it?