Not just hermits living in the wilds, Nomads range from those fleeing the City-States to Nomadic tribes wandering the wastes.
Few people truely know freedom, the Wasteland Nomads being one of them. Nomads travel the wasteland, where no Sorcerer-King can claim stake. It is not always the same reason for each nomad why they became such. Some fled the tyranny of the Sorcerer-Kings choosing the harsh desert over the constricting city walls. Others were born into this life style.
From traversing the wastes for so long the Dune Strider is able to thrive in the desert. No trek without water is too great, no sandstorm is able to hamper them.
The worst of the worst, Sand Reavers are the predators of the wastes. Not content with just making do with what they have Sand Reavers are the outlaws of Athas, preying on unsuspecting travellers and tribes. The desert is full of raiders and outlaws and these less than immoral individuals, whether they chose this life or were shaped by the desert only they can answer.