"We are the warriors that built this town, from dust" means that the people, like the kid in the previous verses, these warriors, did all of the work for a long time, and now that they deserve a better life, the people who were lazy and had a good time before shouldn't turn away from them.