An oily rag was an item used in the quest, Unstable Foundations. Players had to first rip a rag into half, pour oil over the rag to make the rag an oily rag.
The oily rag was used to help defeat the dragon in the tutorial quest by helping to start a fire on a pillar, causing it to collapse.