Contact with the oil/resin causes the issue. Not necessarily soaking into the skin.
Sitting on a jacket doesn’t do anything to change the oil composition. There is degradation with oxidation but not enough to fully clear the effect of the oil. In the same way leaving out cooking oil may change a bit and ruin the flavor, but you’ll still have an oily mess.