Have you ever tried baby oil? I've used it on carvings but I'm not sure if it would clean off dirt. Maybe loosen it a bit?
() 