I use a fairly gritty toothpaste and a soft toothbrush. You can scrub off any HS though if you're not careful.
If that don't work, do as Rich H suggests...break out the rasp.
Rick