Hi Travis,
I would use a little baking soda and a tooth brush. If that doesen't fix it purchase a very fine steel wool and rub ever so lightly. Do not use any substance that will hurt the inlay. Once you get the stuff off - put a little vitamin E-oil on it to restore the clor brightness. Best, Jim