From what I see we can eliminate it be a gambling chip. Looks like the back was cemented/glue into something

Attached to a walking cane seems to be a good guess.

However it does appear to be ivory. If you want to get rid of it, I'm a buyer/trader.