I dont think Queen Victoria did, Bu Edward VII definitely did, and held private games etc. I watched a program on it recently. That was mainly when he was Prince of Wales, right around the dates you give.
Other members of the aristocracy did likewise, and they could have easily afforded such chips. We were probably responsible for plundering most of the worlds ivory around that time anyway.