"that I just say no and keep pockets of lower denomination chips"
That is not what is being said. If the high denom was colored up and given to you, you will have no problem.
