Something I found on Reddit about Claude:

"The problem is not only they scrape, is they scrape so aggressively it brings server to their knees hammering with hundred, if not thousands of connections coming from different IP address (they use AWS (amazon).) Adding a rule seems to block them, but they love to change the name of the agent on the fly to bypass it said rules."

So good luck Charles...