returning the thing was, in your opinion, the right thing, I don't think that you were wrong. The other issue is for that person - perhaps they think that they responded appropriately. It's probably not what you or I would have done, but it's their call. Their response shouldn't have you wondering if you're wrong. IMHO anyway.
Dave