I have never done this or looked into it, but you could retaliate and leave negative feedback for him (if you have not done so already). Then you could suggest that you both agree to remove the negative feedback. "Members that use the eBay Mutual Feedback Withdrawal process will have their feedback rating withdrawn once both members have completed the process." Read here:
http://pages.ebay.com/help/policies/feedback-removal.html

Robert