Can you not right mouse click on the file and select "cut" and then move your cursor to the other destination and right click the mouse, then click on "paste".
This will remove the whole file from it's original destination for good.