If you don't want to cheat the post office but still want cheap stamps got to the nearest coin/stamp shop. Most will sell old, uncancelled stamps for 90% of face value.
() 
