It's true that Homes never spoke that phrase in the Arthur Conan Doyle books.

There are a couple instances where he categorizes something as "elementary," but not with that phrase. It appears in the Basil Rathbone movies (I don't know if it appeared in plays or other movies before then)