Open Character Map from the Search function as I previously described.

When Character Map (or anything else) is open there is an icon on the Taskbar.
Right Click on the icon and a menu will appear.
Click on Pin to Taskbar:

Character Map will be "pinned" to your Taskbar.

Character Map has been around forever, before Windows XP.
It needs upgrading but it's a useful tool.