There is very little to do on the US side, certainly nothing in walking distance. Would recommend you stay in Canada and you can see a lot more there. You can drive to the US side whenever your want. I think you may now need a passport, you should check.

Below is a link to a great site called TripAdvisor where real people post their experences.

Enjoy, it's a beutiful area!