Are Japan Small Towns Safe For Tourists

Are Japan Small Towns Safe For Tourists

I have heard that locals in small towns of Japan are not very happy with seeing foreign tourists.

Any experiences ?