Also Americans are very fucking fat and lazy, and very much used to their patterns of consumption. If you behave in any way outside of the norm(such as walking at night, or even just fucking walking) you are likely to startle and confuse them.
When this happens the first thing you should do is explain to them that you are having a good day and enjoying your freedom. Say whatever you can to exit their programmed response of control. They can become agitated and violent, but you can absolutely say the correct things to undo their lack of abstract thought.