That's true. I know what you mean. When I did a practice draw when I first sat down, my boonie's brim was getting in the way. I had to remove it.
If you want some friendly advice, get a haircut and take a bath. You wouldn't get hassled so much.