The other thing that you might need to consider is the gear you are wearing while riding. I noticed that whenever I wear a non-riding jacket, I feel the wind a lot more. Obviously, a bulkier jacket will catch more wind, just like a sail. You'd be surprised that even a regular or tight fitting rain slicker can act like a parachute at 80mph. The tighter the jacket, the more wind will flow around you. I noticed a huge difference when I went to a performance leather jacket.
And not sure what kind of helmet you are wearing, but that can also effect the flow of air around and over your head. Try and make subtle adjustments to your head position, up and down. Ever notice how you feel like your head is going to get torn off when you turn your head to check your sides at high speed? Well, it works the same when your head is forward into the wind. Different helmets have different aerodynamic properties. Some helmets are not only lighter and safer, but they have slightly different shapes to help fight the wind. For example, an Arai Rx-7 has ridges that not only help with airflow inside the helmet, but those ridges also act as spoilers to help direct airflow smoothly over the head.
So before you go out and buy a whole lot of new gear and mods, at higher speeds try to just sit a little further back in the saddle (even just a couple inches will change your geometry completely), keep those elbows low towards your body and keep that head down. You'll get used to the wind eventually. Now a crosswind...that's something I still can't get used to.