Pants shopping was a big pain in the butt for me. (Pun totally appropriate, no?!) I completely understand! I may have tried a few men's pants on as well. All I recall is that nothing fit.
I wanted and eventually settled on a pair of women's Dainese pants (to zip into my Dainese jacket) however if they were a 1/2 size larger, they'd be perfect. (They're new this season & in the 'stretch phase' or so I'm told. We'll see by the end of the season.) I'm 5'4" with my own curves & can't wear men's pants. My weight generally never tops 130 (only when I'm bad or during the holidays), waist is 28" & hips a little bigger. Depending on the brand, I can wear either a 4 or 6 in US sizes. My Dainese pants are a Euro size 42. These personal stats better be of some benefit to someone!
I'm not familiar with the Icon brand but if their US mens size 32 works for you - I would consider getting the equivalent in women's - knowing you may have to alter somewhat. I wouldn't give up on women's yet - since they're typically cut to fit our curvier shapes!
Maybe find a women's pair that comes close in one direction or another and then have your retailer order the size you think would work best. But also confirm return policy worn & not worn.
Hope this helps! Good luck!