It's not just my opinion, it's based on research. I guess generally beards on men are seen as a sign of virility and fatherhood and that men and women both see it that way. Women are liable to have an affair with such a man. Men though see clean-shaven face as better than ones with stubble.
I've gone back and forth on this and I've heard women say they like the clean-shaven look. I often go without shaving just because I don't feel like it, but it turns out people think it's attractive. Also, I notice it's in fashion these days. I'm often accidentally fashionable.
Grow your beards!