I've heard that about men, but haven't found it to be true in my experience. On the other hand, I've only tasted the boyjuice of two different men (I'm rather careful about safer sex), and one tasted much better than the other. The only real difference between the two, intake-wise, was that one smoked and the other doesn't. The smoker didn't taste so good.

I haven't had enough experience with women, while also knowing what they ate/drank/smoked, to make a judgement there.