Most men's stress linked to women