84
ChatGPT advises women to ask for lower salaries, study finds
(thenextweb.com)
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 22 Jul 2025
84 points (100.0% liked)
Technology
39130 readers
52 users here now
This is the official technology community of Lemmy.ml for all news related to creation and use of technology, and to facilitate civil, meaningful discussion around it.
Ask in DM before posting product reviews or ads. All such posts otherwise are subject to removal.
Rules:
1: All Lemmy rules apply
2: Do not post low effort posts
3: NEVER post naziped*gore stuff
4: Always post article URLs or their archived version URLs as sources, NOT screenshots. Help the blind users.
5: personal rants of Big Tech CEOs like Elon Musk are unwelcome (does not include posts about their companies affecting wide range of people)
6: no advertisement posts unless verified as legitimate and non-exploitative/non-consumerist
7: crypto related posts, unless essential, are disallowed
founded 6 years ago
MODERATORS
Now I really wanna know if that's actually the best advice or sexism. Because I could see that our society might be so bad that this is genuinely good advice.
It’s neither. LLMs are statistical models: if the training material contains bias (women get lower salaries) the output will reflect that bias.
That's not the question.
It wasn't about whether the LLM was well reasoned, it was about whether the conclusion was (pragmatically speaking) correct.
LLMs do not give the correct answer, just the most probable sequence of words based on the training.
That kind of studies (because there are hundreds) highlight two things:
1- LLMs could be incorrect, biased, or give fake information (the so called hallucinations). 2- the previous point stems from the training material proving the existence of bias in the society.
In other words, having an LLM recommending lower salaries for women is a proof that there is a gender gap.
Again, that wasn't the original question.
The question was about whether women are genuinely more likely to be passed over for a job offer if they ask for as much pay as a man would ask for, or if (as you described), or both. A broken clock is right twice a day, and it's missing the point of the question if you go and explain why you can't rely on said broken clock.
Are hiring managers actually less likely to hire women if they ask for market-rate pay, as opposed to men when they do the same?
If instead of giving passive aggressive replies you would spend a moment to reflect on what I wrote you would understand that ChatGPT reflect the reality, including any bias. In short the answer is yes with high probability.
I can't believe we should ever say this. No, the chat machine is the problem.
The problem is to use LLMs for the wrong things expecting correct answers.
Absolutely, so who is building a study that uses it for the wrong thing and then publishing articles about it
The study wanted to highlight the bias, not to recommend ChatGTP’s advice
The chat machine is just a tool. The problem is that a pay disparity exists in society, and that they did not account for this bias in the training data.
That disparity gets very narrow when you account for men and women with similar roles, education, time in career and industry.
Much of that pay disparity is from the jobs we pick. There are also social pressure where a man's value is determined by how much he makes. Guys are more willing to do dangerous or demanding jobs that pay more.
The AI is still just reflecting the bias
the society is also the problem