FairStress: A deeper evaluation of fairness in LLM decision-making

FairStress is a new benchmark designed to evaluate demographic fairness in large language models (LLMs) by measuring how models respond to persuasive arguments that favor different demographic groups. Testing across various models and domains reveals asymmetries in decision changes and explanations, highlighting hidden biases beyond final outputs.