DiverValue-Bench: A Benchmark and Fine-Tuning Framework for Aligning Large Language Models with Diverse Human Values
Researchers have created DiverValue-Bench, a benchmark to evaluate how well large language models align with diverse human values across different cultures and demographics. The framework includes over 23,000 quality-controlled instances from user feedback and is audited through human validation. It provides fine-grained value labels, personalized questions, and demographic metadata. Studies using DiverValue-Bench show that current language models struggle to adapt to differe
Researchers have created DiverValue-Bench, a benchmark to evaluate how well large language models align with diverse human values across different cultures and demographics. The framework includes over 23,000 quality-controlled instances from user feedback and is audited through human validation. It provides fine-grained value labels, personalized questions, and demographic metadata. Studies using DiverValue-Bench show that current language models struggle to adapt to different regions and populations, highlighting the need for more nuanced evaluation methods.
---
Why it matters: This matters because large language models are increasingly being used in real-world applications, but their lack of cultural and demographic awareness can lead to biased or ineffective outcomes. By developing a benchmark like DiverValue-Bench, researchers can better evaluate and improve these models' ability to align with diverse human values.
Source: https://arxiv.org/abs/2509.08022
This article was originally published at: https://arxiv.org/abs/2509.08022