AI
Compliance, Capability, and Conflict: Benchmarking Multimodal LLMs under System Messages
Researchers have created a benchmark called VSysBench to evaluate how well multimodal large language...
AI
When Irrelevant Text Matters: Affine Margin Shifts in Multimodal Large Language Models
Researchers have found that large language models can be biased by irrelevant text. When given extra...
AI
NepOOC-M: Bilingual Nepali-English Benchmark and Comparative Analysis of Multimodal Architectures for OOC Detection
Researchers have created a benchmark for detecting out-of-context misinformation in Nepal. The NepOO...
AI
A Speech Corpus for Mizo Automatic Speech Recognition: Whisper and SraVaani 1.0 Fine-Tuning with Morphology-Aware Evaluation
Researchers have developed a new Automatic Speech Recognition (ASR) system for the Mizo language. To...
AI
Linguistic Holonomy and Statistical Watermarks: Inner Geometry of Meaning-Preserving Transformations
Researchers have developed a new approach to detecting statistical watermarks in...
AI
SynFlow: A Multidimensional Diachronic Semantic Analysis Toolkit
Researchers have developed SynFlow, an open-source toolkit for analyzing how lan...
AI
Hear2Act: Benchmarking When Prosody Should Change What an Assistant Does
Researchers have developed a new benchmark called Hear2Act to evaluate how proso...
AI
Generating Diverse Personas for User Simulators to Test Interview Dialogue Systems
Researchers from Japan have developed a method to automatically generate diverse...