What Aggregate Scores Miss: Measuring Item-Level Regressions in Commercial LLM API Migrations
Researchers from Xiaonan Xu and Wenjing Wu analyzed the migration of commercial large language model APIs by looking at item-level behavior rather tha...
Researchers from Xiaonan Xu and Wenjing Wu analyzed the migration of commercial large language model APIs by looking at item-level behavior rather tha...
Researchers have developed a system to improve the performance of channel state information (CSI) feedback in wireless communication systems. They pro...
Researchers have developed a method to improve the detection of drones in thermal imagery using synthetic data and real-world training. Synthetic scen...
Researchers investigated whether the ways large language models (LLMs) process information are similar to how humans do. They analyzed responses from ...
Researchers have created a new AI system called MotoSafety to assess collision risk in two-wheeler riders under time pressure. The system uses a large...
Researchers have developed a method to detect when language models are leaking sensitive information. They propose LeakGauge, which adds a suffix to t...
Researchers from various institutions have developed AdaLens, an interactive system for monitoring and steering long-running agentic data analysis. Th...
Researchers have been trying to understand what large language models (LLMs) really know and how they use that knowledge. To do this, they looked at s...
BEAR-Bench is a new benchmark for multimodal models that evaluates their ability to reason about text-dense documents. The benchmark includes 1000 hum...
Researchers have conducted a comparative study of out-of-the-box technology for automatic target detection and recognition (ATD/R). They benchmarked s...
Researchers analyzed how students interact with AI systems while working on programming tasks. They used a taxonomy to classify 830 student inquiries ...
Researchers have proposed a new framework for solving the Lifelong Multi-Agent Path Finding problem, which involves multiple agents navigating through...