AI

Thinking Before Retrieving: Robust Zero-Shot Composed Image Retrieval via Strategic Planning and Self-Criticism

Researchers have proposed a new framework for zero-shot composed image retrieval. The current approach to this task involves generating a single query from a reference image and text instruction, which can lead to errors in preserving the reference attributes and integrating textual requirements. To address this issue, the authors introduced PEC-CIR, a multi-stage reasoning pipeline that extracts explicit constraints, generates multiple candidate target descriptions, and eval
Researchers have proposed a new framework for zero-shot composed image retrieval. The current approach to this task involves generating a single query from a reference image and text instruction, which can lead to errors in preserving the reference attributes and integrating textual requirements. To address this issue, the authors introduced PEC-CIR, a multi-stage reasoning pipeline that extracts explicit constraints, generates multiple candidate target descriptions, and evaluates these candidates based on constraint compliance. This approach improves retrieval stability by reducing the propagation of generative errors. --- Why it matters: This matters to researchers in AI because it provides a more robust method for zero-shot composed image retrieval, which is an important task in applications such as image editing and generation. The ability to accurately preserve reference attributes and integrate textual requirements can improve the quality of generated images. Source: https://arxiv.org/abs/2606.31222

This article was originally published at: https://arxiv.org/abs/2606.31222