CLARA:让机器人通过主动提问澄清模糊指令的研究框架
CLARA: A Cognitively-Driven Clarification Framework for Grounding Ambiguous Requests
机器人听不懂"收拾房间"这种模糊话怎么办?这篇论文让 AI 先反问你几个问题,再画图确认,比直接硬干靠谱多了。
论文提出 CLARA(Conversational cLArification for Robotic Arrangement),针对大视觉语言模型(LVLM)在执行"清理房间"这类模糊指令时常假设自己已充分理解的问题。该框架模仿人类的澄清行为,通过有针对性的提问将模糊请求细化为结构化指令。澄清结果再输入扩散模型生成目标场景的视觉渲染图,作为用户确认理解的依据。用户研究显示,CLARA 的输出相比另一个 SOTA LVLM 系统更准确且更一致。
CLARA: A Cognitively-Driven Clarification Framework for Grounding Ambiguous Requests
Robotics and AI systems are increasingly deploying large vision-language models (LVLMs) to follow high-level instructions, from routine household chores to more complex organizational tasks. Yet, broad directives like "clean the room" or "organize the desk" frequently omit crucial details about user preferences and specific arrangement of objects that influence the desired outcome. Without any further guidance, such models tend to overestimate their grasp of ambiguous instructions and frequently assume they have sufficient understanding despite missing important details. In this paper, we propose CLARA (Conversational cLArification for Robotic Arrangement), a cognitively-driven clarification framework that proactively elicits key information from users, in a similar fashion as humans' clarification seeking behavior. Through targeted questioning, CLARA refines ambiguous requests into structured, detailed instructions describing precisely how objects should be organized or rearranged, according to the user's preferences. These clarifications then guide a diffusion-based image generation pipeline, producing realistic visual renderings of the final, desired scene. This final rendering also serves as a visual confirmation of the system's understanding from the user. Experimental results and user studies demonstrate that CLARA leads to more accurate and consistent outcomes compared to another State-of-the-Art LVLM system, highlighting the importance of interactive clarification for bridging the gap between vague directives and fully grounded task specifications.