论文精选

Utility-Aware多模态对比学习:生成更卖货的商品图

Utility-Aware Multimodal Contrastive Learning for Product Image Generation

精选理由

电商团队和AI产品经理终于有了直接优化销量的图像生成方案——不用再猜哪张图更卖货,模型自己学会了。做商品图生成的开发者建议直接看论文里的损失函数设计。

现有AI生成商品图虽能匹配文本描述,但未直接优化电商转化率。本文提出Utility-Aware InfoNCE损失函数,将消费者需求纳入对比学习,引导模型生成既语义一致又能提升需求的图像。在Amazon和Airbnb数据集上,该方法在提升需求、保持图像保真度和文本一致性方面均优于现有模型。人类实验验证了其商业有效性,且该框架可灵活嵌入新兴生成模型。

原文 · arXiv cs.AI

Utility-Aware Multimodal Contrastive Learning for Product Image Generation

Product images strongly influence consumer decision-making in online marketplaces. Empowered by multimodal contrastive learning, generative AI can output images that closely align with text prompts. Yet existing generative AI models do not directly optimize marketplace performance. This is a critical gap, since semantic alignment alone does not guarantee that an image will sell. To address this limitation, we propose a \textit{utility-aware multimodal contrastive learning} framework that incorporates consumer demand into a novel Utility-Aware InfoNCE loss. Optimizing this utility-aware objective guides generation toward images that are both semantically coherent and demand-enhancing. This effect arises directly from a shift in the learned image-text representation space toward demand-driven visual cues, which we also validate through the theoretical bound of the proposed objective. In downstream applications on Amazon and Airbnb, product images generated and edited by our method outperform state-of-the-art models in increasing demand and preserving fidelity, while maintaining text-image consistency. Notably, our utility-aware framework preserves inverse U-shaped demand patterns for attributes such as aesthetics and uniqueness, improving demand-based performance while preserving fidelity and semantic consistency. Human-subject experiments further validate its commercial effectiveness. As generative AI technology continues to evolve, our utility-aware component can be flexibly embedded into emerging generative models to improve direct commercial use.