用一阶逻辑引导图扩散模型生成,减少无效图
Logic-Guided Graph Denoising Diffusion Models
用一阶逻辑约束扩散模型,推理时就能减少无效图,做图生成的朋友可以看看
arXiv 论文提出一种把领域知识注入图扩散模型的方法:用一阶逻辑(FOL)表达结构性约束,再通过 classifier guidance 在推理阶段引导预训练模型的去噪轨迹。约束被转化为可微的模糊松弛目标函数,推理时优化该函数以提高逻辑满足度。作者在知识图谱生成任务上对比无条件生成与加入领域本体约束的生成,结果显示满足本体约束的图比例显著提升。该方法只需在 FOL 中声明约束,无需重训模型。
Logic-Guided Graph Denoising Diffusion Models
Graph diffusion models are competitive approaches for generating complex graph-structured data. However, when such distributions have strict structural constraints, diffusion models may fail to capture them exactly, resulting in the generation of invalid graphs. In this paper, we propose a method for grounding graph diffusion models in domain-specific knowledge via First Order Logic (FOL), leveraging its expressive and interpretable formalism to impose structural constraints on the generative process. We incorporate domain knowledge using classifier guidance, a technique that conditions the diffusion model's distribution on external variables to exert control over the sampled data. During the generative process, classifier guidance steers the denoising trajectory to optimize an objective function, which we define as a fuzzy and differentiable relaxation of the logical rules. Our methodology requires only the specification of constraints in FOL, whose satisfaction is encouraged at inference time to guide a pre-trained generative model. We evaluate our approach by comparing the unconditional generation of knowledge graphs with our logic-guided framework, which incorporates domain ontologies as structural constraints during inference. This approach significantly increases the proportion of generated graphs that satisfy the ontological constraints.