论文

Pix2Point:用像素级对比学习与可变形状建模检测脊柱关键点

Dense Representation Learning and Differentiable Shape Modeling for Spine Landmark Detection

精选理由

一篇医学影像论文,把脊柱关键点检测改用对比学习来做,代码和权重都开源了,做医学影像定位的可以直接上手试。

该论文将 X 光脊柱关键点检测重构为像素级对比表征学习问题,用密集像素嵌入匹配关键点原型。即使采用通用 U-Net 骨干网络,相比传统热图回归范式,该方法在区分不同椎体的椎角时判别性更好。研究还引入可学习的全局形状先验来解决关键点定位歧义。在公开的 AASCE 数据集及两个私有脊柱 X 光数据集上,该方法在关键点精度和临床参数估计方面达到了与 SOTA 相当的水平,代码与预训练权重已在 GitHub 开源。

原文 · arXiv cs.AI

Dense Representation Learning and Differentiable Shape Modeling for Spine Landmark Detection

Spine landmark detection from spinal X-ray is a key step for estimating spine deformation severity, for building biomechanical models, and for pre-operative planning. We reframe anatomical landmark detection as a pixel-level contrastive representation learning problem, matching dense pixel embeddings with landmark prototypes. Surprisingly, even with a generic U-Net backbone, this formulation results in more discriminative heatmaps compared to the traditional heatmap regression paradigm, leading to improved discrimination between vertebral corners on distinct vertebra. Furthermore, we combine the resulting heatmaps with learnable shape priors over the global configuration of spinal landmarks to resolve ambiguities in landmark locations, yielding a simple and practical approach to spinal landmark detection. Our approach is competitive, in terms of landmark accuracy and clinical parameter estimation, with the state-of-the-art on the public AASCE dataset and on two private spinal X-ray datasets. Our code and pre-trained weights are available at https://github.com/BioMedTP/Pix2Point.